ETUDE 4: SOUND ATMOSPHERE PLAYGROUND

Your name

MATTEO FONTANA

Your Pathway Combination

DIGITAL ARTS & MUSIC TECH

The title of your etude

SOUND ATMOSPHERE PLAYGROUND

A short statement of intentions

I AM TRYING TO CREATE A SOUND ENVIRONMENT THAT EVOLVE OR CHANGE THANKS TO THE MOVEMENT CAPTURED BY SOME SENSORS


What you initially wanted the piece to be about / for - its conceptions How you initially intend to create the etude

I WOULD LIKE TO BUILT A SORT OF INTERACTIVE AUDIO SPACE USING SOME PRESET LIBRARIES.
THE SOUNDS PRESENT RESPOND THANKS TO THE SENSOR PLACED IN THE INSTALLATION AREA.

Conceptualization of the work

I WOULD LIKE TO RECREATE A PARTICULAR ATMOSPHERE FOR THE PLACE I WILL CHOOSE,
WHAT IS IMPORTANT IS WHERE I AM GOING TO SET UP THE INSTALLATION, IN FACT THE SURROUNDING NEED TO BE LINKED WITH THE SOUND IN ORDER TO REFLECT WHAT THE SPECTATOR IS SEEING.
THE IDEA IS TO GIVE A SORT OF SENSATION THAT SOMETIMES IS POSSIBLE TO SENSE WHEN YOU STAND IN FRONT OF A LANDSCAPE, OBVIOUSLY EVERYONE DOES USE THEIR OWN JUDGMENT TO INTERPRET WHAT IS SEEN.
LEADING THE PEOPLE THROUGH A SENSORS BASED PATH, HOPEFULLY IT WILL GIVE THE SENSATION ON INTERACT WITH THE PLACE, AND IN A CERTAIN WAY, HAVE THE POSSIBILITY TO CONTROL THE ATMOSPHERE ITSELF.


I ALWAYS BEEN INTERESTED ON IMAGES AND VIDEO BUT I REALIZE THAT A SOUND OR A TRACK IS STILL VERY IMPORTANT IN A VISUAL INSTALLATION. THE SOUNDS GIVE US A SORT OF PERCEPTION THAT LEAD US THROUGH A PARTICULAR MOOD AND MAKE US PERCEPT WHAT IS AROUND US IN A MORE INTENSE WAY. OBVIOUSLY EVERYONE OF US HAVE HIS OWN PERCEPTION OF SOUND AND IMAGES. TAKING CONTROL OF THE SOUNDS CAN REALLY CHANGE THE WAY OF WHAT WE ARE LOOKING.
DEVELOPMENT:

FOR FIRST I STARTED TO THINK ABOUT FEW FEELINGS THAT ARE EXPERIENCED EVERY DAY ALMOST
BY EVERYBODY.
I USED LOGIC AND FEW RECORDING I HAVE MADE TO COMPILE SOME TRACKS.
THE CONCEPT IS REALLY SIMPLE.
I HAVE MANAGED TO DRAW A PATH IN A NORMAL PLAYGROUND AND THE IDEA IS TO PLACE SOME SENSOR THAT ACTIVATE THE SOUND WHILE A PERSON IS PASSING NEARBY.
THE SENSOR WILL NOT ONLY ACTIVATE THE SOUND BUT THEY WILL AFFECT EVEN HIS CONTENT. IT IS POSSIBLE TO CONNECT THE IMPULSE, WITH SOME EFFECT USING THE AUTOMATION TOOL PRESENT IN THE MOST COMMON MUSIC PROGRAM SUCH, ABLETON LIVE, LOGIC, CUBASE ETC.. ETC.. WITH THIS PROCESS THE SENSOR WILL READ THE MOVEMENT INTO THE SUPPORTED RANGE AREA AND IT WILL AFFECT IN REAL TIME THE SOUND PLACED IN THAT PARTICULAR POINT.

CONNECTING THE SENSORS:

I FOUND ON INTERNET THE MIDIsense (WWW.adafruit.com) THAT ALLOW QUITE EASILY TO CREATE A BOARD ALREADY EQUIPPED WITH SENSORS. UNFORTUNATELY THE SITE DON'T SELL THE BOARD ALREADY MADE BUT ONLY THE KIT WHICH MEANS YOU NEED TO HAVE THE PROPER TOOLS AND YOU NEED TO BE REALLY CAREFUL IN ORDER TO DON'T AFFECT THE BOARD WITH THE ELECTRICITY YOU CAN TRANSMIT WITH YOU HANDS.


I DIDN'T BUY YET THE BOARD BUT I THINK THAT THIS IS THE BEST SOLUTION.
"there are 3-4 different boards. Each board is customized to handle a particular kind of sensor. For example, one board handles 'resistive' type sensors: force, bend, and photosensors all act like variable resistors, and require a certain kind of conditioning circuitry. Another board will handle 'capacitive touch' button sensors: this type of sensor requires a specific chip to function. And so on. "

ETUDE: 3 video interactive installations

Your name

MATTEO FONTANA

Your Pathway Combination

DIGITAL ARTS AND MUSIC TECH

The title of your etude

VIDEO INTERACTION AND CAMERA TRACKING ART

A short statement of intentions

I WOULD LIKE TO CREATE A VIDEO INSTALLATION THAT INTERACT WITH THE SHADOW OF THE PEOPLE STANDING IN FRONT OF THE SCREEN.
I HAVE SEEN LOT OF INSTALLATION LIKE THAT BUT NO ONE EXPLAIN HOW TO REALIZE THIS KIND OF PROJECT.


CAMILLE UTTERBACK is one of the first artist I have seen doing an installation like that. the picture above is from her project "Text rain" that involve Participants (using the familiar instrument of their bodies, to do what seems magical - to lift and play with falling letters that do not really exist. In the Text Rain installation participants stand or move in front of a large projection screen. On the screen they see a mirrored video projection of themselves in black and white, combined with a color animation of falling text. Like rain or snow, the text appears to land on participants' heads and arms. The text responds to the participants' motions and can be caught, lifted, and then let fall again. The falling text will land on anything darker than a certain threshold, and "fall" whenever that obstacle is removed)"http://www.camilleutterback.com/

Later on I found out other interesting piece that uses the same technique...............

zack booth Simpson & Ken Demarest ... they create a similar installation to "Text rain" but this time using sand



"A stream of liquid sand flows from above and reacts with your shadow as if it were solid. Its hypnotic motion conjures childhood feelings of playing with water or building wet sandcastles. Like making shadow puppets, you can easily construct concave structures with your hands to catch the sand and then you can pour it from hand to hand or maybe into your friend's mouth. Play with it long enough and you might discover some of its many secrets."(http://www.mine-control.com/sand.html)



WHAT I HAVE UNDERSTAND SO FAR: THE MATERIAL NEEDED IS A PROJECTOR, A CAMERA THAT STREAM THE SIGNAL OF THE PROJECTION STRAIGHT INTO A SOFTWARE. THE PROBLEM IS THAT MOST OF THE SOFTWARE THAT CREATE THIS PROJECT ARE CUSTOM BUILT.
ALL THE APPLICATION AND CODING THAT I HAVE FOUND TEND TO BE CLOSED SOURCE

SO THAT I FIGURED TO START CODING WITH "PROCESSING" WHICH IS AN OPEN SOURCE APPLICATION
THAT EXPLAIN WITH SOME EXAMPLES HOW TO CONNECT A VIDEO PROJECTION INTO A COMPUTER
AND INTERACT WITH IT.
I START TO BUILD SOME SMALL VIDEO WITH ANOTHER OPEN SOURCE SOFTWARE "FLXER" BUT THE CODING I'VE TRIED SUDDENLY DON'T WORK:

Import processing.video.*;

// Variable for capture device
Capture video;
color trackColor;


void setup()
{
size(200, 200);
frameRate(30);
colorMode(RGB,255,255,255,100);
// Using the default capture device
video = new Capture(this, 200, 200, 12);
trackColor = color(0); // Start off tracking for white
noFill();
smooth();
strokeWeight(4.0);
stroke(0);
}

void captureEvent(Capture camera)
{
camera.read();
}

void draw()
{

loadPixels();

// Draw the video image on the background
image(video,0,0);
// Local variables to track the color
float closestDiff = 100.0f;
int newx = 0;
int oldx = 0;
int oldupdatex = 0;
int closestX = 0;
int closestY = 0;
int updatex = 0;
int[] Xs = new int[2];
Xs[0] = 0;
Xs[1] = 0;

int[] upXs = new int[2];
upXs[0] = 0;
upXs[1] = 0;

int count = 0;

// Begin loop to walk through every pixel
for ( int x = 0; x < video.width; x++) {
// for ( int y = 0; y < video.height; y++) {
// int loc = x + y*video.width;
int loc = x + (video.width * 100);
// What is current color
color currentColor = video.pixels[loc];
float r1 = red(currentColor); float g1 = green(currentColor); float b1 = blue(currentColor);
float r2 = red(trackColor); float g2 = green(trackColor); float b2 = blue(trackColor);

// Using euclidean distance to compare colors
float d = dist(r1,g1,b1,r2,g2,b2);
// If current color is more similar to tracked color than
// closest color, save current location and current difference
if (d < closestDiff) {
// println (Xs[0] + " " + Xs[1]);
// if (x > 0){

// println (Xs[0] + " " + Xs[1]);

closestDiff = d;
closestX = x;
Xs[0] = Xs[1];
Xs[1] = x;
// }
// else {Xs[0] = 999;
// Xs[1] = 0;
// }

}


I AM GOING ON TRYING TO LEARN THE CODING FOR THIS APPLICATION AND I THINK I AM WILLING TO BUY ONE ARDUINO CHIP AS WELL.
AS I UNDERSTAND I WILL HAVE MORE POSSIBILITIES.

conceptualization of the work

I THINK THAT THE CONCEPT BEHIND THOSE KIND OF INSTALLATIONS IS THE RELATION BETWEEN THE HUMAN MESSAGE AND THE MACHINE.
CONSIDERING THAT THE SOFTWARE IS AN APPLICATION BUILT BY SOMEONE, IS EASY TO INTERACT
WITH A VIDEO, RESPONDING TO THE MESSAGE THAT THE ARTIST WANT TO GIVE.
USING YOUR BODY IS POSSIBLE TO INTERACT WITH THIS MESSAGE AND JUST FOLLOWING YOUR SENSES GIVE AN UNIQUE RESPONSE. IN THIS CASE WHAT IS CONSIDERED AS ART, IS NOT THE PIECE ITSELF, BUT THE MESSAGE THAT CAME OUT WITH THIS HI-TECH TOOL.

write about

I THINK THAT THE MAIN POINT OF A COMMUNICATION IS THE RESPONSE YOU CAN GET FROM SOMEONE.
LIKE THAT, YOU CAN UNDERSTAND IF YOU STATEMENT ARE CORRECT, OR IS SIMPLY SATISFYING HAVING A SORT OF RESPONSE......
WITH A VIDEO INTERACTIVE INSTALLATION THIS RESPONSE CAN BE GIVEN IN A DIFFERENT AND MORE ARTISTIC WAY LEADING THE ARTIST INTO A MORE INSPIRATIONAL STATE, BECAUSE THE DIALOGUE IS JUST DIFFERENT.

how successful is the Etude

THIS RESEARCH BROUGHT ME INTO A FIELD I HAVE NEVER CONSIDER.
AT THE END I COULDN'T GET WORKING THE CODE BUT SEEING OTHER PEOPLE PROJECT KEPT ME GOING ON. I THINK THAT I'LL CAME OUT WITH SOMETHING MAYBE ASKING SOME HELP TO THOSE GUYS THAT ALREADY DID THIS INSTALLATION.