MATTEO FONTANA
Your Pathway Combination
DIGITAL ARTS AND MUSIC TECH
The title of your etude
VIDEO INTERACTION AND CAMERA TRACKING ART
A short statement of intentions
I WOULD LIKE TO CREATE A VIDEO INSTALLATION THAT INTERACT WITH THE SHADOW OF THE PEOPLE STANDING IN FRONT OF THE SCREEN.
I HAVE SEEN LOT OF INSTALLATION LIKE THAT BUT NO ONE EXPLAIN HOW TO REALIZE THIS KIND OF PROJECT.
CAMILLE UTTERBACK is one of the first artist I have seen doing an installation like that. the picture above is from her project "Text rain" that involve Participants (using the familiar instrument of their bodies, to do what seems magical - to lift and play with falling letters that do not really exist. In the Text Rain installation participants stand or move in front of a large projection screen. On the screen they see a mirrored video projection of themselves in black and white, combined with a color animation of falling text. Like rain or snow, the text appears to land on participants' heads and arms. The text responds to the participants' motions and can be caught, lifted, and then let fall again. The falling text will land on anything darker than a certain threshold, and "fall" whenever that obstacle is removed)"http://www.camilleutterback.com/
Later on I found out other interesting piece that uses the same technique...............
zack booth Simpson & Ken Demarest ... they create a similar installation to "Text rain" but this time using sand
"A stream of liquid sand flows from above and reacts with your shadow as if it were solid. Its hypnotic motion conjures childhood feelings of playing with water or building wet sandcastles. Like making shadow puppets, you can easily construct concave structures with your hands to catch the sand and then you can pour it from hand to hand or maybe into your friend's mouth. Play with it long enough and you might discover some of its many secrets."(http://www.mine-control.com/sand.html)
WHAT I HAVE UNDERSTAND SO FAR: THE MATERIAL NEEDED IS A PROJECTOR, A CAMERA THAT STREAM THE SIGNAL OF THE PROJECTION STRAIGHT INTO A SOFTWARE. THE PROBLEM IS THAT MOST OF THE SOFTWARE THAT CREATE THIS PROJECT ARE CUSTOM BUILT.
ALL THE APPLICATION AND CODING THAT I HAVE FOUND TEND TO BE CLOSED SOURCE
SO THAT I FIGURED TO START CODING WITH "PROCESSING" WHICH IS AN OPEN SOURCE APPLICATION
THAT EXPLAIN WITH SOME EXAMPLES HOW TO CONNECT A VIDEO PROJECTION INTO A COMPUTER
AND INTERACT WITH IT.
I START TO BUILD SOME SMALL VIDEO WITH ANOTHER OPEN SOURCE SOFTWARE "FLXER" BUT THE CODING I'VE TRIED SUDDENLY DON'T WORK:
Import processing.video.*;
// Variable for capture device
Capture video;
color trackColor;
void setup()
{
size(200, 200);
frameRate(30);
colorMode(RGB,255,255,255,100);
// Using the default capture device
video = new Capture(this, 200, 200, 12);
trackColor = color(0); // Start off tracking for white
noFill();
smooth();
strokeWeight(4.0);
stroke(0);
}
void captureEvent(Capture camera)
{
camera.read();
}
void draw()
{
loadPixels();
// Draw the video image on the background
image(video,0,0);
// Local variables to track the color
float closestDiff = 100.0f;
int newx = 0;
int oldx = 0;
int oldupdatex = 0;
int closestX = 0;
int closestY = 0;
int updatex = 0;
int[] Xs = new int[2];
Xs[0] = 0;
Xs[1] = 0;
int[] upXs = new int[2];
upXs[0] = 0;
upXs[1] = 0;
int count = 0;
// Begin loop to walk through every pixel
for ( int x = 0; x < video.width; x++) {
// for ( int y = 0; y < video.height; y++) {
// int loc = x + y*video.width;
int loc = x + (video.width * 100);
// What is current color
color currentColor = video.pixels[loc];
float r1 = red(currentColor); float g1 = green(currentColor); float b1 = blue(currentColor);
float r2 = red(trackColor); float g2 = green(trackColor); float b2 = blue(trackColor);
// Using euclidean distance to compare colors
float d = dist(r1,g1,b1,r2,g2,b2);
// If current color is more similar to tracked color than
// closest color, save current location and current difference
if (d < closestDiff) {
// println (Xs[0] + " " + Xs[1]);
// if (x > 0){
// println (Xs[0] + " " + Xs[1]);
closestDiff = d;
closestX = x;
Xs[0] = Xs[1];
Xs[1] = x;
// }
// else {Xs[0] = 999;
// Xs[1] = 0;
// }
}
I AM GOING ON TRYING TO LEARN THE CODING FOR THIS APPLICATION AND I THINK I AM WILLING TO BUY ONE ARDUINO CHIP AS WELL.
AS I UNDERSTAND I WILL HAVE MORE POSSIBILITIES.
conceptualization of the work
I THINK THAT THE CONCEPT BEHIND THOSE KIND OF INSTALLATIONS IS THE RELATION BETWEEN THE HUMAN MESSAGE AND THE MACHINE.
CONSIDERING THAT THE SOFTWARE IS AN APPLICATION BUILT BY SOMEONE, IS EASY TO INTERACT
WITH A VIDEO, RESPONDING TO THE MESSAGE THAT THE ARTIST WANT TO GIVE.
USING YOUR BODY IS POSSIBLE TO INTERACT WITH THIS MESSAGE AND JUST FOLLOWING YOUR SENSES GIVE AN UNIQUE RESPONSE. IN THIS CASE WHAT IS CONSIDERED AS ART, IS NOT THE PIECE ITSELF, BUT THE MESSAGE THAT CAME OUT WITH THIS HI-TECH TOOL.
write about
I THINK THAT THE MAIN POINT OF A COMMUNICATION IS THE RESPONSE YOU CAN GET FROM SOMEONE.
LIKE THAT, YOU CAN UNDERSTAND IF YOU STATEMENT ARE CORRECT, OR IS SIMPLY SATISFYING HAVING A SORT OF RESPONSE......
WITH A VIDEO INTERACTIVE INSTALLATION THIS RESPONSE CAN BE GIVEN IN A DIFFERENT AND MORE ARTISTIC WAY LEADING THE ARTIST INTO A MORE INSPIRATIONAL STATE, BECAUSE THE DIALOGUE IS JUST DIFFERENT.
how successful is the Etude
THIS RESEARCH BROUGHT ME INTO A FIELD I HAVE NEVER CONSIDER.
AT THE END I COULDN'T GET WORKING THE CODE BUT SEEING OTHER PEOPLE PROJECT KEPT ME GOING ON. I THINK THAT I'LL CAME OUT WITH SOMETHING MAYBE ASKING SOME HELP TO THOSE GUYS THAT ALREADY DID THIS INSTALLATION.
