The web cam was put on to a clamp and then fiducial markers were laid out in front of the camera. The camera is connected to the application ReacTIVision 1.4, which is programmed to track these markers and enable multi-touch finger tracking.
Below is an example of the Flash interface which uses the TUIO protocol to connect to the ReacTIVision application.
Below is an example of the fiducial markers seen through the web cam. On a closer look the markers are labelled on paper, and the green numbers show the application has recognised markers. The green text on the left demonstrates the short cuts that can be used within the application.
This is an example of what can be seen in flash when the markers are moved. They are represented as grey boxes and track the markers where ever they move. At the moment when they are moved the hand will interrupt the signal, so it the camera would need to be below the table and lit by an LED light.
So now, the sensors are set up and working. The next step is to research how to get the sound samples working with this. The sound can be added through changing the .xml code in the reativision application to work in MIDI mode. Used in conjuction with Abelton Live or Reaktor music technology software the sound will play when the marker is moved by the user.
