Z Vector is a new visualization tool that lets you use depth sensors, like the Microsoft Kinect and PrimeSense Carmine, “to sample reality in real-time, visualize it the way you like and explore it in 3D with Full HD resolution.”
Designed to be a live performance tool, rather than a programming environment, Z Vector can animate nearly every variable within the software, using integrated sound analysis algorithms, synthetic rhythms or via externally triggered MIDI/OSC signals. Continue reading →
The V Motion Project is a striking multimedia project that combines the talents of musicians, dancers, programmers, designers and animators to create a ‘visual instrument’ that uses the Microsoft Kinect to capture movement and translate it into music and visuals.
Here’s what the developers have to say about the V Motion Project and the video above:
We created and designed the live visual spectacle with a music video being produced from the results. We wanted it to be clear that the technology was real and actually being played live. The interface plays a key role in illustrating the idea of the instrument and we designed it to highlight the audio being controlled by the dancer. Design elements like real time tracking and samples being drawn on as they are played all add to authenticity of the performance.
The visuals are all created live and the music video is essentially a real document of the night.
Kinect MIDI Controller is an open source project designed to let you use a Microsoft Kinect as a MIDI controller.
The the project uses Microsoft Kinect SDK to track the skeletal data.
The Kinect SDK provides the logic to detect the X and Y Co-ordinates of a user’s hands. The X & Y Co-ordinates are then scaled and converted to MIDI messages. These MIDI messages are then sent to the MIDI output port. The tool contains a .NET Wrapper for the MIDI interfacing methods provided by winmm.dll Win32 API.
This is an example performance of what you can do with Ryan Challinor’s Synapse for Kinect tools combined with Ableton Live and Quartz Composer.
Synapse is an app for Mac and Windows that allows you to use your Kinect to control Ableton Live, Quartz Composer, Max/MSP/Jitter, and any other application that can receive OSC events. It sends joint positions and hit events via OSC, and also sends the depth image into Quartz Composer. This allows you to use your whole body as an instrument.