Nagual Dance Uses Kinect To Translate Movement Into Music

Berlin-based Nagual Sounds has developed a new gestural musical instrument, Nagual Dance, based on the Microsoft Kinect.

The system is based on two main components:

  • Control data – from sensors, cameras, files and all kinds of sources – is used to turn gestures and movement into sounds; and
  • The Soundscape -an interactive piece of music that doesn’t consist of pre-recorded musical sequences, but of musical possibilities. The music decides the behavior of the used data source.

In the example above, a Kinect camera is used by Nagual Dance to control the Soundscape ‘Firedance’.

Here’s how it works: Continue reading

Z Vector + Microsoft Kinect Lets You ‘Sample Reality’ In 3D HD


Z Vector is a new visualization tool that lets you use depth sensors, like the Microsoft Kinect and PrimeSense Carmine, “to sample reality in real-time, visualize it the way you like and explore it in 3D with Full HD resolution.”

Designed to be a live performance tool, rather than a programming environment, Z Vector can animate nearly every variable within the software, using integrated sound analysis algorithms, synthetic rhythms or via externally triggered MIDI/OSC signals.  Continue reading

Kinect + 3D Graphics + Dubstep = The V Motion Project

The V Motion Project is a striking multimedia project that combines the talents of musicians, dancers, programmers, designers and animators to create a ‘visual instrument’ that uses the Microsoft Kinect to capture movement and translate it into music and visuals.

Here’s what the developers have to say about the V Motion Project and the video above:

We created and designed the live visual spectacle with a music video being produced from the results. We wanted it to be clear that the technology was real and actually being played live. The interface plays a key role in illustrating the idea of the instrument and we designed it to highlight the audio being controlled by the dancer. Design elements like real time tracking and samples being drawn on as they are played all add to authenticity of the performance.

The visuals are all created live and the music video is essentially a real document of the night.

Continue reading

Use A Microsoft Kinect As A MIDI Controller

YouTube Preview Image

Kinect MIDI Controller is an open source project designed to let you use a Microsoft Kinect as a MIDI controller.

The the project uses Microsoft Kinect SDK to track the skeletal data.

The Kinect SDK provides the logic to detect the X and Y Co-ordinates of a user’s hands. The X & Y Co-ordinates are then scaled and converted to MIDI messages. These MIDI messages are then sent to the MIDI output port. The tool contains a .NET Wrapper for the MIDI interfacing methods provided by winmm.dll Win32 API.

Details are available the project site.

Controlling A 4-Story Pipe Organ WIth The Kinect

YouTube Preview Image

Developer/producer Chris Vik explains a new work, Carpe Zythum, in which he uses a Microsoft Kinect to conduct a MIDI performance:

I’ve created my own software “Kinectar“, which allows the use of the Kinect to control MIDI devices, ie. playing notes through simple gestures and motion.

The Melbourne Town Hall Organ got a referb in the late 90s adding the ability of MIDI messages to active the notes… and so, this happened.

The Kinectar Performance Platform is a toolkit that allows you to use your Microsoft Kinect sensor as a fully-fledged MIDI controller.

Continue reading

Kinect Dubstep Jam With Synapse

YouTube Preview Image

This is an example performance of what you can do with Ryan Challinor’s Synapse for Kinect tools combined with Ableton Live and Quartz Composer.

Synapse is an app for Mac and Windows that allows you to use your Kinect to control Ableton Live, Quartz Composer, Max/MSP/Jitter, and any other application that can receive OSC events. It sends joint positions and hit events via OSC, and also sends the depth image into Quartz Composer. This allows you to use your whole body as an instrument.

You can download Synapse for Kinect at Challinor’s site. Continue reading