Mark Mosher interviewed Tim Thompson for this first look at Thompson’s Kinect-based instrument, MultiMultiTouchTouch:
MultiMultiTouchTouch is custom solution invented by Tim Thompson that offers players any number of arbitrarily-shaped multitouch areas with three-dimensional spatial control.
Interaction with this space allows users to control and play virtual synthesizers using a Microsoft Kinect as the controller.
In this video Mark Mosher interviews Tim, who offers a behind-the-scenes look at the technology. At the end of the video Mark gives MultiMultitouchTouch a try.
Thompson’s MultiMultiTouchTouch is built with these components:
- Microsoft Kinect (with power supply)
- KeyKit which is Tim’s own programming language and graphical environment for MIDI
- Cinder Open Source SDK
- Open Source Computer Vision (OpenCV)
- Open Sound Control (OSC)
- Python, used to implement a GUI for parameter control
- HP Laptop running Windows 7
- A wood frame for calibration (wood frame is not required once the frames have been calibrated).
The raw output of this controller is OSC messages formatted using the TUIO (multitouch) standard format. Parameters of the software can be controlled with JSON-formatted messages.
More interviews like this at Mosher’s ModulateThis!
awesome!
thought there would have been more comments on this, – what an initiative instrument
This is kind of cool as a tech demo, but not very useful as an instrument.
What's the latency like?
That is pretty bad ass.
it will be useful for realtime soundtrack making