The Computer Orchestra is a crowdsourcing platform, created by Simon de Diesbach, Jonas Lacôte, Laura Perrenoud, that allows users to create and conduct their own orchestra.
Users can choose to upload their own music or download samples to integrate into their formation Once the ‘orchestra’ is configured, users can direct it with the movements of their body.
Here’s a demo of the Computer Orchestra:
How The Computer Orchestra Works
A Kinect detects the director’s movements and transmits the data to Processing via the SimpleOpenNI library.
Processing then sends a signal to the corresponding computers via wifi. These then play the samples that are assigned to them and generate a visual derived from the outgoing sound.
In this manner, the ‘musician-screens’ not only send sound back to the director, but also visual feedback.