Jan van Nuenen’s Flowers is an interesting experimental electronic music video that explores the idea of using the Monome to control audio and video generation at the same time. 

Here’s how it works:

The home made Monome is connected to a max/msp patch called boiingg (great app for the monome).

Max sends midi to Ableton <ive, triggering some Operator synths and…

Live generates a string of midinotes with velocity 0 to 20 and back to 0. The velocity channel is used to tell the game engine which frame of the loop will be displayed. In this case, a loop of a growing flower is playing from frame 0 to 20 and back. So you can re-animate the flower by changing the velocities. Framerate can be changed by changing bpm in live. This technique also allows you to change in and out points of the loop live. 

This string of midinotes is send to the NuPlay midi client, which sends it to the right object trigger inside the game engine.

More details at Nuenen’s site. 

via Oliver Chesler