Sunday Synth Jam: Composer and media artist Steve Joslin shared this video, capturing a live performance of Channeling Rachmaninoff.

The performance features a custom instrument, created by Joslin, the Lux Codex. The Lux Codex uses computer vision to read levels of RGB light, through a piano roll, to generate data. In the performance, Joslin uses the data generated by the hand-cranked piano role to manipulate audio and visuals in real-time.

Technical Details:

MaxMSP to read the light data and Jitter to create visual content. Kyma for audio.

Program Notes:

Multichannel, real-time, interactive composition for Lux Codex, MaxMSP, and Kyma.

Rachmaninoff’s Prelude in C# Minor is deconstructed using light. Data derived from a player piano roll of Rachmaninoff’s Prelude in C# Minor is used to reinterpret an audio recording of the Composer performing his piece. In this way, Rachmaninoff is mapped onto a recording of Rachmaninoff – performing Rachmaninoff.

All sounds were derived solely from the audio recording of this composition. Visuals elements are controlled in real-time.

This performance premieres a new Data-Driven Instrument, the Lux Codex. Lux Codex (light code) is a type of projector that uses three colors of light to reinterpret music from paper rolls made for player pianos.

By detecting projected light through these rolls, the Lux Codex transforms the physical code from the piano roll into robust data streams used to control aspects of the sonic and visual elements of the live performance.

Steve designed the Lux Codex for the sole purpose of reinterpreting piano rolls in real-time.