Video To Sound Synthesis

This video, via Matthijs van Henten, demonstrates his real-time video-to-sound conversion app,

The color-tracker was created using Python and OpenCV, using a basic contour tracker on a thresholded HSV channeled image. For each blob, a histogram is calculated.

The most prominent Hue value is then taken as input for the base tone. Information about the size of the contour and it’s position is used to manipulate amplitude.

The sound was made using a simple Pure-data patch.

You can download the source code at Henten’s code site.

Leave a Reply