Gestural Synth Jam With Airbending

Developer Asep Bagja shared this synth jam, created with the Airbending camera-based MIDI controller.

AirBending is a macOS app that transforms hand gestures into musical expression using computer vision and MIDI technology. It tracks hand movements in real-time using Apple’s Vision framework, detecting precise hand poses and finger positions.

With dual-camera control, you can control multiple MIDI devices using up to two camera inputs, and each camera can have its own preset.

AirBending is one of the nominees in the Accessible category of the 2025 MIDI Innovation Awards, an annual event, organized by The MIDI Association, NAMM, and Music Hackspace. The awards highlight products and projects that use MIDI 1.0 and 2.0 in novel ways.

Here’s another example of Airbending in action:

The developer says that AirBending can make music-making more accessible by eliminating eliminating the need for special instruments and devices. Unlike traditional MIDI controllers that require touching keys, knobs, or faders, AirBending transforms the surrounding space into a musical instrument using only hand gestures and built-in Mac camera, without the need for additional hardware.

This provides a new option for people that may not have access to, or may not be physically able to use traditional MIDI controllers.

You can find out more about Airbending at the developer’s site.

6 thoughts on “Gestural Synth Jam With Airbending”

  1. Isn’t airbending already a registered trademark of Nickelodeon? I am pretty sure if someone invented a synthesizer and called it a Ford Bronco, there would be some legal communication occurring in rapid succession. Image-Line did not stop calling their product Frooty Loops just because they were tired of it. Kellogg’s had a bit to say about that. Likewise, the erotic comic book series Cherry Pop-Tart because simply Cherry post haste. Kellogg’s in particular seems adamantly pernicious in defense of their public image.

    1. gridsleep – It sounds like you’re a little confused about how trademarks work.

      Trademarks are generally granted for specific categories.

      Think about Apple. Apple’s got the trademark when it comes to computers and related products. But they had to work out an agreement with the Beatles, who own the Apple record label, when they wanted to get into music products.

      ” I am pretty sure if someone invented a synthesizer and called it a Ford Bronco, there would be some legal communication occurring in rapid succession. ”

      Nope. Think about the Moog Taurus and the Ford Taurus. Both companies got the same name approved, because there was zero chance of brand confusion because they were in completely different categories.

      1. It may be more specific in this case, because “airbending” seems to be a made-up word, and the gesticulations look a bit like the things in the tv show. I’m not a lawyer, but trademark dilution is a thing.

        The app looks like a really fun idea by the way. Maybe Nickelodeon will even endorse it!

  2. I came up with a similar idea that operates differently but does much of the same thing: mine captures motions and transforms them into MIDI signals of various types. As far as I understand it, his recognizes objects, like in this case, his hands, and then does the same with that data. I think it is a cool idea either way! A performance of mine is here: https://youtu.be/0gNwa8kTf9A?si=u1fRFKQ8nNHdRECI

Leave a Reply

Your email address will not be published. Required fields are marked *