Here’s what he has to say about it:
“Synth1 was one of the first plugins I downloaded when starting to make music. Its versatility lies in its simplicity – and a massive collection of user generated presets. So as a CS person who’s interested in the fusion of machine learning and music, who could ask for a better dataset?
This project was heavily inspired by Nintorac’s This DX7 Cartridge Does Not Exist. Make sure to check that out also!
I used a Generative Adversarial Network (GAN), which is essentially making two neural networks fight against each other for our own benefit.
The AI is made up of two parts, a generator and a discriminator. The discriminator learns to detect whether a given preset is fake or not, while the generator learns how to fool the discriminator. Over time, the discriminator gets better at detecting fakes, while the generator gets better at generating fakes. At the end, the generator ends up producing pretty convincing fakes, which are then sent to you!
The names are generated from a Recurrent Neural Network (RNN) based off of the synth parameters. There’s a lot of duplicates however, further training and model finagling is needed.”
You can preview examples of the AI-generated patches below:
See the site for details.