Teenage Engineering has collaborated with Google to create Pocket Operator for Pixel phones.
They say that the app “utilizes the familiar pocket operator workflow to sequence sound and video”.
Using the Pixel phone’s video camera as a sampling tool, and using Google’s TensorFlow machine learning to analyze and categorize the samples, you can create unique drum and sample kits using just your phone.
Play and mix live, or record step by step using your recorded video clips. Use up to 4 tracks across 16 patterns to compose full songs, including the sampled video and 16 audiovisual effects.
It’s available now for Pixel 5 and newer Pixel phones.