# Team Synthexis

- **Event:** [Meta Global AI Developer Hackathon](https://cerebralvalley.ai/e/meta-ai-developer-hackathon)
- **When:** Oct 26, 12:00 PM – Nov 4, 9:00 PM (EST)
- **Where:** Online
- **Placement:** Best Creative Build
- **Team:** [Noa Katana](https://cerebralvalley.ai/u/Katana)
- **GitHub:** https://github.com/smashburger-dev/synthexis
- **Demo video:** https://youtu.be/EbNaVOHnnvo
- **Gallery:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/5090

synthexis turns the webcam you already own into an instrument for the plugins you already love.

Every producer has the same problem. A synth like Serum 2 has more than 500 parameters, and you reach them one at a time with a mouse. Hardware controllers help, but they cost money, take up desk space, and all they add is more knobs. The most expressive thing in the studio is your own body, and today it does nothing.

synthexis is a plugin for FL Studio. 

Load it, look into your camera, and type what you want in plain English or German: "when I open my left hand, open the filter", "pinch my fingers to lower the reverb", "when I open my mouth, push the distortion". It understands the sentence, finds the right parameter in whatever plugin you picked, and from then on your hand, your fingers, your mouth, your eyes or the turn of your head play that parameter live. FL records it as automation, so a performance becomes part of the track.

It goes beyond a couple knobs:

Hands: each finger can trigger its own MIDI part, a hi-hat pattern on the index, chords on the ring finger, all in the key of the song.
Head: turn, nod and tilt, mouth and each eye become controllers, shown as a live drawing of your face.
Pong: point your finger and shoot a ball across the camera picture. Each of the four walls plays a note, a chord or moves a parameter when the ball hits it. Music as a game.
Profiles and presets: switch between whole setups with one click on 1, 2 or 3.
Every plugin works. synthexis ships with readable parameter names for 887 plugins (107,350 labelled parameters), and for any plugin it has never seen, a small model running inside the plugin works out what each parameter does from its name.

Everything runs on your Mac, in real time, with no cloud and no extra hardware. The camera picture never leaves the machine. From your movement to the parameter in FL takes about a tenth of a second.

The result: plugins you have used for years feel new again, you can perform them wherever you are with a laptop, and your expression is no longer limited to what fits under a mouse pointer.

## More from Meta Global AI Developer Hackathon

- [BenBen](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/5087)
- [N.E.G.U](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/5088)
- [Banger AI](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/5089)
- [mileto](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/5091)
- [MemriPal](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/5092)
- [Apprentice AI](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/5093)

---

Markdown version of https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/5090. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt