# ControlAnything

- **Event:** [Meta Global AI Developer Hackathon](https://cerebralvalley.ai/e/meta-ai-developer-hackathon)
- **When:** Oct 26, 12:00 PM – Nov 4, 9:00 PM (EST)
- **Where:** Online
- **Team:** [Bektour](https://cerebralvalley.ai/u/bektour)
- **GitHub:** https://github.com/Apolotary/controlanything
- **Demo video:** https://www.youtube.com/watch?v=hIwSHZT-eoQ
- **Gallery:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3441

ControlAnything is a Meta Quest 3 passthrough app plus a server on your laptop. Meta's SAM 3.1 outlines real objects. You pinch one and ask what your hands should do. A Muse agent on the laptop (Muse Spark with terminal, file, deploy and test tools) writes a connector, runs it, tests it on the device, fixes failures, and returns AR controls or a hand program. Nothing is pre-wired. It works with any device the laptop can reach: USB, MIDI, serial, Bluetooth or network. Demonstrated: a visual synth you touch like water, Instagram Reels scrolled by hand swipes, an OP-1 Field over USB-MIDI, a DJI gimbal over Bluetooth, and a virtual pet. Every demo can also record head and hand poses for physical-AI datasets. A phone or webcam version needs no headset.

## More from Meta Global AI Developer Hackathon

- [Praesidia.AI](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3438)
- [Rangga Kori Lesmana](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3439)
- [Mumbai Coder](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3440)
- [Knovine](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3442)
- [lu](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3443)
- [Olasile Abolade](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3444)

---

Markdown version of https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3441. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt