# MuseBody

- **Event:** [Meta Global AI Developer Hackathon](https://cerebralvalley.ai/e/meta-ai-developer-hackathon)
- **When:** Oct 26, 12:00 PM – Nov 4, 9:00 PM (EST)
- **Where:** Online
- **Team:** [Markus Kamsties](https://cerebralvalley.ai/u/Bobbob)
- **GitHub:** https://github.com/Kasties/muse-body
- **Demo video:** https://youtu.be/Kyt9WK8w_m0
- **Gallery:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2650

A helper you can just ask for things, like a home robot, needs eyes, ears, a body, and a model that turns “could you bring me that” into an action among real people. Testing that with real hardware is slow and expensive. muse-body tests it in VRChat for free: an avatar that only sees the pixels on screen, hears the audio, and moves with a virtual Xbox gamepad like a player. Muse Voice Transcribe writes down what people say, Muse Spark 1.3 decides what to do from each frame, and SAM 3.1 finds the target again in every frame so a small controller can steer to it. When SAM also matches look-alikes, like menu boards on a wall, Muse Spark picks the real object among numbered boxes. Live, a player asked it out loud for the café menu: it answered, found the menu, grabbed it, handed it over, and told a joke when asked. Every run logs its frames and Meta API calls, published in the repo. Everything was built during the hackathon, including the 3D model of its avatar; the commit history starts Oct 28

## More from Meta Global AI Developer Hackathon

- [Team Harsh](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2647)
- [Tandem](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2648)
- [EchoFrame](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2649)
- [NovaCore](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2651)
- [SameRoom](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2652)
- [Bijay Yerra](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2653)

---

Markdown version of https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2650. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt