# Carpathron

- **Event:** [Meta Global AI Developer Hackathon](https://cerebralvalley.ai/e/meta-ai-developer-hackathon)
- **When:** Oct 26, 12:00 PM – Nov 4, 9:00 PM (EST)
- **Where:** Online
- **Team:** [Mircea Rusu](https://cerebralvalley.ai/u/Carpathron)
- **GitHub:** https://github.com/qubitpage/carpathron-muse
- **Demo video:** https://youtu.be/E-0B57rt1jE?si=MRIzH2AhIR2k3bfV
- **Gallery:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3574

Carpathron: robots you can talk to, drive and become.

Carpathron connects a real robot to Meta's AI and to Meta Quest, so anyone can talk to a robot, see through its eyes and give it tasks. It has three parts that work together:

1) Muse Carpathron (Windows): an open-source AI agent and robot control center powered by Meta Muse (Muse Spark via the Meta Model API, or your Meta account). It chats, runs multi-step tasks with full PC access, writes and uploads robot firmware (Arduino/ESP32 studio), manages SSH servers, scans them for security problems (Carpathron Shield), offers remote desktop, research, documents, MCP, memory and WhatsApp control (text and voice). For the robot it streams live video, drives the car, builds a room map, explores, scans with photos and finds objects, using Muse vision and SAM 3.1 for exact object outlines.

2) Carpathron Avatar (Meta Quest 3/3S, Godot + OpenXR): a mixed reality companion. In passthrough, Carpathron stands on your real floor, sees your room through the headset camera, names and outlines what is in it, answers with a natural voice and does what you ask: come here, follow me, go to the chair, dance, scan the room, find the dog. Short commands react instantly; everything else is answered by Muse Spark. Connect the real robot and the same conversation drives it: his camera window follows your head and shows what he recognises, the headset guides the car to objects, and one button switches to full VR through the robot's camera, for example to drive it outside. With a Meta API key the headset also works standalone, without the PC.

3) Baby Carpathron: our robot, a 4WD ESP32-CAM car with a 3D-printed head, an Arduino Mega sensor hub (ultrasonic eyes, MPU-6050 gyro, temperature), our own open firmware and an open HTTP robot protocol that any robot can speak.

Meta technology used: Muse Spark (chat, agent, vision), Muse Voice Transcribe (speech to text), Muse Image, SAM 3.1 (segmentation masks decoded into object contours), Meta Quest passthrough and the headset camera through the OpenXR vendor extensions.

What we learned building it: speed matters more than anything in a conversation. We stream the answer so the first sentence is spoken while the rest is still being written, resend a request when the model is slow, answer simple commands locally, and let the robot search by turning, stopping and looking instead of spinning blindly. Muse can also show and record exactly what the headset user sees, over Wi-Fi, for demos.

Vision: Carpathron is the start of a startup building modular utility robots for agriculture, security, warehouses and care. Robots carry a small computer for instant safety reactions, your PC is the local brain, and the cloud (Meta Muse) handles the hard tasks. Through Carpathron Avatar a person can step into any robot remotely when it needs help.

Everythin

## More from Meta Global AI Developer Hackathon

- [Keeper](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3571)
- [Echo_1](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3572)
- [Daniel Wagner](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3573)
- [Dinevia](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3575)
- [X-Link](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3576)
- [Motion Transfer](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3577)

---

Markdown version of https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3574. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt