# ActuateOS

- **Event:** [Gemini 4 NYC Hackathon](https://cerebralvalley.ai/e/gemini-4-nyc)
- **When:** Sat, Nov 21 at 9:00 AM – 10:00 PM (EST)
- **Where:** New York, NY
- **Team:** [You Song Hou](https://cerebralvalley.ai/u/ysongh), [koushik vasa](https://cerebralvalley.ai/u/koushikvasa), [Isayah C](https://cerebralvalley.ai/u/isayac), [Sahil Pardasani](https://cerebralvalley.ai/u/sahilpardasani)
- **GitHub:** https://github.com/isayahc/ActuateOS
- **Demo video:** https://youtu.be/7V21_kk5zes
- **Gallery:** https://cerebralvalley.ai/e/gemini-4-nyc/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/gemini-4-nyc/hackathon/gallery/60

ActuateOS turns a video of a person assembling something into a working 3D robotic setup and tests whether a robot can actually pull it off.

Watching a human do a task on camera is the easy part. Figuring out how a machine can repeat it safely is hard a video won't tell you if a robotic arm can reach a part, if pieces will collide, or if a step requires delicate human touch.

ActuateOS bridges that gap automatically:

It watches and learns: Using Gemini 4 Hydrogen, it breaks an assembly video down into clear steps, noting what happened and what information is still missing.

It designs the workspace: Using Gemini 4 Carbon, it lays out a 3D robotic workcell in OpenIndustries and builds a step-by-step task plan.

It puts the plan to the test: It runs the steps inside a real physics simulator (MuJoCo). Right now, our virtual robot arm handles standard pick-and-place moves and if a step is too complex (like tight screwing or snapping parts together), ActuateOS flags it honestly instead of faking success.

## More from Gemini 4 NYC Hackathon

- [Sadman Habib](https://cerebralvalley.ai/e/gemini-4-nyc/hackathon/gallery/57)
- [Amed](https://cerebralvalley.ai/e/gemini-4-nyc/hackathon/gallery/58)
- [Pack It Up](https://cerebralvalley.ai/e/gemini-4-nyc/hackathon/gallery/59)
- [Lane](https://cerebralvalley.ai/e/gemini-4-nyc/hackathon/gallery/61)
- [RealityCart](https://cerebralvalley.ai/e/gemini-4-nyc/hackathon/gallery/62)
- [Iron Pulse Arena](https://cerebralvalley.ai/e/gemini-4-nyc/hackathon/gallery/63)

---

Markdown version of https://cerebralvalley.ai/e/gemini-4-nyc/hackathon/gallery/60. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt
