# Robo world

- **Event:** [GPT-6 Astra Hackathon SF](https://cerebralvalley.ai/e/openai-gpt-6-astra-sf)
- **When:** Tue, Sep 8 at 9:00 AM – 10:00 PM (PDT)
- **Where:** San Francisco, CA
- **Team:** [Martin W](https://cerebralvalley.ai/u/robotmartin), [Anto Patrex](https://cerebralvalley.ai/u/apbio)
- **GitHub:** https://github.com/antopatrex1/robotworld.git
- **Demo video:** https://drive.google.com/file/d/1LxCe1Cm3yIdv0eZNq72utn3j5ukj7cZV/view?usp=sharing
- **Gallery:** https://cerebralvalley.ai/e/openai-gpt-6-astra-sf/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/openai-gpt-6-astra-sf/hackathon/gallery/1

Robot World connects real-world observation with an interactive robotics simulation. It combines a live Intel RealSense D435 color-and-depth feed, a World Labs virtual environment, and a simulated Unitree G1 humanoid with five-finger Shadow hands.

Our latest milestone brings an observed physical tabletop into the virtual world. Using a known-size paper reference, we map objects from a camera capture into simulation, where users can ask the robot to approach and pick up the observed black mug. The interface also supports commands for walking, reaching, and grasping, with MuJoCo simulating object physics and hand contacts.

The project explores a practical foundation for bringing real environments into robot development and testing. Live camera viewing and snapshot-based scene mapping work today; continuous reconstruction and object tracking are the next steps.

---

Markdown version of https://cerebralvalley.ai/e/openai-gpt-6-astra-sf/hackathon/gallery/1. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt