Skip to Main Content

Capture Studio turns a phone video of a factory into manufacturing-grade AI analysis and process engineering. It uses LingBot to generate a point cloud from the video and then our agent semantically and spatially segments the points into objects for a process. The segmented objects are an editable BIM model that an AI agent can redesign or replicate through an MCP. Every design edit is checked against a building-code profile, site-safety rules and a MuJoCo rigid-body stability test; decisions that need a human are put to the user in a minimal three.js viewer, and the result is exported as IFC4 + GLB + MJCF. The semantic segmentation of the point cloud, 3d reconstruction, BIM editing and CAD are all powered by Gemini 4.

Team

de_an_huCobe

More from Gemini 4 NYC Hackathon

We design an agentic system to automatically create + manage intelligent AI opponents/NPCs in video games. The suite of agents analyzes user gameplay…

Adaptive NPCs project preview

Manually routing PCBs is time-consuming and cost-inefficient. Current best algorithms (freerouting, PCBRouter) score very low on PCBWorld's hardest PCB…

routr project preview

Heliocam is a camera app where Gemini controls the camera. It watches what you're pointing at, sets the ISO, shutter, focus, white balance and zoom for you…

heliocam project preview

Repairs and assembly fail because manuals are lost, vague, missing, or nonexistent, so people break things or throw them out. KLIK turns a photo of any object…

Klik project preview

Iron Pulse turns your laptop into a 3D boxing ring. Fight an adaptive AI rival in real time using just your webcam. Throw real punches and lean to dodge…

Iron Pulse Arena project preview

Text your raw footage to an iMessage number and get a finished, trend-informed Reel back in the same thread.

Sticky project preview