Skip to Main Content

A voice-controlled 3D interior design studio where you shop the look as you talk. You stand in a live three.js room and speak casually ("paint that wall sage", "put a lamp on the desk", "swap it for the second one"). Gemini turns each utterance into precise scene edits: wall and floor materials, furniture placement with exact spatial reasoning (on, under, above, beside, in the corner), lighting, and wall art. Every piece of furniture is a real, buyable product from a 682-item shop catalog with a 3D model, so the room you design is a cart you can check out. Problem it solves: buying furniture online means guessing how things fit and look together. Here you design by talking, see real products in your room at true scale, compare same-kind alternatives, and buy them. How it works: live speech-to-text streams the user's words; an orchestrator model emits function calls that are sanitized into scene ops; background workers generate wall images and, when a product has no merchant 3D model, a Managed Agent writes three.js geometry from the product photo in a sandbox, raced against a direct model call. A "Shop the look" panel shows each placed item with price, vendor and alternatives, and a checkout page collects the cart. Stack: Vite + React + three.js front end, Hono server on Node, deployed on a Cloudflare Worker with the API in a Cloudflare Container (hackathon.sparkyidea.com).

Team

jingerpierohan_gore

More from Gemini 4 NYC Hackathon

We design an agentic system to automatically create + manage intelligent AI opponents/NPCs in video games. The suite of agents analyzes user gameplay…

Adaptive NPCs project preview

Manually routing PCBs is time-consuming and cost-inefficient. Current best algorithms (freerouting, PCBRouter) score very low on PCBWorld's hardest PCB…

routr project preview

Heliocam is a camera app where Gemini controls the camera. It watches what you're pointing at, sets the ISO, shutter, focus, white balance and zoom for you…

heliocam project preview

Repairs and assembly fail because manuals are lost, vague, missing, or nonexistent, so people break things or throw them out. KLIK turns a photo of any object…

Klik project preview

Iron Pulse turns your laptop into a 3D boxing ring. Fight an adaptive AI rival in real time using just your webcam. Throw real punches and lean to dodge…

Iron Pulse Arena project preview

Text your raw footage to an iMessage number and get a finished, trend-informed Reel back in the same thread.

Sticky project preview