HomeTwin
Built at Meta Global AI Developer Hackathon · Oct 26, 2026 · Remote
HomeTwin turns a photograph of a room into a controllable, automatable smart home. Today, running a connected home means device lists, menus, and YAML automations. HomeTwin makes the room itself the interface: Meta SAM 3.1 segments a room photo into tappable regions, each bound to a real Home Assistant entity, so tapping a lamp in the photo toggles the real lamp. Automations are authored by typing or speaking ("when the door opens after sunset, turn the string lights on") — Muse Spark turns that into structured AutomationIR, which passes a deterministic validator and compiler and only deploys after your approval. A What-If mode simulates a rule before it goes live, a Design Advisor proposes lighting settings with Muse Image previews, and time-of-day presets, scenes, a Time Machine past-view, and a tap-only guest view round out the demo. The loop closes in the real system, not in a report — the rule deploys to Home Assistant under approval and fires live. Scope, stated honestly: the demo runs the real Home Assistant engine with virtual devices, so a physical rollout swaps entity IDs while the API, compiler, and UI stay the same.