Skip to Main Content

Interaction Twin

Built at Meta Global AI Developer Hackathon · Oct 26, 2026 · Remote

Interaction Twin — Demo video

Interaction Twin turns everyday demonstrations into reusable, source-linked object programs for robotics developers and AI agents. It combines 3D parts with estimated connections, demonstrated actions, and timestamped video evidence. Users can compare video with an interactive scene, inspect parts, and export assets. Local MCP tools let agents discover and reuse the same curated descriptions across recordings for example, drafting a task using a phone and charger. The public demo contains five recorded example families. Robot sequences illustrate authored kinematic rehearsals. Explore the interactive demo: https://nigelhartman.github.io/interaction_twin/

Team