Diorama - Draw it. Walk into it.
Built at Meta Global AI Developer Hackathon · Oct 26, 2026 · Remote

Diorama turns one sentence, or a few sketches on paper, into a small playable point-and-click adventure: painted places, a hero and characters who walk and talk, things to pick up and use, sound and voices, and endings that are checked to be reachable. The problem: AI can paint a beautiful scene, but a picture is not a game. Someone still has to cut out every object, mark where the floor is, decide what stands in front of what, and test that the story can be finished. Diorama does that part. Meta's models do the creative work, and code measures and checks every result, so what comes out is playable, not only pretty. How it works: Muse Spark designs the world, story, cast, items and endings, and lays out each place as a plan sketch. Muse Image paints over the sketch, a Spark critic flags what is wrong and Muse Image repaints only those regions. SAM 3.1 cuts every object, floor, stair and patch of water out of the painting; with a depth map, those masks become the walk grid, occlusion (characters walk behind things, not through them) and the pick-ups. Characters are painted, turned into 3D models and drawn back as sprite sheets. Finally a bot plays every place and every ending, and failed places are repaired automatically. It runs locally as a CLI and as Studio, a GUI where you describe a world, watch it build place by place, play it, and fix it by clicking a thing on the stage and telling the agent what should change. Every step writes plain files, so manual fixes survive a rebuild. Try it: https://grzegorz.tanczyk.pl/diorama/ and Paper Boat Storm, a world built from three crayon-style sketches that you can play in the browser: https://grzegorz.tanczyk.pl/diorama/paper-boat-storm/ Built solo during the hackathon, starting from the kickoff on 26 October 2026.