Pixel Heist
Built at Meta Global AI Developer Hackathon · Oct 26, 2026 · Remote

PIXEL HEIST is a browser-based puzzle game built around a simple question: What if objects from your own photos could become playable objects in a video game? Players steal objects from real-world images using Meta SAM 3.1 and bring them into a hand-drawn museum. Unlike traditional games that use predefined assets, PIXEL HEIST uses each object's actual segmentation mask as its collision geometry. A ruler can bridge a gap, a mug can block security cameras, and the hole in a handle can interact with a hook. Shape—not object identity—determines what works. The game features 10 handcrafted stages, multiple solutions to puzzles, and a Muse-powered AI Game Director called the Curator, which creates personalized challenges based on the objects players bring. PIXEL HEIST explores a new kind of AI-native gameplay: turning everyday images into interactive game content rather than simply generating images or text.