Rohan Alexander
Gemini 4 NYC HackathonAnd Then turns a child's real paper drawing and spoken voice into a playable storybook on screen. A child holds their drawing up to the camera and speaks a twist aloud, something like "And then the bridge broke"—and our solver proves the story is stuck, tests Gemini's ideas for fixing it live on the page, and crosses out the ones that don't actually work before asking the child to draw the winning fix (like a boat) on a scrap of paper. On /proof, we test the whole pipeline on real photographs of children's drawings, compare against a model-only baseline (catching the 57% of first repair ideas where the model is wrong), and push degraded photos and noisy audio until they break. You can play it here: https://and-then-93760759615.us-east4.run.app With password: hackathon





