Mystery Pigeon
Built at Zero to Agent: Vercel x Deepmind Hackathon NYC · Mar 21, 2026 · New York, NY

Mystery Pigeon is an interactive, kid-friendly web application that combines free-form drawing with AI-powered voice interaction and educational mini-games. How it works: Draw — Kids draw anything on a sketchbook-style canvas (a house, a rocket, an animal, etc.) AI Recognition — Gemini multimodal AI analyzes the canvas every few seconds and describes what it sees Voice Agent — An ElevenLabs conversational voice agent reacts to the drawing in real time, talking to the kid about what they drew — excited, encouraging, and specific Character Creation — When ready, the kid taps "Let's Play!" and the AI turns their drawing into a named character (e.g. "Zoomy the Rocket") with a description and optional "Magic Upgrade" Mini-Games — The kid picks from three educational games starring their character: Sort & Stack — Drag colored blocks to matching zones (color recognition, motor skills) Math Runner — Solve addition and subtraction problems (arithmetic) Quiz Quest — Answer AI-generated questions about their drawing (comprehension, creativity) Voice Guidance Throughout — The voice agent helps at every step: narrating the drawing, guiding game selection, cheering correct answers, and coaching through mistakes Tech stack: Next.js (App Router), HTML5 Canvas, Google Gemini (multimodal image analysis + content generation), ElevenLabs Conversational AI (real-time voice), Tailwind CSS, TypeScript.