# Mystery Pigeon

- **Event:** [Zero to Agent: Vercel x Deepmind Hackathon NYC](https://cerebralvalley.ai/e/zero-to-agent-nyc)
- **When:** Sat, Mar 21 at 9:00 AM – 10:00 PM (EDT)
- **Where:** 220 W 26th St, New York, NY
- **Team:** [Baladhurgesh Balagurusamy Paramasivan](https://cerebralvalley.ai/u/baladhurgesh)
- **GitHub:** https://github.com/Baladhurgesh/mystery-pigeon
- **Demo video:** https://youtu.be/LCFdIgEo7pM
- **Gallery:** https://cerebralvalley.ai/e/zero-to-agent-nyc/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/zero-to-agent-nyc/hackathon/gallery/33

Mystery Pigeon is an interactive, kid-friendly web application that combines free-form drawing with AI-powered voice interaction and educational mini-games.
How it works:
Draw — Kids draw anything on a sketchbook-style canvas (a house, a rocket, an animal, etc.)
AI Recognition — Gemini multimodal AI analyzes the canvas every few seconds and describes what it sees
Voice Agent — An ElevenLabs conversational voice agent reacts to the drawing in real time, talking to the kid about what they drew — excited, encouraging, and specific
Character Creation — When ready, the kid taps "Let's Play!" and the AI turns their drawing into a named character (e.g. "Zoomy the Rocket") with a description and optional "Magic Upgrade"
Mini-Games — The kid picks from three educational games starring their character:
Sort & Stack — Drag colored blocks to matching zones (color recognition, motor skills)
Math Runner — Solve addition and subtraction problems (arithmetic)
Quiz Quest — Answer AI-generated questions about their drawing (comprehension, creativity)
Voice Guidance Throughout — The voice agent helps at every step: narrating the drawing, guiding game selection, cheering correct answers, and coaching through mistakes
Tech stack: Next.js (App Router), HTML5 Canvas, Google Gemini (multimodal image analysis + content generation), ElevenLabs Conversational AI (real-time voice), Tailwind CSS, TypeScript.

---

Markdown version of https://cerebralvalley.ai/e/zero-to-agent-nyc/hackathon/gallery/33. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt