Skip to Main Content

Mystery Pigeon is an interactive, kid-friendly web application that combines free-form drawing with AI-powered voice interaction and educational mini-games. How it works: Draw — Kids draw anything on a sketchbook-style canvas (a house, a rocket, an animal, etc.) AI Recognition — Gemini multimodal AI analyzes the canvas every few seconds and describes what it sees Voice Agent — An ElevenLabs conversational voice agent reacts to the drawing in real time, talking to the kid about what they drew — excited, encouraging, and specific Character Creation — When ready, the kid taps "Let's Play!" and the AI turns their drawing into a named character (e.g. "Zoomy the Rocket") with a description and optional "Magic Upgrade" Mini-Games — The kid picks from three educational games starring their character: Sort & Stack — Drag colored blocks to matching zones (color recognition, motor skills) Math Runner — Solve addition and subtraction problems (arithmetic) Quiz Quest — Answer AI-generated questions about their drawing (comprehension, creativity) Voice Guidance Throughout — The voice agent helps at every step: narrating the drawing, guiding game selection, cheering correct answers, and coaching through mistakes Tech stack: Next.js (App Router), HTML5 Canvas, Google Gemini (multimodal image analysis + content generation), ElevenLabs Conversational AI (real-time voice), Tailwind CSS, TypeScript.

Team

baladhurgesh

Placement

Participant

More from Zero to Agent: Vercel x Deepmind Hackathon NYC

Evaluating NYC development sites requires assembling data from 10+ disconnected sources, creating costly bottlenecks for acquisitions teams screening dozens…

Ashkan + U Jin project preview

Everyone has an accent. Chattermint lets you control yours. 750 million people want to change how they sound in English, from actors learning dialects to…

Chattermint project preview

Ansr is an AI voice host for restaurants that answers every phone call (especially during peak hours), taking orders, making reservations, and answering…

Ansr project preview

PreLife is an AI-powered life decision game where players explore "what-if" scenarios by walking through a pixel-art city and making binary choices that…

Pre-Life project preview

Grimoire clones any writing voice. Paste text, get a statistical fingerprint (9 metrics: syllable density, sentence rhythm, punctuation cadence, lexical…

Grimoire project preview

GenUI Test Harness AI-generated UIs look great in screenshots. But do they actually work? GenUI Test Harness is an autonomous QA agent that crawls any…

www.loom.com/…