Skip to Main Content

The Dark Knight

Google I/O Hackathon

▎ Sketch2App turns hand-drawn UI sketches into working web apps via a multi-step Gemini agent. ▎ ▎ The problem: the fastest path from "idea in your head" to "working product on screen" today is typing a 200-word prompt. That's a writing skill, not a design skill. ▎ Sketching is universal — PMs, designers, founders, and kids all sketch. We make the sketch the prompt. ▎ ▎ A user draws a wireframe on a canvas. A Gemini-powered agent then runs three phases: ① Analyze the sketch using vision + structured JSON output (responseSchema) to ▎ produce a typed Plan — title, components, theme, interactions. ② Build a complete self-contained HTML/CSS/JS page from the plan + sketch. ③ Refine in a chat loop — the ▎ user types "make it dark mode" or "add a Google sign-in" and the agent patches the live app in place. ▎ ▎ The whole thing is one HTML file. No backend, no build step, no install. The API key stays in the browser; the generated app runs in a sandboxed iframe. Multimodal ▎ reasoning is the creative tool — vision in, working code out, no intermediate text representation the user has to author. --- Public GitHub Repository *

Team

gangsd007

Placement

Participant

More from Google I/O Hackathon

Billie Gene is a rapid vaccine-design research acceleration platform built to reduce the early bottleneck in responding to emerging viral outbreaks such as…

Billie Gene project preview

Our technology has reached the point where society needs to stop putting human lives at risk and start leveraging the tools around us. Picture this: a…

Sky Guardian project preview

An RL environment to help train your managed agents in your voice.

us06web.zoom.us/…

1 in 4 Americans lives with a disability, yet most cities have no systematic way to audit pedestrian infrastructure for ADA compliance at scale. Manual…

Autonomous Infrastructure Auditor project preview

Gemini Lifeguard Rescue is an AI-powered water safety system that helps lifeguards detect and respond to emergencies faster. The demo focuses on beach rescue…

Gemini Lifeguard Rescue project preview

Autonomous Android Simulator Player Fleet & Telemetry Ingest It is a premium, real-time platform designed to run autonomous gameplay testing agents on a…

Autonomous Player Fleet project preview