Skip to Main Content

Discovery Clock

Gemini 4 NYC Hackathon

Film a checklist job, type the steps, and Discovery Clock says which steps happened, when each started, and which were skipped, with a probability for each. The problem: a seller films every order being packed, or a technician films a lockout procedure. When someone later asks whether a step was skipped, nobody has time to watch the footage. A single Gemini call can list the steps it saw, but it cannot say how sure it is. How it works: four witnesses watch the same video. The Gemini Decisions API answers about 70 to 100 yes or no questions in one call ("had this step started by now?"), which gives a curve per step and a first read within a few seconds. Three Gemini 4 calls (Hydrogen twice, Neon once) write their own timelines. Bayes' rule combines them, weighting each witness by a reliability measured on held-out clips. A Gemini Managed Agent then audits start and end frames in a sandbox and marks each step confirm, dispute or cannot tell. Proof: 518 held-out clips from DeepMind's Perception Test, split by a hash before any model ran, with two planted steps per clip that never happen. I shipped three versions and scored each once on clips it had never seen. Version 3, on 199 fresh clips: it catches planted steps at F1 0.87, level with one Gemini 4 Hydrogen call (0.87), the best of the fast single calls. What it adds is odds that hold up: of the steps it rated 0.8 or higher, 97 percent had happened; of those under 0.2, 11 percent had. On nine phone takes recorded at the event, 151 of 162 step verdicts were right. Where it breaks: an already-open bag reads as "unzipped"; a faked step still read as done in 2 of 14 runs (version 2: 4 of 6); counts are only checked when the list makes them matter; on an 8 minute video it missed the one skipped step, and on long video its timing is 6 to 25 seconds off. The README lists every failure and seven things that did not help. It is a review aid. A person checks every flagged step and signs. Live demo: https://strategy-harmony-film-pot.trycloudflare.com

Team

sanatgupta

More from Gemini 4 NYC Hackathon

We design an agentic system to automatically create + manage intelligent AI opponents/NPCs in video games. The suite of agents analyzes user gameplay…

Adaptive NPCs project preview

Manually routing PCBs is time-consuming and cost-inefficient. Current best algorithms (freerouting, PCBRouter) score very low on PCBWorld's hardest PCB…

routr project preview

Heliocam is a camera app where Gemini controls the camera. It watches what you're pointing at, sets the ISO, shutter, focus, white balance and zoom for you…

heliocam project preview

Repairs and assembly fail because manuals are lost, vague, missing, or nonexistent, so people break things or throw them out. KLIK turns a photo of any object…

Klik project preview

Iron Pulse turns your laptop into a 3D boxing ring. Fight an adaptive AI rival in real time using just your webcam. Throw real punches and lean to dodge…

Iron Pulse Arena project preview

Text your raw footage to an iMessage number and get a finished, trend-informed Reel back in the same thread.

Sticky project preview