Skip to Main Content

Wordless is a one-shot procedure learner and real-time verifier. From one unlabelled demonstration video, Gemini 4 Carbon induces the steps and a forced-alignment pass over per-frame Decisions API posteriors localizes each one; an image model renders them as a wordless picture card. The card then runs as an 8 Hz streaming classifier on the next person: posteriors are Viterbi-decoded, aligned to the card by edit distance, and a missed step is flagged mid-task. On 16 public recordings of other people, 97% of performed steps were never falsely flagged, compared with 91% for a single model call.

Team

Tensumarvst__

More from Gemini 4 NYC Hackathon

We design an agentic system to automatically create + manage intelligent AI opponents/NPCs in video games. The suite of agents analyzes user gameplay…

Adaptive NPCs project preview

Manually routing PCBs is time-consuming and cost-inefficient. Current best algorithms (freerouting, PCBRouter) score very low on PCBWorld's hardest PCB…

routr project preview

Heliocam is a camera app where Gemini controls the camera. It watches what you're pointing at, sets the ISO, shutter, focus, white balance and zoom for you…

heliocam project preview

Repairs and assembly fail because manuals are lost, vague, missing, or nonexistent, so people break things or throw them out. KLIK turns a photo of any object…

Klik project preview

Iron Pulse turns your laptop into a 3D boxing ring. Fight an adaptive AI rival in real time using just your webcam. Throw real punches and lean to dodge…

Iron Pulse Arena project preview

Text your raw footage to an iMessage number and get a finished, trend-informed Reel back in the same thread.

Sticky project preview