Skip to Main Content

● Cinemind is a tool YouTubers drop into their live streams as an OBS Browser Source: their viewers type choices in chat, Gemini 3.5 Flash reads thousands of natural-language messages every ~15 seconds — handling synonyms, negations, and trolls — and decides which pre-rendered scene plays next from a Google Cloud Storage vault, with three coordinated sub-agents making it work (a Director that picks the next clip with story-aware reasoning, a Live Tally classifier that updates vote bars every 3 seconds, and a Narrative Summarizer that maintains continuity across a branching DAG with reconvergence). FFmpeg seamlessly concatenates the chosen clips and pushes a continuous 1080p stream to YouTube Live's RTMP ingest; a Next.js dashboard renders the live tally, branch map, and Director's reasoning panel so the audience watches the AI direct in real time. Gemini also intelligently matches image fragments to comments — the predicted-pane composite layers a different per-story-node reaction overlay (cartoon meme generated by Higgsfield Kling 3.0, AI-cinematic b-roll generated by Seedance 2.0, or stock footage) that maps chat energy to animation, so "LETS GO" gets a triumphant cartoon, "💀" gets a Home-Alone-style scared meme, and "WAIT WHAT" gets shocked wide-eyes. Built on Gemini 3.5 Flash + Google Cloud Storage + YouTube Data API + Veo 3 + Higgsfield + FFmpeg, with three deploy modes (own broadcast, local HLS demo, embedded as a guest in another creator's stream via scripts/guest_mode.py), the system turns thousands of strangers into a single collective director — a broadcast-quality experience whose narrative bends to whoever's watching, achievable for the first time because Flash can classify ~5,000 messages and decide in under 2 seconds at fractions of a cent per call (~$0.06 per 10-minute segment), and shippable as a creator integration because the entire chat-read-and-decide pipeline runs on free-tier YouTube APIs against any public live broadcast without the creator installing anything.

Team

KUSH2704ayushojha

Placement

Participant

More from Google I/O Hackathon

Billie Gene is a rapid vaccine-design research acceleration platform built to reduce the early bottleneck in responding to emerging viral outbreaks such as…

Billie Gene project preview

Our technology has reached the point where society needs to stop putting human lives at risk and start leveraging the tools around us. Picture this: a…

Sky Guardian project preview

An RL environment to help train your managed agents in your voice.

us06web.zoom.us/…

1 in 4 Americans lives with a disability, yet most cities have no systematic way to audit pedestrian infrastructure for ADA compliance at scale. Manual…

Autonomous Infrastructure Auditor project preview

Gemini Lifeguard Rescue is an AI-powered water safety system that helps lifeguards detect and respond to emergencies faster. The demo focuses on beach rescue…

Gemini Lifeguard Rescue project preview

Autonomous Android Simulator Player Fleet & Telemetry Ingest It is a premium, real-time platform designed to run autonomous gameplay testing agents on a…

Autonomous Player Fleet project preview