# Cinemind

- **Event:** [Google I/O Hackathon](https://cerebralvalley.ai/e/google-io-hackathon)
- **When:** Sat, May 23 at 9:00 AM – 10:00 PM (PDT)
- **Where:** Shack15, San Francisco, CA
- **Team:** [Kush Ise](https://cerebralvalley.ai/u/KUSH2704), [Ayush Ojha](https://cerebralvalley.ai/u/ayushojha)
- **GitHub:** https://github.com/Kush614/cinemind
- **Demo video:** https://www.loom.com/share/a1c19a3cdd2e435fabc0d626a039b09a
- **Gallery:** https://cerebralvalley.ai/e/google-io-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/google-io-hackathon/hackathon/gallery/143

● Cinemind is a tool YouTubers drop into their live streams as an OBS Browser Source: their viewers type choices in
  chat, Gemini 3.5 Flash reads thousands of natural-language messages every ~15 seconds — handling synonyms, negations,
  and trolls — and decides which pre-rendered scene plays next from a Google Cloud Storage vault, with three coordinated
   sub-agents making it work (a Director that picks the next clip with story-aware reasoning, a Live Tally classifier
  that updates vote bars every 3 seconds, and a Narrative Summarizer that maintains continuity across a branching DAG
  with reconvergence). FFmpeg seamlessly concatenates the chosen clips and pushes a continuous 1080p stream to YouTube
  Live's RTMP ingest; a Next.js dashboard renders the live tally, branch map, and Director's reasoning panel so the
  audience watches the AI direct in real time. Gemini also intelligently matches image fragments to comments — the
  predicted-pane composite layers a different per-story-node reaction overlay (cartoon meme generated by Higgsfield
  Kling 3.0, AI-cinematic b-roll generated by Seedance 2.0, or stock footage) that maps chat energy to animation, so
  "LETS GO" gets a triumphant cartoon, "💀" gets a Home-Alone-style scared meme, and "WAIT WHAT" gets shocked wide-eyes.
   Built on Gemini 3.5 Flash + Google Cloud Storage + YouTube Data API + Veo 3 + Higgsfield + FFmpeg, with three deploy
  modes (own broadcast, local HLS demo, embedded as a guest in another creator's stream via scripts/guest_mode.py), the
  system turns thousands of strangers into a single collective director — a broadcast-quality experience whose narrative
   bends to whoever's watching, achievable for the first time because Flash can classify ~5,000 messages and decide in
  under 2 seconds at fractions of a cent per call (~$0.06 per 10-minute segment), and shippable as a creator integration
   because the entire chat-read-and-decide pipeline runs on free-tier YouTube APIs against any public live broadcast
  without the creator installing anything.

---

Markdown version of https://cerebralvalley.ai/e/google-io-hackathon/hackathon/gallery/143. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt