Kavach — real-time call intelligence that hears the manipulation, not just the words. India loses over ₹22,000 crore a year to scam calls that follow predictable scripts: hook → authority → isolation → urgency → extraction. Kavach listens to a live call and intervenes before the money moves. Real-time & multimodal: the phone streams live 16 kHz audio to Gemini 3.1 Flash Live, which listens continuously — reading vocal urgency, catching the caller mid-sentence, and speaking a calm counter-warning into the call the moment the script turns coercive. It isn't turn-based; the caller can interrupt it and it keeps listening. Each risk signal is a schema-validated tool call gated by a local two-hit state machine, so the model senses and reasons but never acts alone. On-device Gemma 4: when the network drops — exactly when a first-time victim is most exposed — a Gemma 4 E2B agent runs natively on the phone via LiteRT. It's a full sense → decide → act → check loop that holds state across the call, recovers from malformed model output, and defers to a human at clear boundaries. It keeps working even with no weights loaded. Beyond detection: Kavach names the manipulation tactic and explains it in one plain sentence, scores caller trust live, can flip to a honeypot persona that wastes the scammer's time, and writes a post-call forensic debrief. Every event lands in a privacy-preserving, tamper-evident local ledger — transcript hashes, never raw audio. Verified with real audio on gemini-3.1-flash-live-preview; a 16-case regression scores 1.00 precision and recall. Dual-brain: Gemini when connected, Gemma on-device when not.
More from Google DeepMind Bangalore Hackathon
Kahani is a browser-based adventure game where a player's one-line idea is expanded into a full "game bible": a mystery with 3 NPCs, 3 guarded clues, and fail…

Upload a real government construction blueprint, ask any element a question, watch it rebuild as a measurable 3D model, and run a pipeline of five AI agents…

Project Parallax is a pioneer in director-authored adaptive cinema, allowing filmmakers to deliver personalized storytelling and intelligently use ad-spots in…

True Autonomous, Offline-First Multimodal Diagnostic Agent 1. Real-Time Multimodal Interaction (Gemini Live) Most "voice assistants" are just text interfaces…
StoreUp — talk your shop onto ONDC. Millions of small shopkeepers in India want to sell online but are locked out by a language barrier, complicated forms…
When thousands of people gather for large social events like huge festivals, pilgrimages, and religious gatherings, families get separated in the chaos. Cell…