Skip to Main Content

Voice Bridge is a real-time, multimodal lip-reading assistive-communication tool for people with ALS. As ALS progressively destroys speech (80–85% of patients lose ▎ intelligible speech) while leaving the mind fully intact, urgent needs — "water," "raise the bed," "I'm choking" — can take minutes to communicate. Today's ▎ alternative, a $15–20k eye-tracker, is fragile to lighting and head angle and is abandoned by 30–50% of users. ▎ ▎ Voice Bridge reads the mouth instead of the gaze — the signal a patient can still produce — and fuses lip movement with blinks and small gestures to recover intent ▎ even when audio fails. Recovered intent is spoken aloud and routed as severity-graded, role-aware alerts (comfort → caregiver, clinical → nurse, emergency → entire ▎ circle of care), and the patient-specific understanding persists across staff turnover so a new nurse inherits what the system already knows. ▎ ▎ It runs on an ordinary camera and laptop via a capture → VSR → TTS adapter pipeline: a zero-dependency offline default that works today, with hosted lip-reading ▎ (Claude vision) and expressive voice (MiniMax) that activate when keys are provided. ▎ ▎ Honest caveat: this is an early assistive-research prototype, not a clinically validated medical device.

Team

sachin-crispai

Placement

Participant

More from AI Engineer World's Fair Hackathon 2026

SplatForge is a robot manipulation agent that trains itself inside the worlds it reconstructs. Point a phone at a tabletop and it turns the scene into a…

SplatForge project preview

https://www.podman.live/ PodMan is the pair programmer for your AI-native dev. team. Writing code got cheap; knowing who's writing what didn't. With…

PodMan: Pair Programmer ❤️ project preview

Rote is a self-improving computer-use agent for real desktop work. When a task is new, Gemini Computer Use drives the browser or Mac app live; Rote records…

rote project preview

Electrical design engineers often have to place and route boards by hand — agonizing over where the buck switching node goes, how far the crystal sits from…

field-ratchet: a recursively self-improving AI for PCB design. project preview

EvoLoRA is an auditable, bounded self-improvement loop for LoRA fine-tuning. You provide a plain-English goal; a MiniMax agent plans the evaluation set, the…

EvoLoRA project preview

FocalPoint is a chat interface that watches how you read and adapts in real time — no feedback buttons, no ratings, no extra effort from the user. Using your…

Focal point project preview