# Amelia for the Deaf

- **Event:** [The Persistent Context Sprint Hackathon | Live at MongoDB .Local Build Fest](https://cerebralvalley.ai/e/persistent-context-sprint-hackathon)
- **When:** Thu, Aug 13 at 12:30 – 8:00 PM (PDT)
- **Where:** Pier 48, San Francisco, CA
- **Placement:** 1st Place
- **Team:** [Jerry Yan](https://cerebralvalley.ai/u/Imhaohao), [Boris N](https://cerebralvalley.ai/u/borisn), [David Wu](https://cerebralvalley.ai/u/davidwu6), [Brendan G](https://cerebralvalley.ai/u/brendang)
- **GitHub:** https://github.com/borisnezlobin/mongo-hacks
- **Demo video:** https://youtu.be/ORtimmhfjlk
- **Gallery:** https://cerebralvalley.ai/e/persistent-context-sprint-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/persistent-context-sprint-hackathon/hackathon/gallery/73

Amelia
The problem. Live captions get the words right, but words are the easy part. In a group conversation, deaf and hard-of-hearing people lose everything around them — who's speaking, which voice just changed their mind, what someone promised to do. Captions scroll away, and asking people to repeat themselves has a social cost hearing people never pay.
What it does. Amelia listens from your phone and turns the conversation into something you can ask questions of, instead of a wall of text you have to keep up with.
    •    Every line is tied to a real person, recognized by their voice.
    •    She remembers each person, and tracks when things about them change.
    •    She tracks promises in both directions — what you owe and what you're owed.
    •    Say her name and she recognizes you by voice, answers from memory, and can speak the answer aloud to the room for you.
Sponsor technologies. MongoDB Atlas stores everything and powers the search, using Atlas Vector Search for both voice recognition and memory. Anthropic Claude does the reasoning, Fireworks AI handles memory extraction, OpenAI transcribes and separates speakers, SpeechBrain makes the voiceprints, ElevenLabs is her voice, Resend drafts emails, and Mentra adds smart glasses. Built on Bun, Hono, and Expo.

---

Markdown version of https://cerebralvalley.ai/e/persistent-context-sprint-hackathon/hackathon/gallery/73. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt