# Refractored-vision

- **Event:** [Meta Global AI Developer Hackathon](https://cerebralvalley.ai/e/meta-ai-developer-hackathon)
- **When:** Oct 26, 12:00 PM – Nov 4, 9:00 PM (EST)
- **Where:** Online
- **Team:** [Syed Kazmi](https://cerebralvalley.ai/u/syedf1), [Moosa Ahmed](https://cerebralvalley.ai/u/Moosa1Ahmed), [Dawood Ahmed](https://cerebralvalley.ai/u/Dawood_Ahmed)
- **GitHub:** https://github.com/AiWithAmman/refactored-vision
- **Demo video:** https://youtu.be/0p-iUJtTdDw
- **Gallery:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3873

Lumen helps blind and low-vision people find the things they put down. Knowing your keys are on top of the fridge doesn't help if you can't reach them without sight, so Lumen covers the full loop: remember, recall, guide, watch.

Remember: the user says "remember my keys" while showing the object to the camera. Lumen locates it, describes the spot in plain language ("on top of the fridge in the kitchen"), and stores it with a timestamp.

Recall: "Where are my keys?" gets a one-sentence spoken answer drawn from stored memory.

Guide: Lumen takes a loop of camera frames, locates the target in each one, and speaks short cues like "turn a little left", "keep going", "reach straight out" for the last ten feet.

Watch: Lumen warns "bicycle approaching from your left" when a tracked object's box grows quickly between frames.

Read text: "Read this" reads labels, signs and mail aloud.

A router agent decides which tool a spoken request needs. The app is a FastAPI backend with a browser front end that uses the browser's speech recognition and text-to-speech, and SQLite for memory. Everything is voice-first.

Lumen is an experimental assistive aid, not a mobility aid. It does not measure distance, detect hazards, or recognize faces, and the README says so explicitly.

## More from Meta Global AI Developer Hackathon

- [Shree](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3870)
- [Kovarnis / SurMap](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3871)
- [Juan Pablo Ghelfi](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3872)
- [Truss](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3874)
- [muvilion](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3875)
- [Further](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3876)

---

Markdown version of https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3873. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt