# Talking Tactile

- **Event:** [Meta Global AI Developer Hackathon](https://cerebralvalley.ai/e/meta-ai-developer-hackathon)
- **When:** Oct 26, 12:00 PM – Nov 4, 9:00 PM (EST)
- **Where:** Online
- **Team:** [Deepak Kumaran T S](https://cerebralvalley.ai/u/deepakkts)
- **GitHub:** https://github.com/DeepakKTS/talking-tactile
- **Demo video:** https://www.youtube.com/watch?v=t0WsLi3jYXY
- **Gallery:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3765

Science textbooks are full of figures, and a blind student usually can’t use them. Talking Tactile turns a printed STEM figure into a raised sheet that talks.

The student touches a part of a raised heart, and a phone on a stand above the sheet plays a tone and says “left ventricle”. Holding the screen, they ask a question out loud and hear an answer drawn only from that figure and the teacher’s notes. Labels and tones keep working offline.

The teacher uploads a textbook figure. Muse Spark reads it and plans each part for touch. SAM 3.1 outlines each part from points Spark places, and code lays out the sheet with the gaps, textures and braille that tactile guidelines require. Nothing becomes touchable until the teacher checks it, and publishing refuses a sheet that breaks a tactile rule.

In our live eval, 36 of 38 heart questions and 35 of 35 brain questions were answered from the right source. Our first recorded touch test missed its accuracy target (median 4.0 mm, mean 7.9 mm against a 4 mm goal). The next fix is snapping calibration corners to the printed marks.

Built solo in ten days. Not yet tested with blind students or teachers.

## More from Meta Global AI Developer Hackathon

- [RigForge: A.I game art generator for 2d skeleton assets](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3762)
- [Rizonetech](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3763)
- [VoiceBridge](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3764)
- [CaseAlly](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3766)
- [Say Again](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3767)
- [SIkai Saathi](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3768)

---

Markdown version of https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3765. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt