Fingerpost
Built at Meta Global AI Developer Hackathon · Oct 26, 2026 · Remote

Flat touch panels made microwaves, lifts and kiosks unusable for blind people: 43 million are blind, 295 million more have serious vision loss, and 52% of blind users say new appliances are less accessible than old ones. AI assistants can describe a panel, but none gets your finger onto the right key. Fingerpost is turn-by-turn directions for your fingertip. Take one photo of any machine's control panel and Meta's models map every button. Say what you want ("heat my tea for 45 seconds"). The phone tracks your fingertip and guides it to each button with beeps that speed up as you get close and short spoken cues. It detects every press from the display, reads the display back to check it worked, and when you hit the wrong key it says so ("That was 1, not 4") and replans. Works on any phone browser, no hardware or changes to the machine. Also: explore mode, "tell me when it's done", 12 languages, and a virtual microwave anyone can try. Live demo: https://fingerpost.onrender.com