Skip to Main Content

Recall

Built at Meta Global AI Developer Hackathon · Oct 26, 2026 · Remote

Recall — Demo video

Recall is a voice-first 3D memory of your home, built first for blind and low-vision people. Walk through a room once with an iPhone. Then ask "where's my watch?" and hear the answer: which surface, what height, when it was last seen. A Muse Spark Open agent then guides you there with spoken clock-face steps, and the camera checks that the thing is really there when you arrive. THE PROBLEM If you can't see, losing your keys means searching every surface by touch, or waiting for someone to help. Camera apps describe what's in front of you, but only if you know where to point. They don't remember, and they don't walk you there. HOW IT WORKS - Scan: the iPhone leads you round the room by voice and records photos, LiDAR depth and camera poses. No video is streamed. - Map: MapAnything rebuilds the room in metres. Classic geometry finds the floor, walls and surfaces. - Find: SAM 3.1 finds furniture and everyday things by name, and each is placed in 3D. - Ask: Muse Voice Transcribe hears you. The Guide agent, on Muse Spark Open, chooses its tools and words the answer. - Walk: a route planner keeps to the middle of free space, and the phone speaks each turn as a clock-face step. - Check: on arrival, a Verifier uses SAM 3.1 and LiDAR depth to confirm the thing is there. Muse Spark 1.1 can only lower confidence, never confirm. If the thing has moved nearby, the memory updates, and you can correct any name or colour in the app. WHY IT'S NOT A CHATBOT Geometry decides every fact; the model only puts it into words. The Guide can't state a place, distance or time that no tool returned, and the code enforces that. A wrong place sends a blind person the wrong way, so if Recall hasn't seen something, it says so. WHAT I MEASURED From the app's own logs, 31 Oct to 4 Nov 2026, one flat, one iPhone. Real use, not a study. - 49 of 49 answers grounded in what Recall really saw - 2 cm median gap between camera and memory, over 22 confirmed arrivals - 26 of 31 arrival checks where the camera saw the thing - 2.3 s median from question to answer, over 46 questions - 19 of 20 spoken replies understood, in a test of varied phrasing TESTED WITH A REAL USER A senior tester with low vision tried Recall on my iPhone. After a couple of runs, he said he could guide himself through the rooms and find his wallet. One person's feedback. PRIVATE BY DESIGN The map of your home stays on your own computer. Recall publishes no scan photos, and robots or other apps can connect only if you turn that on: read-only, over A2A, and never your live position. WHAT'S NEXT A fuller session with blind and low-vision testers, Apple Watch guidance beyond its current preview, and support for Meta AI glasses. TRY IT Website: https://recall-ten-khaki.vercel.app Demo, no sign-up: https://recall-ten-khaki.vercel.app/demo Real 3D scan: https://recall-ten-khaki.vercel.app/homes/flat/viewer Backup site: https://recall.onica.ai Or run it from the repo with make demo: no keys, no GPU, no account.

Team