Skip to Main Content

Apprentice Coach

Built at Meta Global AI Developer Hackathon · Oct 26, 2026 · Remote

Apprentice Coach — Demo video

Apprentice turns any instructions into a live camera coach for hands-on work. Give it a video of an expert doing a job, a direct video link, a PDF or help page, or photos of printed manual pages. Muse Spark splits the job into ordered steps with parts, tools, a "done when" check and warnings, and finds exactly when each step is finished in the expert's video. SAM 3.1 grounds every part in the expert's finished frames, Muse Image draws a labelled diagram per step, and Muse Wonder reviews the whole guide for hazards. Then a beginner points their phone at their own work. Apprentice compares their frames with the expert's and only moves on when two confident checks agree the step is really done. Otherwise it asks to see closer, sends them back with evidence, or stops them before an unsafe step. They can ask questions by voice. Every run ends with a report showing each step's evidence frames, and steps many trainees struggle with are flagged for the guide's author. The problem: hands-on know-how (repairs, servicing, assembly, lab and kitchen work, field installs) lives in a few experts' heads. Training someone means the expert stands beside them for days, and written instructions get skipped. Apprentice lets an expert record a job once and have it checked every time someone else does it. Live: https://apprentice-xi.vercel.app (example guides: open an HP ProBook laptop, replace a hand pump packing nut). Measured on openly licensed repair videos: 0 false passes on 12 real cross-video checks, about $0.02 to $0.03 per coaching minute and $0.20 to $0.60 per guide.

Team