Second Opinion
Built at Meta Global AI Developer Hackathon · Oct 26, 2026 · Remote
Second Opinion is a privacy-preserving, webcam-guided coaching demo for upper-limb rehabilitation, built around a real daily-living task: reaching to the face and holding it there, as in washing your face. In /setup, the person gives separate consents, passes camera checks and calibrates their arms and face. In /session, a Meta Detectron2 pose model running in a local sidecar tracks 17 body keypoints, and OpenCV keeps frames on the device. A fast rule-based System 1 turns the keypoints into joint angles and flags struggle signs such as a failed reach, a hand that can’t stay at face level, a dropped hand and shoulder hiking. Coaching is triggered only when difficulty appears or the person asks for it. Separate /metrics, /review and /validation pages let a therapist or reviewer inspect struggle events, coaching calls and evaluation results. No video leaves the device, and only a small angle summary can go to the cloud, with consent. This is a research demo, not a clinical tool.