Vedit Agrawal
Built at Meta Global AI Developer Hackathon · Oct 26, 2026 · Remote

ChronoSight-MCP is a hands-free, closed-loop hardware diagnostic and self-healing firmware workbench for browsers and smart glasses. When a robotic actuator or industrial controller oscillates on a bench, engineers have both hands occupied holding probes while cross-referencing multi-hundred-page datasheets and writing compensating firmware. ChronoSight-MCP closes the loop from raw video pixels to verified code: 1. Differential Optical Vibrometry: SAM 3.1 tracks up to 16 components simultaneously. We stream masks in a custom binary wire format (.csmk), subtract static fiducial anchor motion to cancel handheld camera shake, resample timestamps with outlier rejection (`apps/web/lib/session/psd.ts`), and run Welch Power Spectral Density (PSD) analysis to lock onto physical oscillations (7.4 Hz J2 servo resonance) in real time. 2. Zero-RAG Datasheet Pinning: Muse Spark 1.3 pins the entire 60-page ENCX-14 reference manual (`corpus/encx14/encx14.pdf`) in its 1M-token window, enforcing deterministic page and SHA-256 quote verification. 3. Gated Sandbox Patching: Muse Wonder 1.0 enforces an operator safety gate before Muse Code (`@muse-code/sdk`) compiles and unit-tests a compensating register patch inside a seccomp-filtered, egress-proxied container or Modal sandbox (`deploy/modal/sandbox.py`) against a physics Digital Twin. 4. Post-Patch Visual Unit Testing & Placebo Control: SAM 3.1 re-segments the post-patch video stream to prove >20 dB oscillation suppression—and deterministically rejects a 1-click Placebo Control patch—logged in an RFC 8785 JCS SHA-256 hash chain (`packages/run-model`).