Keyboard Repair Check
Built at Meta Global AI Developer Hackathon · Oct 26, 2026 · Remote
Keyboard Repair Check tests whether a model's repair of a broken web widget really works with a keyboard. It has 7 small hand-built broken widgets (div, span and h3 controls with click handlers, plus a native button whose focus outline was removed), a headless-Chrome checker (Tab reaches the control, a focus indicator is visible, Enter triggers the behaviour), and a harness that sends each widget to Muse Glimmer 30B and scores the repaired version. In one real run on 2026-11-04, the broken pages pass 0 of 7 and the Glimmer repairs pass 7 of 7. All repairs kept the visible text and handlers; the accordion heading became a button, so its heading element was lost. Scope: Tab and Enter on 7 small cases, one run each; the prompt names the broken element. It is not a screen-reader test or accessibility certification. Raw model output, hashes and scored results are in the repo.