Airlock serves as a self-improving controller for delegating and evaluating subagents within coding harnesses. In our own experiences, we've found that the orchestrator agent has the tendency to delegate vague tasks to subagents, leading to overly broad specifications to specific tasks. Furthermore, these subagents evaluate on themselves, writing tests that can evaluate functionality of a feature, yet overlook requirements such as data integrity, ownership boundaries, and safe retry behavior. Airlock delegates approved coding tasks in a schematic, objective-oriented format, which freezes the resulting code, and validates it against independent, controller-owned checks before integration. Changes that fail these tests are rejected, and the subagent must reattempt the fix. Our distinctive feature is improving the validation harness itself, which can be shared across engineering teams. If someone flags an issue with code that passes the harness but fails external tests, the harness will learn to improve its testing ability, until it is able to flag the same issue without overfitting, only accepting a candidate harness if it can detect more defects without reducing the acceptance of legitimate work, thus evolving alongside codebase.
More from The Harness Engineering & Model Wrangling #SFTechWeek Hackathon
MongoMation is an autonomous PLC engineer. You describe a machine in plain English, and Claude agents write IEC 61131-3 PLC code, compile and deploy it to a…

LabRat is a self-improving harness for a physical lab agent, running on a real bench: two SO-101 arms, a 3018 CNC carrying a servo pipette I designed during…

Recursive Harness Scientist: an AI scientist that improves its own scientific method, and must replicate every gain on data it has never seen. Why it…

Super Bid is a self-improving AI estimator that teaches itself to price bids the way a specific company would. It practices on the company’s real past bids…

A robot that gets better at handling objects it’s never seen, without retraining. After every round, an AI coach reviews what broke and rewrites the robot’s…
WORLDSTATE gives physical spaces a memory. Any phone becomes an observer: open a link, point the camera, and WORLDSTATE tracks what's inside fridges, shelves…
