Forge: an AI agent that rebuilds its own harness, and can't cheat to do it. Forge takes a small, frozen model (gpt-4.1-nano) and lets an agent improve everything around it: it writes its own tools, rewrites its memory, and even edits the code that decides how it thinks. The model never changes; the harness evolves. ▎ ▎ The hard part of self-improving agents is that they can game their own grader or break themselves. In Forge, every change is proposed to a watchdog the agent can't touch. The deeper the change, the harder the check: tools are tested, memory changes are checked on hidden questions, and changes to how it thinks need human approval. The judge and the rules are locked. Every kept change is signed into a hash-chained history in MongoDB Atlas, which also holds the agent's configuration and the data it works on. That history can be replayed and rolled back. In one run, with the same frozen model, the agent went from 10 to 19 of 24 practice questions, and from 15 to 17 of 30 on a final exam it never saw. It blocked every attack we threw at it: rewriting the grader, smuggling in answers, writing to the database directly, tampering with history, and planting a time bomb. Built on MongoDB Atlas (substrate, history, sandboxed read-only agent access), OpenRouter, and Python. Run it locally with make dev.
More from The Harness Engineering & Model Wrangling #SFTechWeek Hackathon
MongoMation is an autonomous PLC engineer. You describe a machine in plain English, and Claude agents write IEC 61131-3 PLC code, compile and deploy it to a…

LabRat is a self-improving harness for a physical lab agent, running on a real bench: two SO-101 arms, a 3018 CNC carrying a servo pipette I designed during…

Recursive Harness Scientist: an AI scientist that improves its own scientific method, and must replicate every gain on data it has never seen. Why it…

Super Bid is a self-improving AI estimator that teaches itself to price bids the way a specific company would. It practices on the company’s real past bids…

A robot that gets better at handling objects it’s never seen, without retraining. After every round, an AI coach reviews what broke and rewrites the robot’s…
WORLDSTATE gives physical spaces a memory. Any phone becomes an observer: open a link, point the camera, and WORLDSTATE tracks what's inside fridges, shelves…
