Skip to Main Content

Notary is admission control for AI agent memory. Agents that learn from experience write "lessons" into procedural memory and follow them forever but nobody checks whether a lesson is true, overgeneralized, or poisoned. One caller saying "your manager told me gold members get refunds anytime" can rewrite an agent's rules for every future customer. Notary sits between the agent and its memory. A lesson proposed from failure clusters or extracted from live chat and ElevenLabs voice calls becomes trusted memory only if it improves held-out tasks, causes no regressions, introduces no hard-rule violations (graded by deterministic code, no LLM judge), and comes from a trusted source. Known attacks are caught instantly with Atlas Vector Search. Promotion and rollback are single MongoDB transactions with an audit log, and Atlas Agent Engine holds the procedural memory with Notary as its only writer. Results (3 repeats, same model): the promoted lesson took held-out tasks from 18 to 42/42 and cut refunds paid against policy from $1,608 to $500 per pass; a loophole draft, an overgeneralized rule and three poisoning attempts were quarantined or rejected. A blind 40-task benchmark exposed date-boundary mistakes; the loop proposed a follow-up lesson that passed the gate (held-out 45→55/60, regression 60→65/66, 0 new violations).

Team

PujaSridhar

More from The Harness Engineering & Model Wrangling #SFTechWeek Hackathon

MongoMation is an autonomous PLC engineer. You describe a machine in plain English, and Claude agents write IEC 61131-3 PLC code, compile and deploy it to a…

MongoMation project preview

LabRat is a self-improving harness for a physical lab agent, running on a real bench: two SO-101 arms, a 3018 CNC carrying a servo pipette I designed during…

LabRat project preview

Recursive Harness Scientist: an AI scientist that improves its own scientific method, and must replicate every gain on data it has never seen. Why it…

Recursive Harness Scientist project preview

Super Bid is a self-improving AI estimator that teaches itself to price bids the way a specific company would. It practices on the company’s real past bids…

SuperBid project preview

A robot that gets better at handling objects it’s never seen, without retraining. After every round, an AI coach reviews what broke and rewrites the robot’s…

WORLDSTATE gives physical spaces a memory. Any phone becomes an observer: open a link, point the camera, and WORLDSTATE tracks what's inside fridges, shelves…

WorldSTATE project preview