Skip to Main Content

A coding agent's conversation runs 100,000 tokens. Every single message, the model re-reads all of it before answering. Providers cache that work and charge up to 90% less the second time - but only for the model that did the reading. Model routers pick a different model for each message to save money. The moment one switches, the new model has read nothing, and you pay full price for all 100,000 tokens again. A single switch can cost more than the turn it was trying to optimize. No router on the market tracks this, so they all treat switching as free. Inertia makes switching cost something. A cache ledger in MongoDB Atlas records which model has read how much of each conversation, so the router can ask the real question: is a smarter model worth re-reading 100,000 tokens, given how many messages are left? Atlas Vector Search remembers how similar questions actually turned out, so it learns which ones truly need the expensive model instead of guessing.

Team

adinai

Placement

Participant

More from The Persistent Context Sprint Hackathon | Live at MongoDB .Local Build Fest

Amelia The problem. Live captions get the words right, but words are the easy part. In a group conversation, deaf and hard-of-hearing people lose everything…

Amelia for the Deaf project preview

Tracecase finds the exact environment that makes a customer's bug happen. - Problem: A customer reports that a feature is broken, yet the code review and…

TraceCase project preview

You never have to give claude context ever again. Your conversations with claude become skills and the moment it notices that you are performing the same task…

www.loom.com/…

Tusk — the SRE that never forgets. Experienced human SREs can solve problems quickly because they've seen the problem before. Tusk enables your AI SRE to do…

Tusk project preview

A persistent, reloadable project brain, where memories are both the candidates and the decentralized lenses an AI swarm judges through to establish project…

Galen Goodwick project preview

Groundhog is a game agent that dies, remembers, and comes back smarter. An LLM agent crawls a little dungeon we rigged so that a memoryless run reliably…

Groundhog project preview