NavEvolve — Self-Improving Spatial Memory for Embodied AI Agents Embodied AI agents can perceive their surroundings, but struggle to remember places, recognize previously visited environments, and use those memories to navigate intelligently. NavEvolve addresses this challenge by building a persistent, cognitively inspired spatial memory from first-person observations in photorealistic Gaussian Splat environments. Using Gemini, the agent generates visual and semantic embeddings from captured images and their descriptions, combining them with spatial measurements to associate observations with places and objects. These memories form a cognitive graph of recognizable locations and their connections, stored in MongoDB Atlas. A recursive harness evaluates and optimizes the place-recognition policy, measuring missed revisits and incorrect memory associations. Through natural-language instructions, the agent can retrieve relevant memories, plan paths across a navigation mesh, physically navigate to remembered viewpoints, and visually verify what it finds. Our goal is to move embodied AI beyond recognizing objects toward learning, remembering, and reasoning about places.
More from The Harness Engineering & Model Wrangling #SFTechWeek Hackathon
MongoMation is an autonomous PLC engineer. You describe a machine in plain English, and Claude agents write IEC 61131-3 PLC code, compile and deploy it to a…

LabRat is a self-improving harness for a physical lab agent, running on a real bench: two SO-101 arms, a 3018 CNC carrying a servo pipette I designed during…

Recursive Harness Scientist: an AI scientist that improves its own scientific method, and must replicate every gain on data it has never seen. Why it…

Super Bid is a self-improving AI estimator that teaches itself to price bids the way a specific company would. It practices on the company’s real past bids…

A robot that gets better at handling objects it’s never seen, without retraining. After every round, an AI coach reviews what broke and rewrites the robot’s…
WORLDSTATE gives physical spaces a memory. Any phone becomes an observer: open a link, point the camera, and WORLDSTATE tracks what's inside fridges, shelves…
