Skip to Main Content

WORLDSTATE gives physical spaces a memory. Any phone becomes an observer: open a link, point the camera, and WORLDSTATE tracks what's inside fridges, shelves and tables, what changed, and who changed it. Then anyone can just ask: "Hey World, where's the milk?" or "What's in fridge 2?" It answers out loud in about 2 seconds, with when and where it last saw the item. How it works: Detection on the device: MediaPipe on the laptop detects fridges and registered objects. Frames only go to the cloud when something relevant is in view. Perception: the vision model reads only the key frames. It catalogues contents, finds changes ("−milk") and tells whether this is the same fridge or a new one, using registered reference photos ("register this"). Memory: MongoDB Atlas holds the live state, the event history and long-term memory, and streams updates to a shared dashboard in real time. Voice: ElevenLabs speech-to-text and text-to-speech; answers come from hybrid search over the stored memory. Use cases: home kitchens and pantries, warehouses, commercial kitchens, shared equipment, and finding misplaced items. Anywhere tracking is manual and coordination costs time.

Team

arnavdewanthilakshriyan

Awards

More from The Harness Engineering & Model Wrangling #SFTechWeek Hackathon

MongoMation is an autonomous PLC engineer. You describe a machine in plain English, and Claude agents write IEC 61131-3 PLC code, compile and deploy it to a…

MongoMation project preview

LabRat is a self-improving harness for a physical lab agent, running on a real bench: two SO-101 arms, a 3018 CNC carrying a servo pipette I designed during…

LabRat project preview

Recursive Harness Scientist: an AI scientist that improves its own scientific method, and must replicate every gain on data it has never seen. Why it…

Recursive Harness Scientist project preview

Super Bid is a self-improving AI estimator that teaches itself to price bids the way a specific company would. It practices on the company’s real past bids…

SuperBid project preview

A robot that gets better at handling objects it’s never seen, without retraining. After every round, an AI coach reviews what broke and rewrites the robot’s…

to train a bot to play a game for you using recursive harnessing, a self-improving agent that repeatedly plays the game, evaluates its performance, identifies…

banana-fighter project preview