Toby

Built a system for building and governing AI agents through AR glasses. AI can now act on its own, but there's no clean way for a human to stay in the loop and govern an agent in the moment as it acts on the real world — you either grant full autonomy and hope, or babysit every step and lose the point. With Glance, you look at a real object, ask an agent to control it, and it builds itself, takes control, and surfaces only its genuine judgment calls to your field of view, where you resolve them with a glance or your voice — and the limits you set become rules it respects, acting on its own where you've allowed it and stopping to ask where you haven't. We prove it on a real smart lamp: you glance at it, an agent connects over Bluetooth and controls it live, proposes a schedule tuned to your day, and when told "never turn off without asking," later catches itself mid-action and asks first instead of crossing the line you drew. The whole approach is only possible because Gemini 3.5 Flash is fast and cheap enough for the agent to score its own confidence at every step — handling the routine silently and escalating only what genuinely needs you — turning "an agent that acts" into "an agent you can govern."