OpenEyes AI

OpenEyes AI — Giving People a New Way to Experience the World OpenEyes AI is a voice-first accessibility companion designed to help blind and low-vision individuals understand their surroundings, locate everyday objects, read printed information, and interact with artificial intelligence through natural conversation. Our mission is simple: make everyday life more accessible, independent, and connected. Built as a native Android application, OpenEyes works with both a smartphone camera and compatible Ray-Ban Meta smart glasses. Users can ask questions about their surroundings and receive spoken descriptions without relying on a traditional visual interface. Core capabilities: Live Explore: Combines continuous camera processing, on-device object detection, and Meta Muse Spark to provide contextual descriptions of visible environments. Find Objects: Helps locate items such as keys, bottles, cups, and eyeglasses using object recognition, visual tracking, directional feedback, and optional vibration when a target is centered. Read Text: Recognizes printed text from signs, labels, menus, and documents and reads it aloud using accessible speech controls. AI Conversation: Enables natural voice and text interaction for general questions, explanations, and supported real-time information tools. Trusted Circle: Provides accessible contact management and voice-assisted calling with explicit confirmation. Spatial Intelligence: Allows users to scan indoor spaces, identify rooms, and save observations for later reference. Experimental mapping and route-preview capabilities provide a foundation for future indoor navigation research. Technical architecture: OpenEyes combines Meta Muse Spark, Meta SAM 3.1, Meta's Wearables Device Access Toolkit, Android CameraX, on-device object detection, and OCR into a hybrid AI architecture. Rather than sending every camera frame to the cloud, OpenEyes performs suitable vision tasks locally and uses Meta models for more complex understanding. This approach aims to improve responsiveness while providing intelligent, conversational assistance. OpenEyes is more than a chatbot or photograph-description tool. It brings together vision, speech, object tracking, personal assistance, and spatial memory in one accessibility-focused mobile experience. Our vision is a world where technology helps people experience their surroundings with greater confidence and independence.