RAX

RAX is a real-time, low-latency robotic agent framework powered by Gemini 3.1 Flash Audio and LiveKit Agents. By leveraging a persistent, bidirectional WebRTC/WebSocket pipeline, RAX enables an autonomous robot to "see" through its camera, "hear" user spoken commands, process environmental context multi-modally, and execute precise physical actions (like gaze-tracking or halting) via asynchronous function calling—all with natural, conversational, and instantaneous voice feedback.