Crossmodal Search Engine

A natural-language search tool for the Waymo Motion Dataset. Using Waymo’s multimodal data—camera frames, object positions, acceleration, trajectory, and scene context—the system lets users describe the driving scenario they want to find in plain language. For example: “Find scenes where a pedestrian jaywalks.” The tool then searches across the dataset and returns the exact frames or scene segments that match the requested situation, making it easier to identify complex behavioral patterns without manually reviewing hours of autonomous driving data.