# Crossmodal Search Engine

- **Event:** [Google I/O Hackathon](https://cerebralvalley.ai/e/google-io-hackathon)
- **When:** Sat, May 23 at 9:00 AM – 10:00 PM (PDT)
- **Where:** Shack15, San Francisco, CA
- **Team:** [Rae Jin](https://cerebralvalley.ai/u/raejin)
- **GitHub:** https://github.com/jin-dalrae/2605-GoogleIO-crossmodal-search
- **Demo video:** http://youtube.com/not yet
- **Gallery:** https://cerebralvalley.ai/e/google-io-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/google-io-hackathon/hackathon/gallery/41

A natural-language search tool for the Waymo Motion Dataset.

Using Waymo’s multimodal data—camera frames, object positions, acceleration, trajectory, and scene context—the system lets users describe the driving scenario they want to find in plain language. For example: “Find scenes where a pedestrian jaywalks.”

The tool then searches across the dataset and returns the exact frames or scene segments that match the requested situation, making it easier to identify complex behavioral patterns without manually reviewing hours of autonomous driving data.

---

Markdown version of https://cerebralvalley.ai/e/google-io-hackathon/hackathon/gallery/41. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt