Skip to Main Content

Visual Learning Studio

Gemini 4 NYC Hackathon

Students encounter complex concepts every day, from understanding how machines operate to visualizing processes that are difficult to explain through words and static diagrams. Traditional learning resources often rely on technical jargon and two-dimensional illustrations, leaving students struggling to understand how components connect, move, and interact. Visual Learning Studio transforms complex concepts into interactive 3D learning experiences in real time through a coordinated AI workflow. Students can highlight text, select diagrams or images directly from their screens, or simply describe what they want to understand. An **interpretation agent powered by Gemini 4 Hydrogen** analyzes the selected information, identifies the underlying concept, and extracts its key components and relationships. A **visualization agent** then uses this information to construct or select relevant interactive 3D scenes, with selectable reference points that allow students to inspect individual components, explore internal structures, and observe how systems operate. We also tested **Gemini 4 Argon** during development for text-based reasoning and explanations. Beyond visualization, an AI teaching agent transforms complex technical jargon into simple, engaging narratives using everyday analogies and step-by-step storytelling. An integrated voice system delivers these explanations while synchronizing narration with component highlighting, camera movements, and animations. Students can ask follow-up questions, explore specific parts in greater detail, and adjust the complexity of explanations to match their understanding. From exploring jet propulsion and automotive engines to visualizing robotic movements, Visual Learning Studio combines multimodal understanding, interactive 3D visualization, and personalized voice-guided teaching to help students **see, explore, and truly understand concepts that were previously difficult to imagine.**

Team

vbm89891

More from Gemini 4 NYC Hackathon

We design an agentic system to automatically create + manage intelligent AI opponents/NPCs in video games. The suite of agents analyzes user gameplay…

Adaptive NPCs project preview

Manually routing PCBs is time-consuming and cost-inefficient. Current best algorithms (freerouting, PCBRouter) score very low on PCBWorld's hardest PCB…

routr project preview

Heliocam is a camera app where Gemini controls the camera. It watches what you're pointing at, sets the ISO, shutter, focus, white balance and zoom for you…

heliocam project preview

Repairs and assembly fail because manuals are lost, vague, missing, or nonexistent, so people break things or throw them out. KLIK turns a photo of any object…

Klik project preview

Iron Pulse turns your laptop into a 3D boxing ring. Fight an adaptive AI rival in real time using just your webcam. Throw real punches and lean to dodge…

Iron Pulse Arena project preview

Text your raw footage to an iMessage number and get a finished, trend-informed Reel back in the same thread.

Sticky project preview