Gemmassist
Google DeepMind Bangalore HackathonTraditional mobile automation is highly rigid and brittle, relying on hardcoded coordinates or layout IDs that break as soon as an application's UI changes or an unexpected popup appears. GemmAssist solves this by building a true native Android reasoning agent that dynamically inspects accessibility trees, retains session history context, and performs autonomous local recovery (like back-tracking and coordinate offset recalculations) when visual verifications fail. By merging on-device voice pipelines (hands-free STT/TTS) with Model Context Protocol (MCP) tool calls and a parameterized workflow recorder, GemmAssist transforms fragile automated gestures into flexible, voice-driven, and highly adaptive agentic workflows inside any third-party application.
