Execution Assurance Bureau

AI generated repositories increasingly optimize for plausibility rather than behavioral correctness. A repository can boot successfully, expose polished APIs, and still contain incomplete or non functional runtime behavior underneath. RepoProbe is an execution assurance system for AI generated repositories. Instead of statically analyzing code, it executes repositories, probes runtime surfaces, fuzzes endpoints, verifies behavioral consistency, and compares observed runtime evidence against functionality claimed in repository READMEs. The pipeline is intentionally split into two layers. Deterministic systems handle repository fingerprinting, execution planning, runtime probing, contradiction detection, and behavioral verification. Gemini 3.5 Flash is then used to synthesize runtime evidence and reason over contradictions without generating evidence itself. The investigation system escalates suspicious runtime behavior into deeper probing workflows. For example, if an authentication endpoint returns invariant responses across malformed JWTs, empty credentials, and randomized payloads, RepoProbe flags the implementation as behaviorally inconsistent with its claimed authentication guarantees. The terminal interface streams the investigation live as execution unfolds: runtime boot events, route discovery, contradiction escalation, fuzzing, trust score degradation, and final runtime assessment. The project was built as infrastructure for a problem that is becoming increasingly common with AI generated software: code that looks production ready while remaining behaviorally incomplete under execution.

Team

Placement

Participant