# Agentic Verification Layer

- **Event:** [Meta Global AI Developer Hackathon](https://cerebralvalley.ai/e/meta-ai-developer-hackathon)
- **When:** Oct 26, 12:00 PM – Nov 4, 9:00 PM (EST)
- **Where:** Online
- **Team:** [Souvik Roy](https://cerebralvalley.ai/u/sroy0211)
- **GitHub:** https://github.com/sroy0211/agentic-re-verifier-meta-global-ai-developer-hackathon
- **Demo video:** https://youtu.be/W_HgY0_07SI
- **Gallery:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/726

LLM agents hallucinate, and the usual fix — having a second LLM check the first — fails, because the verifier hallucinates too. The Agentic Verification Layer puts a deterministic oracle between the agent and ground truth: the model (Muse Spark) proposes a claim and explains the outcome, but the accept/reject verdict is a pure function of executable evidence, and when evidence can't settle it the gate returns INCONCLUSIVE instead of guessing.

I demonstrate it on the hardest domain to fake — stripped x86-64 binaries — with three verdict modes: symbol (static imports + live Frida PLT-stub firing), behavioral (differential execution, verifies a crackme key with no comparison symbol), and semantic (differential testing vs a reference, catching a binary claimed to compute factorial that really computes (n-1)!). On 44 ground-truth RE questions, Muse Spark hallucinated 20% of the time and the layer caught 100%.

Then I prove the pattern generalizes: the same gate, refactored into one core with thin adapters, runs across four recognized benchmarks — HumanEval+/MBPP+, GSM8K, BFCL, and BIRD — on real data. Across all four it caught 19 of 19 Muse Spark hallucinations. One pattern, five domains, nothing faked.

## More from Meta Global AI Developer Hackathon

- [EdgeCases](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/723)
- [RAJAKUMARAN](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/724)
- [Point, Say, Press](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/725)
- [ProofPath](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/727)
- [Farhan](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/728)
- [EcoAgents](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/729)

---

Markdown version of https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/726. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt