# OpsGate

- **Event:** [OpenEnv Hackathon SF](https://cerebralvalley.ai/e/openenv-hackathon-sf)
- **When:** Mar 7 at 9:00 AM – Mar 8 at 12:00 AM (PST)
- **Where:** Shack15, San Francisco, CA
- **Team:** [Sidra Miconi](https://cerebralvalley.ai/u/Sidra)
- **GitHub:** https://github.com/Sidra/opsgate
- **Website:** https://colab.research.google.com/drive/1Y8KosYrTjjnQzt7FNMQ0knstU3CbskDw
- **Demo video:** https://youtu.be/B-Gm2p7JQyU
- **Hugging Face:** https://huggingface.co/spaces/SidraMiconi/opsgate
- **Gallery:** https://cerebralvalley.ai/e/openenv-hackathon-sf/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/openenv-hackathon-sf/hackathon/gallery/4

GitHub: https://github.com/Sidra/opsgate
W&B: https://wandb.ai/code-happy-sf/opsgate

OpsGate is a simulation-based reliability gate for enterprise AI agents. It places an LLM agent in a multi-tool environment (CRM, billing, calendar, email) with 25 tasks — 15 standard enterprise workflows and 10 adversarial traps — and scores it on a deterministic 100-point rubric. No LLM judge.

Results: Llama-3.1-8B-Instruct went from 55.6 → 97.1 avg safety score after SFT + GRPO training in 16 minutes on H100. Baseline: 1/25 PASS, 15/25 BLOCK. After training: 24/25 PASS, 0/25 BLOCK, 9/10 adversarial traps caught.

Graduated reward function: -0.5 (no JSON) → 0.0 (valid tools) → 1.0 (PASS). The reward signal is code, not vibes.

---

Markdown version of https://cerebralvalley.ai/e/openenv-hackathon-sf/hackathon/gallery/4. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt