OpsGate
OpenEnv Hackathon SFGitHub: https://github.com/Sidra/opsgate W&B: https://wandb.ai/code-happy-sf/opsgate OpsGate is a simulation-based reliability gate for enterprise AI agents. It places an LLM agent in a multi-tool environment (CRM, billing, calendar, email) with 25 tasks — 15 standard enterprise workflows and 10 adversarial traps — and scores it on a deterministic 100-point rubric. No LLM judge. Results: Llama-3.1-8B-Instruct went from 55.6 → 97.1 avg safety score after SFT + GRPO training in 16 minutes on H100. Baseline: 1/25 PASS, 15/25 BLOCK. After training: 24/25 PASS, 0/25 BLOCK, 9/10 adversarial traps caught. Graduated reward function: -0.5 (no JSON) → 0.0 (valid tools) → 1.0 (PASS). The reward signal is code, not vibes.
Team
Placement
Participant
