SentinelOps

SentinelOps Arena is a multi-agent adversarial reinforcement learning environment for enterprise AI safety. It simulates systems like CRM, Billing, and Ticketing with three agents: a Red Team Attacker, a Blue Team Worker, and an Auditor. The Attacker launches schema drift, policy drift, social engineering, and rate-limiting attacks, while the Worker must complete legitimate customer tasks without being manipulated. The Auditor reviews actions and flags violations with scored explanations. Rewards are computed directly from the environment state (no LLM-as-judge). Agents are trained with GRPO using four reward layers: format validation, approximate format scoring, action correctness with anti-gaming logic, and live environment execution with six-step attacker lookahead. Built on OpenEnv with FastMCP tools, the Worker learns to detect schema drift, verify policies before refunds, and reject social engineering, reducing attack success from 80% to under 20%.