kaumnen

AIMS is an open-source bench for AI alignment. Agents can lie, leak secrets, cheat or work together without us realizing it. In AIMS, each task contains hidden temptations on purpose. Agents work in Docker sandboxes. A monitor model is watching every call and behavior and flags issues across 15 different categories. Temptations are known and AIMS scores what the agent took against what the monitor caught