Wisent - Kant: Environment for Evolutionary Ethics through Infinite and Dynamic Game Theory

Our project solves the problem of AI alignment by creating a game-theory inspired environment where models take actions and receive rewards. In addition to simulating over 100 classical game theory problems like prisoners dillemma or stag hunt, we added variants such as infinite horizon games, games with communication (both cheap talk and binding communication), games with uncertain payoffs or game structure, trembling hand equilibria, games with many agents. We also create a new version of game theory where agents interact with each other using their own rules: meta-gaming. We also add variants where the agents have reputation or gossip about each other. Our training shows this env contributes to improvements on classical problems like jailbreaking and ethical alignment showing the potential of evolutionary game theory for persistent alignment.

Team

Placement

Participant