CoEvolve

CoEvoLve — A Living Benchmark That Evolves Faster Than Any Model Can Game It. Static benchmarks leak. CoEvoLve solves this with a coevolutionary system where the benchmark and the solvers evolve together in an open-ended arms race.Two populations of Gemini agents co-evolve simultaneously: Examiners generate causal reasoning tasks and evolve toward maximum discriminative power — tasks that separate strong solvers from weak ones. Solvers attempt those tasks and evolve better reasoning strategies. .After 500 generations, the system independently discovered that graphs combining confounders, mediators, and colliders are maximally discriminative — a finding that matches the theoretical causal inference literature, without being programmed. The benchmark found the structure of LLM failure automatically.Built on ShinkaEvolve (Sakana AI, Apache 2.0) extended with dual-archive coevolution, Gemini 3 Pro for examiner mutations, Gemini 3 Flash for solver evaluation.