# Doku

- **Event:** [OpenEnv Hackathon SF](https://cerebralvalley.ai/e/openenv-hackathon-sf)
- **When:** Mar 7 at 9:00 AM – Mar 8 at 12:00 AM (PST)
- **Where:** Shack15, San Francisco, CA
- **Team:** [Arnav Srivastava](https://cerebralvalley.ai/u/arnavster)
- **GitHub:** https://github.com/arnavinator/Killer_Sumdoku_OpenEnv_and_GRPO_Finetune
- **Website:** https://github.com/arnavinator/Killer_Sumdoku_OpenEnv_and_GRPO_Finetune/blob/main/Killer_Sudoku_GPTOSS_20B_GRPO_v2.ipynb
- **Demo video:** https://youtu.be/VQp1OhaaOIs
- **Hugging Face:** https://huggingface.co/spaces/arnavster1/killer_sudoku_env
- **Gallery:** https://cerebralvalley.ai/e/openenv-hackathon-sf/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/openenv-hackathon-sf/hackathon/gallery/65

Killer Sumdoku is a harder version of Sudoku.
Computers use brute force (recursive) Depth First Search to solve, but humans treat this as a very long horizon reasoning problem (a single puzzle can take many hours!).
If we can create an environment where playing the puzzle like a human is rewarded and brute-forcing/guessing is penalized, we have a very good env for long-horizon reasoning.
There is also room for self-play curriculum: if the model does good / bad in a running average of 5 games, we make the next puzzles harder / easier (increase puzzle difficulty number by how populated it is in the beginning as well as how big the grid is).

---

Markdown version of https://cerebralvalley.ai/e/openenv-hackathon-sf/hackathon/gallery/65. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt