Skill Forge - Agent Skill Gym
Built at OpenEnv Hackathon SF · Mar 7, 2026 · San Francisco, CA
From Scratch to Library. Inspired by paper SkillRL. This environment benchmarks LLM's ability to discover and compose reusable abstractions, addressing the gap in current tool-use evaluations where agents are given tools rather than learning to create them. Proof of concept **SkillForge** is an OpenEnv RL environment where an agent learns to solve chained Python DataFrame tasks by building a reusable skill library. The agent starts generating full pandas pipelines from scratch on every task. After training, it recognizes recurring operation chains, saves them as parameterized templates, and reuses them - outputting only param values instead of full code, dramatically reducing the output tokens. It's only for pandas dataframe manipulation as hackathon time constraints, but similar idea can be extended to much wider verifiable code generation space.