Skip to Main Content

Repository-to-RLenv

Built at OpenEnv Hackathon SF · Mar 7, 2026 · San Francisco, CA

Repository-to-RLenv — Demo video

Repository-to-RLEnv converts real Python repositories into executable RL environments for code agents. With one Claude Code MCP command, it inspects a repo, finds a clean test scope, creates a staged copy, injects a small source-code bug, verifies the failing tests, generates task metadata, validates the environment, and deploys it to Hugging Face Spaces as a live OpenEnv environment. The result is a repo-level RL environment where an agent can read files, edit code, run tests, and submit fixes while receiving rewards from the real test suite. I also built a web UI for running episodes on deployed Spaces. The problem this solves is improving the quality of AI coding assistants for YOUR own codebase.

Team