Skip to Main Content

RoboReplan is a tabletop planning environment for OpenEnv that targets Problem Statement 3.1 (World Modeling: Professional Tasks). LLMs often fail at long-horizon robot tasks because they can't replan — they loop or freeze when something goes wrong (blockers, grasp slips, mid-task instruction changes). RoboReplan benchmarks this failure mode and trains agents to recover: clear blockers, pick and place in the right bins, and adapt when the instruction changes. The env is deliberately hard for a small model so we can show improvement over time (0% → 78% success with SFT + GRPO). Four domain skins (Default, Pharmacy, Warehouse, Lab) ground the same mechanics in professional scenarios. Built with OpenEnv 0.2.1, deployed on HF Spaces, trained with HF TRL (GRPO) in Colab

Team

jwalinshah

Placement

Participant

More from OpenEnv Hackathon SF

Kube SRE Gym is a self-improving RL environment where a small language model (Qwen3-1.7B) learns to diagnose and fix real Kubernetes production incidents…

Noclue project preview

RL environment for autonomous biologist agents. Simulate an entire biological worldstate based on scientifically-accurate single-cell standards. Naive agents…

Zero Shot Cancer project preview

ShopRLVE-GYM HF Blog https://huggingface.co/blog/thebajajra/shop-rlve-gym

Lambda project preview

Our agent uses OpenEnv to build a curriculum of video game environments that train a TinyLlama 1.1B agent via GRPO reinforcement learning. We implement three…

Play-gent project preview

GAIA is an OpenEnv-compatible geospatial reasoning environment where an AI agent infers hidden real-world locations using multi-step tool calls (terrain…

drive.google.com/…

Voyager-VRAM is a long-horizon workplace simulator where LLM agents must navigate a realistic office environment ( emails, Slack, shared drive, spreadsheets…

Deepmind Ace project preview