AI & ML interests
RL Environments at Scale
Recent Activity
๐ค HuggingEnvs: Open RL Environments
HuggingEnvs is a home for end-to-end RL environment recipes, built to make it easier to explore, reproduce, train, and evaluate agent systems.
Explore complete and reproducible environment projects from us and the community, including:
- ๐ Open RL environments
- ๐งฉ End-to-end environment recipes
- ๐ป Complete implementations
- ๐ฆ Models, datasets, and artifacts
- ๐งช Training and evaluation setups
- ๐ Demos and Spaces
- ๐ Tutorials and guides
All the reproducible code โ environments, rollouts, training configs, notebooks, article and slide sources โ lives in one repo: github.com/adithya-s-k/HuggingEnvs. The artifacts those produce live here on the Hub.
HuggingEnvs Projects
A growing collection of open projects, environments, resources, and artifacts.
| Project | What it is | Explore |
|---|---|---|
| HuggingEnvs Academy | Articles, guides, tutorials, slides, and hands-on resources for learning how to build RL environments and agent systems. | Explore โ |
| Data Agent | Training SLMs for data science with multi-harness RL environments. | Explore โ |
Articles & Talks
| What it covers | Read / Watch | |
|---|---|---|
| ๐ The Ultimate Guide to RL Environments | Building and scaling RL environments in the LLM era โ how frameworks are built, how rewards are wired, how they scale to thousands of concurrent sessions. | Read โ |
| ๐๏ธ RL Environments 101 | From "what is an env?" to training your own: RL fundamentals โ environment anatomy โ OpenEnv โ training with TRL. | Watch โ |
| ๐ Scaling RL for LLMs | RL environments and RL training โ what an environment is, how reward hacking happens, how to train against your own. AMD AI Dev Day. | Watch โ |
| ๐ Multi-Harness Training | OpenEnv ร Harbor โ why an environment's failure model decides whether it can be trained against. | Watch โ |
Environments
Three reference environments, each implemented across six frameworks โ openenv, ors, nemo_gym, verifiers, skyrl_gym, gem. Same logic, six dialects. Source โ
| Environment | Tools | OpenEnv | ORS | NeMo Gym |
|---|---|---|---|---|
| Jupyter agent โ real code execution in an E2B sandbox | 4 | Space | Space | Space |
| Wordle โ multi-turn, pure Python, no backend | 1 | Space | Space | Space |
| Desktop โ computer-use, vision-driven Linux desktop | 19 | Space | Space | โ |
Build your own
Five agent skills turn a plain-English description into a runnable RL environment across four frameworks โ works with Claude Code, Cursor, Codex, OpenCode, Gemini CLI and others.
npx skills add adithya-s-k/HuggingEnvs
We're looking for new end-to-end recipes โ a task, an environment, a training run, and honest results. Contributing guide โ
