AI & ML interests

RL Environments at Scale

Recent Activity

AdithyaSKย  updated a collection about 7 hours ago
Data Agent
AdithyaSKย  updated a collection about 7 hours ago
Data Agent
AdithyaSKย  updated a collection about 7 hours ago
Data Agent
View all activity

Organization Card

HuggingEnvs Banner

๐Ÿ’ป Code ๐Ÿ“– Guide ๐ŸŽฅ Slides

๐Ÿค— HuggingEnvs: Open RL Environments

HuggingEnvs is a home for end-to-end RL environment recipes, built to make it easier to explore, reproduce, train, and evaluate agent systems.

Explore complete and reproducible environment projects from us and the community, including:

  • ๐ŸŒ Open RL environments
  • ๐Ÿงฉ End-to-end environment recipes
  • ๐Ÿ’ป Complete implementations
  • ๐Ÿ“ฆ Models, datasets, and artifacts
  • ๐Ÿงช Training and evaluation setups
  • ๐Ÿš€ Demos and Spaces
  • ๐Ÿ“š Tutorials and guides

All the reproducible code โ€” environments, rollouts, training configs, notebooks, article and slide sources โ€” lives in one repo: github.com/adithya-s-k/HuggingEnvs. The artifacts those produce live here on the Hub.

HuggingEnvs Projects

A growing collection of open projects, environments, resources, and artifacts.

Project What it is Explore
HuggingEnvs Academy Articles, guides, tutorials, slides, and hands-on resources for learning how to build RL environments and agent systems. Explore โ†’
Data Agent Training SLMs for data science with multi-harness RL environments. Explore โ†’

Articles & Talks

What it covers Read / Watch
๐Ÿ“– The Ultimate Guide to RL Environments Building and scaling RL environments in the LLM era โ€” how frameworks are built, how rewards are wired, how they scale to thousands of concurrent sessions. Read โ†’
๐ŸŽž๏ธ RL Environments 101 From "what is an env?" to training your own: RL fundamentals โ†’ environment anatomy โ†’ OpenEnv โ†’ training with TRL. Watch โ†’
๐Ÿ“ˆ Scaling RL for LLMs RL environments and RL training โ€” what an environment is, how reward hacking happens, how to train against your own. AMD AI Dev Day. Watch โ†’
๐Ÿ”€ Multi-Harness Training OpenEnv ร— Harbor โ€” why an environment's failure model decides whether it can be trained against. Watch โ†’

Environments

Three reference environments, each implemented across six frameworks โ€” openenv, ors, nemo_gym, verifiers, skyrl_gym, gem. Same logic, six dialects. Source โ†’

Environment Tools OpenEnv ORS NeMo Gym
Jupyter agent โ€” real code execution in an E2B sandbox 4 Space Space Space
Wordle โ€” multi-turn, pure Python, no backend 1 Space Space Space
Desktop โ€” computer-use, vision-driven Linux desktop 19 Space Space โ€”

Build your own

Five agent skills turn a plain-English description into a runnable RL environment across four frameworks โ€” works with Claude Code, Cursor, Codex, OpenCode, Gemini CLI and others.

npx skills add adithya-s-k/HuggingEnvs

We're looking for new end-to-end recipes โ€” a task, an environment, a training run, and honest results. Contributing guide โ†’