Skip to content

docs: update RL framework compatibility table - #1523

Merged
ananthsub merged 4 commits into
NVIDIA-NeMo:mainfrom
ananthsub:ananthsub/docs-rl-framework-compatibility
Jun 4, 2026
Merged

ananthsub merged 4 commits into
NVIDIA-NeMo:mainfrom
ananthsub:ananthsub/docs-rl-framework-compatibility

Conversation

@ananthsub

Copy link
Copy Markdown
Contributor
  • Remove the Ecosystem/NeMo RL GRPO note
  • Rename the container column to "Container / Docker File", and stage a v0.3.0 row

Remove the Ecosystem/NeMo RL GRPO note, rename the container column to
"Container / Docker File", and stage a v0.3.0 row (placeholders for now).

Signed-off-by: Ananth Subramaniam <ansubramania@nvidia.com>
@copy-pr-bot

copy-pr-bot Bot commented Jun 3, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@nemo-automation-bot nemo-automation-bot Bot added the community-request Issue reported or requested by someone from the community label Jun 3, 2026
@ananthsub ananthsub added documentation Improvements to documentation and removed community-request Issue reported or requested by someone from the community labels Jun 3, 2026
@ananthsub ananthsub linked an issue Jun 3, 2026 that may be closed by this pull request
Link out to the existing Training with VeRL tutorial for verl version
compatibility rather than duplicating the facts here.

Signed-off-by: Ananth Subramaniam <ansubramania@nvidia.com>
ananthsub added 2 commits June 3, 2026 17:57
Replace the v0.3.0 placeholders with links to the RL Dockerfile and the
Nemotron 3 Ultra guide.

Signed-off-by: Ananth Subramaniam <ansubramania@nvidia.com>
Add a NeMo RL GRPO tutorial note to the NeMo RL Container section and
define the NeMo Gym <> verl version compatibility in the VeRL section.

Signed-off-by: Ananth Subramaniam <ansubramania@nvidia.com>
@ananthsub
ananthsub marked this pull request as ready for review June 4, 2026 01:07

@cmunley1 cmunley1 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

suggest upgrading nano tutorial to main and newer container, as the NemoRL codebase has evolved a lot.

@ananthsub
ananthsub merged commit 8570842 into NVIDIA-NeMo:main Jun 4, 2026
21 checks passed
@ananthsub
ananthsub deleted the ananthsub/docs-rl-framework-compatibility branch June 4, 2026 03:07

This branch was previously deployed

1 inactive deployment
public β€” ddd7ea6a Deployed Jun 4, 2026 by copy-pr-bot[bot] via release / finalize / notify #271
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Update RL framework compatibility docs table and add verl link

3 participants