Skip to content

Commit 03f6330

Browse files
docs: update readme post 0.5 (#1856)
Signed-off-by: Ashwath Aithal <aaithal@nvidia.com>
1 parent 6246c81 commit 03f6330

1 file changed

Lines changed: 17 additions & 10 deletions

File tree

‎README.md‎

Lines changed: 17 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -10,10 +10,11 @@
1010
</div>
1111

1212
## 📣 News
13+
* [01/30/2026] [Release v0.5.0!](https://github.com/NVIDIA-NeMo/RL/releases/tag/v0.5.0)
14+
* Both linux/amd64 and linux/arm64 Docker containers are available on NGC [nvcr.io/nvidia/nemo-rl:v0.5.0](https://registry.ngc.nvidia.com/orgs/nvidia/containers/nemo-rl/tags).
15+
* NeMo-Gym + NeMo-RL support
16+
* 📊 [Coming soon] release run
1317
* [12/15/2025] NeMo-RL is the framework that trained [NVIDIA-NeMotron-3-Nano-30B-A3B-FP8](https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8)! [This guide](docs/guides/nemotron-3-nano.md) provides reproducible instructions for the post-training process.
14-
* [12/1/2025] [Release v0.4.0!](https://github.com/NVIDIA-NeMo/RL/releases/tag/v0.4.0)
15-
* First release with official NGC Container [nvcr.io/nvidia/nemo-rl:v0.4.0](https://registry.ngc.nvidia.com/orgs/nvidia/containers/nemo-rl/tags).
16-
* 📊 View the release run metrics on [Google Colab](https://colab.research.google.com/drive/1u5lmjHOsYpJqXaeYstjw7Qbzvbo67U0v?usp=sharing) to get a head start on your experimentation.
1718
* [10/10/2025] **DAPO Algorithm Support**
1819
NeMo RL now supports [Decoupled Clip and Dynamic Sampling Policy Optimization (DAPO)](https://arxiv.org/pdf/2503.14476) algorithm that extends GRPO with **Clip-Higher**, **Dynamic Sampling**, **Token-Level Policy Gradient Loss**, and **Overlong Reward Shaping** for more stable and efficient RL training. See the [DAPO guide](docs/guides/dapo.md) for more details.
1920
* [9/27/2025] [FP8 Quantization in NeMo RL](https://github.com/NVIDIA-NeMo/RL/discussions/1216)
@@ -22,7 +23,9 @@
2223

2324
<details>
2425
<summary>Previous News</summary>
25-
26+
* [12/1/2025] [Release v0.4.0!](https://github.com/NVIDIA-NeMo/RL/releases/tag/v0.4.0)
27+
* First release with official NGC Container [nvcr.io/nvidia/nemo-rl:v0.4.0](https://registry.ngc.nvidia.com/orgs/nvidia/containers/nemo-rl/tags).
28+
* 📊 View the release run metrics on [Google Colab](https://colab.research.google.com/drive/1u5lmjHOsYpJqXaeYstjw7Qbzvbo67U0v?usp=sharing) to get a head start on your experimentation.
2629
* [9/30/2025] [Accelerated RL on GCP with NeMo RL!](https://discuss.google.dev/t/accelerating-reinforcement-learning-on-google-cloud-using-nvidia-nemo-rl/269579/4)
2730
* [8/15/2025] [NeMo-RL: Journey of Optimizing Weight Transfer in Large MoE Models by 10x](https://github.com/NVIDIA-NeMo/RL/discussions/1189)
2831
* [7/31/2025] [NeMo-RL V0.3: Scalable and Performant Post-training with Nemo-RL via Megatron-Core](https://github.com/NVIDIA-NeMo/RL/discussions/1161)
@@ -71,19 +74,21 @@ For detailed information on backend selection, configuration, and examples, see
7174
## Features
7275

7376
✅ _Available now_ | 🔜 _Coming in v0.4_
74-
75-
- 🔜 **Nemo-Gym Integration** - RL Environment Integration.
77+
- 🔜 **Muon Optimizer** - Emerging Optimizer support for SFT/RL
7678
- 🔜 **Megatron Inference** - Improved performance for Megatron Inference (avoid weight conversion).
79+
- 🔜 **SGLang Inference** - SGLang rollout suport for optimized inference.
7780
- 🔜 **Improved Native Performance** - Improve training time for native PyTorch models.
7881
- 🔜 **Improved Large MoE Performance** - Improve Megatron Core training performance and generation performance.
79-
- 🔜 **New Models** - gpt-oss, Qwen3-Next, Nemotron-Nano3.
80-
- 🔜 **Expand Algorithms** - LoRA support for SFT/RL
82+
- 🔜 **New Models** - Qwen3-Next, Nemotron-Super.
83+
- 🔜 **Expand Algorithms** - GDPO, LoRA support for RL(GRPO) and DPO
8184
- 🔜 **Resiliency** - Fault tolerance and auto-scaling support
82-
- 🔜 **GB200** - Add container support for GB200.
85+
- 🔜 **On-Policy Distillation** - Multi-teacher and cross tokenizer distillation support
86+
- 🔜 **Speculaive Decoding** - Speculative Decoding support for rollout acceleration
87+
8388
- ✅ **Distributed Training** - Ray-based infrastructure.
8489
- ✅ **Environment Support and Isolation** - Support for multi-environment training and dependency isolation between components.
8590
- ✅ **Worker Isolation** - Process isolation between RL Actors (no worries about global state).
86-
- ✅ **Learning Algorithms** - GRPO/GSPO/DAPO, SFT, DPO, and On-policy distillation.
91+
- ✅ **Learning Algorithms** - GRPO/GSPO/DAPO, SFT(with LoRA), DPO, and On-policy distillation.
8792
- ✅ **Multi-Turn RL** - Multi-turn generation and training for RL with tool use, games, etc.
8893
- ✅ **Advanced Parallelism with DTensor** - PyTorch FSDP2, TP, CP, and SP for efficient training (through NeMo AutoModel).
8994
- ✅ **Larger Model Support with Longer Sequences** - Performant parallelisms with Megatron Core (TP/PP/CP/SP/EP/FSDP) (through NeMo Megatron Bridge).
@@ -94,6 +99,8 @@ For detailed information on backend selection, configuration, and examples, see
9499
- ✅ **Vision Language Models (VLM)** - Support SFT and GRPO on VLMs.
95100
- ✅ **Megatron Inference** - Megatron Inference for fast Day-0 support for new Megatron models (avoid weight conversion).
96101
- ✅ **Async RL** - Support for asynchronous rollouts and replay buffers for off-policy training, and enable a fully asynchronous GPRO.
102+
- ✅ **Nemo-Gym Integration** - RL Environment Integration.
103+
- ✅ **GB200** - container support for GB200.
97104

98105
## Table of Contents
99106
- [Prerequisites](#prerequisites)

0 commit comments

Comments
 (0)