NVIDIA
NVIDIA
nemo-rl
Container
NVIDIA
NVIDIA
nemo-rl

NVIDIA NeMo™ RL accelerates reinforcement learning post-training with high-performance GPU backends, offering scalable GRPO, DPO, SFT, and distillation for multimodal models from single-node experiments to enterprise-scale clusters.

LayerLabelCreated
sha256:467f5064b39dff5e0a91f651a3875ba3e06c10c7b81a8610f98ce8f6f0741ff7RUN
UV_VERSION=0.9.7 PYTHON_VERSION=3.12 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= NEMO_RL_COMMIT=6c7089300fded94abfa49bb9cbf9eb357d862461 NVIDIA_BUILD_ID=260950277 NVIDIA_BUILD_REF=9a061ffe319a603160878f54bde43b16ee4c7554 RC_DATE=25.11 TARGETARCH=arm64 echo "This distribution includes open source which is archived at the following URL: https://opensource.nvidia.com/oss/teams/nvidia/nemo-rl/${RC_DATE}:linux-${TARGETARCH}/index.html" > NOTICES.txt &&
  echo "For further inquiries or assistance, contact us at oss-requests@nvidia.com" >> NOTICES.txt
01/30/2026 6:02 PM UTC
sha256:7fc002173a070d844dbd0c0a98854fb26ef395eb1ddadca29e8b77dff371333aRUN
UV_VERSION=0.9.7 PYTHON_VERSION=3.12 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= NEMO_RL_COMMIT=6c7089300fded94abfa49bb9cbf9eb357d862461 NVIDIA_BUILD_ID=260950277 NVIDIA_BUILD_REF=9a061ffe319a603160878f54bde43b16ee4c7554 RC_DATE=25.11 TARGETARCH=arm64 python tools/generate_fingerprint.py > /opt/nemo_rl_container_fingerprint
01/30/2026 6:02 PM UTC
sha256:9c9af66dcbb615d3ae6721b5749f8a67a4df87bed930631b6700a9341452b8d9RUN
UV_VERSION=0.9.7 PYTHON_VERSION=3.12 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= NEMO_RL_COMMIT=6c7089300fded94abfa49bb9cbf9eb357d862461 NVIDIA_BUILD_ID=260950277 NVIDIA_BUILD_REF=9a061ffe319a603160878f54bde43b16ee4c7554 RC_DATE=25.11 TARGETARCH=arm64 UV_LINK_MODE=symlink uv run nemo_rl/utils/prefetch_venvs.py
01/30/2026 6:02 PM UTC
sha256:d5e96a8556f5644f2c944f0d785d308e22bf5336e1a7f525e7abe545b79516bbRUN
UV_VERSION=0.9.7 PYTHON_VERSION=3.12 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= NEMO_RL_COMMIT=6c7089300fded94abfa49bb9cbf9eb357d862461 NVIDIA_BUILD_ID=260950277 NVIDIA_BUILD_REF=9a061ffe319a603160878f54bde43b16ee4c7554 RC_DATE=25.11 TARGETARCH=arm64 git rev-parse --is-shallow-repository | grep -q true &&
  git fetch --unshallow ||
  true
01/30/2026 6:01 PM UTC
sha256:3f9831fea2461d1628107a2c3d2e7811c2765f29abb3f34577a850b52d85505fCOPY
. /opt/nemo-rl
01/30/2026 6:01 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NEMO_RL_VENV_DIR=/opt/ray_venvs
01/30/2026 6:01 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
com.nvidia.build.ref=9a061ffe319a603160878f54bde43b16ee4c7554
01/30/2026 6:01 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
com.nvidia.build.id=260950277
01/30/2026 6:01 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NVIDIA_BUILD_REF=9a061ffe319a603160878f54bde43b16ee4c7554
01/30/2026 6:01 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NVIDIA_BUILD_ID=260950277
01/30/2026 6:01 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.