NVIDIA
NVIDIA
nemo-rl
Container
NVIDIA
NVIDIA
nemo-rl

NVIDIA NeMo™ RL accelerates reinforcement learning post-training with high-performance GPU backends, offering scalable GRPO, DPO, SFT, and distillation for multimodal models from single-node experiments to enterprise-scale clusters.

LayerLabelCreated
sha256:8d9a421eb2900087e755431cc9bb87b03d4e980b61d910d57d7ffbfe8fe3c080RUN
UV_VERSION=0.9.7 PYTHON_VERSION=3.12 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= NEMO_RL_COMMIT=c751f811217db7df0d4c94abdeaada6626cfc150 NVIDIA_BUILD_ID=235668931 NVIDIA_BUILD_REF=75c3230de6cbf76f90c39dea2eed7bf82bcf6669 RC_DATE=25.11 TARGETARCH=amd64 echo "This distribution includes open source which is archived at the following URL: https://opensource.nvidia.com/oss/teams/nvidia/nemo-rl/${RC_DATE}:linux-${TARGETARCH}/index.html" > NOTICES.txt &&
  echo "For further inquiries or assistance, contact us at oss-requests@nvidia.com" >> NOTICES.txt
11/20/2025 1:05 AM UTC
sha256:7c46c84fe3bc20425f8b6788922725dbcef6fd34eb534e2f620472c9b6a682ebRUN
UV_VERSION=0.9.7 PYTHON_VERSION=3.12 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= NEMO_RL_COMMIT=c751f811217db7df0d4c94abdeaada6626cfc150 NVIDIA_BUILD_ID=235668931 NVIDIA_BUILD_REF=75c3230de6cbf76f90c39dea2eed7bf82bcf6669 RC_DATE=25.11 TARGETARCH=amd64 UV_LINK_MODE=symlink uv run nemo_rl/utils/prefetch_venvs.py
11/20/2025 1:05 AM UTC
sha256:0cd78960583aa8082d6cdd123f16d6e0766a03caf52089293b2a4e5bb14e0a9bRUN
UV_VERSION=0.9.7 PYTHON_VERSION=3.12 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= NEMO_RL_COMMIT=c751f811217db7df0d4c94abdeaada6626cfc150 NVIDIA_BUILD_ID=235668931 NVIDIA_BUILD_REF=75c3230de6cbf76f90c39dea2eed7bf82bcf6669 RC_DATE=25.11 TARGETARCH=amd64 git rev-parse --is-shallow-repository | grep -q true &&
  git fetch --unshallow ||
  true
11/20/2025 1:04 AM UTC
sha256:e7db2c3e24f77f6f355ca34bd30e59c2645e5b716382eb5af73ea4bd4d6eb1f4COPY
. /opt/nemo-rl
11/20/2025 1:04 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NEMO_RL_VENV_DIR=/opt/ray_venvs
11/20/2025 1:04 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
com.nvidia.build.ref=75c3230de6cbf76f90c39dea2eed7bf82bcf6669
11/20/2025 1:04 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
com.nvidia.build.id=235668931
11/20/2025 1:04 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NVIDIA_BUILD_REF=75c3230de6cbf76f90c39dea2eed7bf82bcf6669
11/20/2025 1:04 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NVIDIA_BUILD_ID=235668931
11/20/2025 1:04 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NEMO_RL_COMMIT=c751f811217db7df0d4c94abdeaada6626cfc150
11/20/2025 1:04 AM UTC
...