NVIDIA
NVIDIA
nemo-rl
Container
NVIDIA
NVIDIA
nemo-rl

NVIDIA NeMo™ RL accelerates reinforcement learning post-training with high-performance GPU backends, offering scalable GRPO, DPO, SFT, and distillation for multimodal models from single-node experiments to enterprise-scale clusters.

LayerLabelCreated
9a7e07b2b361a288f4e6b3b127de72c190dad035c4dba507500201655d7a7638CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /opt/nemo-rl
01/30/2026 5:51 PM UTC
437c963f6cf64f39fad87150592d16108c50168e79d63d3f4e3ed0436d53283fRUN
UV_VERSION=0.9.7 PYTHON_VERSION=3.12 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= NEMO_RL_COMMIT=6c7089300fded94abfa49bb9cbf9eb357d862461 NVIDIA_BUILD_ID=260950276 NVIDIA_BUILD_REF=9a061ffe319a603160878f54bde43b16ee4c7554 RC_DATE=25.11 TARGETARCH=amd64 python tools/generate_fingerprint.py > /opt/nemo_rl_container_fingerprint
01/30/2026 5:51 PM UTC
9e2d4646a43fa8c6a434821bf974036e453c862a8aa105125a2eeb18d30d3d61RUN
UV_VERSION=0.9.7 PYTHON_VERSION=3.12 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= NEMO_RL_COMMIT=6c7089300fded94abfa49bb9cbf9eb357d862461 NVIDIA_BUILD_ID=260950276 NVIDIA_BUILD_REF=9a061ffe319a603160878f54bde43b16ee4c7554 RC_DATE=25.11 TARGETARCH=amd64 UV_LINK_MODE=symlink uv run nemo_rl/utils/prefetch_venvs.py
01/30/2026 5:51 PM UTC
345600d7b4c23f3074902028cd7012c7ccff8d8d122a914a8e85f2eb74f7969aRUN
UV_VERSION=0.9.7 PYTHON_VERSION=3.12 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= NEMO_RL_COMMIT=6c7089300fded94abfa49bb9cbf9eb357d862461 NVIDIA_BUILD_ID=260950276 NVIDIA_BUILD_REF=9a061ffe319a603160878f54bde43b16ee4c7554 RC_DATE=25.11 TARGETARCH=amd64 git rev-parse --is-shallow-repository | grep -q true &&
  git fetch --unshallow ||
  true
01/30/2026 5:51 PM UTC
4e7e5faa5eaaaa6a42cd284b01513e4bee72e6a5a8ecddc79b7b908e3d153dfaCOPY
. /opt/nemo-rl
01/30/2026 5:51 PM UTC
dc16189bcab269bcfc3d57facca57ba52c259eb8f26c5d261d6f3793ddcc0f4dENV
NEMO_RL_VENV_DIR=/opt/ray_venvs
01/30/2026 5:51 PM UTC
a46ecaa813f478781aed30a3a91f65c94bfffc89d7effe92ebe49cec10030421LABEL
com.nvidia.build.ref=9a061ffe319a603160878f54bde43b16ee4c7554
01/30/2026 5:51 PM UTC
9b23436e83c241ad98444878905c94e900506d07d48ff7319b51198cb5bf843aLABEL
com.nvidia.build.id=260950276
01/30/2026 5:51 PM UTC
08f8af4f586cd4e254de11a4e854974d4df74be8a5993ade46e9fe2f2ff2b519ENV
NVIDIA_BUILD_REF=9a061ffe319a603160878f54bde43b16ee4c7554
01/30/2026 5:51 PM UTC
bcf79994ac4663248cda7966cc9879d1677d44d4deb8438ce0c61cc34bc8c281ENV
NVIDIA_BUILD_ID=260950276
01/30/2026 5:51 PM UTC
...