NVIDIA
NVIDIA
nemo-rl
Container
NVIDIA
NVIDIA
nemo-rl

NVIDIA NeMo™ RL accelerates reinforcement learning post-training with high-performance GPU backends, offering scalable GRPO, DPO, SFT, and distillation for multimodal models from single-node experiments to enterprise-scale clusters.

LayerLabelCreated
7a268296a5c815192677c73c611b9cd42caa184c6782cffae8a88e1f35776c82CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /opt/nemo-rl
04/28/2026 11:14 PM UTC
f77ca05fd9d5c4b7ca85988bb93ea588d75d9c5a745d716a3391056e09c9a0b1RUN
UV_VERSION=0.11.6 PYTHON_VERSION=3.13.13 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= BUILD_CUSTOM_VLLM_URL= BUILD_CUSTOM_VLLM_REF= BUILD_CUSTOM_VLLM_PRECOMPILED_WHEEL_LOCATION= BUILD_CUSTOM_FLASHINFER= BUILD_CUSTOM_FLASHINFER_URL= BUILD_CUSTOM_FLASHINFER_REF= SKIP_VLLM_BUILD= SKIP_SGLANG_BUILD= NEMO_RL_COMMIT=fbbbbd5489c55b6ffbfb90ad23d6385cf918d163 NVIDIA_BUILD_ID=307287576 NVIDIA_BUILD_REF=322ff9a002a2ff44a0551faaa58fa60fe947894d RC_DATE=v0.6.0 TARGETARCH=amd64 python tools/generate_fingerprint.py > /opt/nemo_rl_container_fingerprint
04/28/2026 11:14 PM UTC
f2407e85eba6c689a44e05c68eeed11c5f5dfbb437fffde90813280bd77f4292RUN
RUN |18 UV_VERSION=0.11.6 PYTHON_VERSION=3.13.13 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= BUILD_CUSTOM_VLLM_URL= BUILD_CUSTOM_VLLM_REF= BUILD_CUSTOM_VLLM_PRECOMPILED_WHEEL_LOCATION= BUILD_CUSTOM_FLASHINFER= BUILD_CUSTOM_FLASHINFER_URL= BUILD_CUSTOM_FLASHINFER_REF= SKIP_VLLM_BUILD= SKIP_SGLANG_BUILD= NEMO_RL_COMMIT=fbbbbd5489c55b6ffbfb90ad23d6385cf918d163 NVIDIA_BUILD_ID=307287576 NVIDIA_BUILD_REF=322ff9a002a2ff44a0551faaa58fa60fe947894d RC_DATE=v0.6.0 TARGETARCH=amd64 /bin/sh -c <<"EOF" bash -exu NEGATIVE_FILTERS="" if [[ -n "${SKIP_VLLM_BUILD:-}" ]]; then NEGATIVE_FILTERS="$NEGATIVE_FILTERS vllm" fi if [[ -n "${SKIP_SGLANG_BUILD:-}" ]]; then NEGATIVE_FILTERS="$NEGATIVE_FILTERS sglang" fi if [[ -n "$NEGATIVE_FILTERS" ]]; then UV_LINK_MODE=symlink uv run nemo_rl/utils/prefetch_venvs.py --negative-filters $NEGATIVE_FILTERS else UV_LINK_MODE=symlink uv run nemo_rl/utils/prefetch_venvs.py fi EOF # buildkit
04/28/2026 11:14 PM UTC
6229b06a5d7972602285468d5989a771b449210c2036ff3431917f07fec57900RUN
UV_VERSION=0.11.6 PYTHON_VERSION=3.13.13 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= BUILD_CUSTOM_VLLM_URL= BUILD_CUSTOM_VLLM_REF= BUILD_CUSTOM_VLLM_PRECOMPILED_WHEEL_LOCATION= BUILD_CUSTOM_FLASHINFER= BUILD_CUSTOM_FLASHINFER_URL= BUILD_CUSTOM_FLASHINFER_REF= SKIP_VLLM_BUILD= SKIP_SGLANG_BUILD= NEMO_RL_COMMIT=fbbbbd5489c55b6ffbfb90ad23d6385cf918d163 NVIDIA_BUILD_ID=307287576 NVIDIA_BUILD_REF=322ff9a002a2ff44a0551faaa58fa60fe947894d RC_DATE=v0.6.0 TARGETARCH=amd64 git rev-parse --is-shallow-repository | grep -q true &&
  git fetch --unshallow ||
  true
04/28/2026 11:13 PM UTC
35308d6f5aab74494c791243b302f9cc7756751e65414f5009c9a9959937d0cfCOPY
. /opt/nemo-rl
04/28/2026 11:13 PM UTC
98766f66759d19b14c411d7bbd9c0b331726eb356f1c93c578d89a13efe79353ENV
NEMO_RL_VENV_DIR=/opt/ray_venvs
04/28/2026 11:13 PM UTC
d81522a49ce49a2898b35f4ef1a158cf48c20c4d96e70c4e16fcaf68aa83cab8LABEL
com.nvidia.build.ref=322ff9a002a2ff44a0551faaa58fa60fe947894d
04/28/2026 11:13 PM UTC
0b6b2e3ca762d2fd95d0591bc99fa1c5aca0b5698b78abc3265dc21bb33b475aLABEL
com.nvidia.build.id=307287576
04/28/2026 11:13 PM UTC
805dba8311f0e3a31fdf49586caba1367b64e31a9be5e18c77f87f4ecb85acb3ENV
NVIDIA_BUILD_REF=322ff9a002a2ff44a0551faaa58fa60fe947894d
04/28/2026 11:13 PM UTC
34305f0140a8740a1eb567372927a6f128021bc49b877fd75284b9d05442bf2bENV
NVIDIA_BUILD_ID=307287576
04/28/2026 11:13 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.