Skip to main content
ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    nemo-rl
    Container
    NVIDIA
    nemo-rl

    NVIDIA NeMo™ RL accelerates reinforcement learning post-training with high-performance GPU backends, offering scalable GRPO, DPO, SFT, and distillation for multimodal models from single-node experiments to enterprise-scale clusters.

  • LayerLabelCreated
    sha256:8d9a421eb2900087e755431cc9bb87b03d4e980b61d910d57d7ffbfe8fe3c080RUN
    UV_VERSION=0.9.7 PYTHON_VERSION=3.12 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= NEMO_RL_COMMIT=c751f811217db7df0d4c94abdeaada6626cfc150 NVIDIA_BUILD_ID=235668931 NVIDIA_BUILD_REF=75c3230de6cbf76f90c39dea2eed7bf82bcf6669 RC_DATE=25.11 TARGETARCH=amd64 echo "This distribution includes open source which is archived at the following URL: https://opensource.nvidia.com/oss/teams/nvidia/nemo-rl/${RC_DATE}:linux-${TARGETARCH}/index.html" > NOTICES.txt &&
  echo "For further inquiries or assistance, contact us at oss-requests@nvidia.com" >> NOTICES.txt
    		11/20/2025 1:05 AM UTC
    sha256:7c46c84fe3bc20425f8b6788922725dbcef6fd34eb534e2f620472c9b6a682ebRUN
    UV_VERSION=0.9.7 PYTHON_VERSION=3.12 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= NEMO_RL_COMMIT=c751f811217db7df0d4c94abdeaada6626cfc150 NVIDIA_BUILD_ID=235668931 NVIDIA_BUILD_REF=75c3230de6cbf76f90c39dea2eed7bf82bcf6669 RC_DATE=25.11 TARGETARCH=amd64 UV_LINK_MODE=symlink uv run nemo_rl/utils/prefetch_venvs.py
    		11/20/2025 1:05 AM UTC
    sha256:0cd78960583aa8082d6cdd123f16d6e0766a03caf52089293b2a4e5bb14e0a9bRUN
    UV_VERSION=0.9.7 PYTHON_VERSION=3.12 MAX_JOBS= NVTE_BUILD_THREADS_PER_JOB= BUILD_CUSTOM_VLLM= NEMO_RL_COMMIT=c751f811217db7df0d4c94abdeaada6626cfc150 NVIDIA_BUILD_ID=235668931 NVIDIA_BUILD_REF=75c3230de6cbf76f90c39dea2eed7bf82bcf6669 RC_DATE=25.11 TARGETARCH=amd64 git rev-parse --is-shallow-repository | grep -q true &&
  git fetch --unshallow ||
  true
    		11/20/2025 1:04 AM UTC
    sha256:e7db2c3e24f77f6f355ca34bd30e59c2645e5b716382eb5af73ea4bd4d6eb1f4COPY
    . /opt/nemo-rl
    		11/20/2025 1:04 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NEMO_RL_VENV_DIR=/opt/ray_venvs
    		11/20/2025 1:04 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.ref=75c3230de6cbf76f90c39dea2eed7bf82bcf6669
    		11/20/2025 1:04 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.id=235668931
    		11/20/2025 1:04 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_BUILD_REF=75c3230de6cbf76f90c39dea2eed7bf82bcf6669
    		11/20/2025 1:04 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_BUILD_ID=235668931
    		11/20/2025 1:04 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NEMO_RL_COMMIT=c751f811217db7df0d4c94abdeaada6626cfc150
    		11/20/2025 1:04 AM UTC
    ...

    Modal Content

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.

    Manage Settings