ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported
LayerLabelCreated
51ab67c11de49600b331db1f28a2b1e492b84535d8b0fc8e75cfb677eabb352dCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp
11/22/2025 2:51 AM UTC
6beb3738356071f200ddcd073a369b24757c2bf79b6aa3930d09762d991c9299ARG
NVIDIA_BUILD_REF=cc74c4a0337b29a223359606e6ebbefbe2791136
11/22/2025 2:51 AM UTC
10df7e70ff09a93af3dea837d8d3972008d40ad19bc86b41e5ac6dc1dd914d34LABEL
com.nvidia.build.id=236656226
11/22/2025 2:51 AM UTC
cff3173c88622c206f361bbfedca2562737e668a6824d91f5c54df9281763fedENV
NVIDIA_BUILD_ID=236656226
11/22/2025 2:51 AM UTC
111a453e9dd75b46dcf844a026400198e4a196ab611ce263ef4031afad911ee6ARG
NVIDIA_BUILD_ID=236656226
11/22/2025 2:51 AM UTC
6bc3a39a19977f5873311a1883460d92bb6608893f771f0624731e74fa7db870RUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.7.2 REINSTALL_NSYS=True NSYS_VERSION=2025.4.1.172 REINSTALL_CUDNN=True CUDNN_VERSION=9.10.2.21 REINSTALL_NCCL=True NCCL_VERSION=2.27.3 INSTALL_DEEPEP=True TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 DEEPEP_NVSHMEM_COMMIT= GDR_COPY_VERSION=v2.4.1 MCORE_REPO=https://github.com/NVIDIA/Megatron-LM.git MCORE_COMMIT=32ad5c89a6b6d7bb1ed75b81a4f845751d8955cc MCORE_VERSION=0.14.1 NEMO_COMMIT=b366d85e6619092257e7f3063e3838cdea34c054 NEMO_VERSION=2.5.3 NEMO_EXPORT_DEPLOY_COMMIT=b006b37634bf33a09faa7ffd57ef8394cd47c13e NEMO_EXPORT_DEPLOY_VERSION= NEMO_EVAL_COMMIT=b6fbfc652e48ffd9ef5f0cf9fd92eb14162a90a9 NEMO_EVAL_VERSION= NEMO_AUTOMODEL_COMMIT=0b58a59870a228220b3f270d904db655f8d13793 NEMO_AUTOMODEL_VERSION=0.1.1 MEGATRON_BRIDGE_COMMIT=a2884419541f9969b6fc34517cb3e94190c13ae4 MEGATRON_BRIDGE_VERSION=0.1.0rc4 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.35.1 NEMO_RUN_COMMIT=04f900a9c1cde79ce6beca6a175b4c62b99d7982 SKIP_TRTLLM=True URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True chmod -R a+w /workspace
11/22/2025 2:51 AM UTC
2b6feb4dd1f36274e49116f948533db6c583fc940114253125e9c7725d6555feWORKDIR
/workspace
11/22/2025 2:51 AM UTC
8d185a6ccb0afe08666aedb4c4230809bbccd43e5c50bf68fe8044af5d4b65b6RUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.7.2 REINSTALL_NSYS=True NSYS_VERSION=2025.4.1.172 REINSTALL_CUDNN=True CUDNN_VERSION=9.10.2.21 REINSTALL_NCCL=True NCCL_VERSION=2.27.3 INSTALL_DEEPEP=True TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 DEEPEP_NVSHMEM_COMMIT= GDR_COPY_VERSION=v2.4.1 MCORE_REPO=https://github.com/NVIDIA/Megatron-LM.git MCORE_COMMIT=32ad5c89a6b6d7bb1ed75b81a4f845751d8955cc MCORE_VERSION=0.14.1 NEMO_COMMIT=b366d85e6619092257e7f3063e3838cdea34c054 NEMO_VERSION=2.5.3 NEMO_EXPORT_DEPLOY_COMMIT=b006b37634bf33a09faa7ffd57ef8394cd47c13e NEMO_EXPORT_DEPLOY_VERSION= NEMO_EVAL_COMMIT=b6fbfc652e48ffd9ef5f0cf9fd92eb14162a90a9 NEMO_EVAL_VERSION= NEMO_AUTOMODEL_COMMIT=0b58a59870a228220b3f270d904db655f8d13793 NEMO_AUTOMODEL_VERSION=0.1.1 MEGATRON_BRIDGE_COMMIT=a2884419541f9969b6fc34517cb3e94190c13ae4 MEGATRON_BRIDGE_VERSION=0.1.0rc4 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.35.1 NEMO_RUN_COMMIT=04f900a9c1cde79ce6beca6a175b4c62b99d7982 SKIP_TRTLLM=True URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True if [ -f /usr/local/bin/torchrun ]; then sed -i '1s|#!/usr/bin/python|#!/usr/bin/env python|' /usr/local/bin/torchrun; fi
11/22/2025 2:51 AM UTC
eaa0d005150c9d7cde5839aa21bd3b407a8ce06c3e121e067d8beb0eeb7c3d7cRUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.7.2 REINSTALL_NSYS=True NSYS_VERSION=2025.4.1.172 REINSTALL_CUDNN=True CUDNN_VERSION=9.10.2.21 REINSTALL_NCCL=True NCCL_VERSION=2.27.3 INSTALL_DEEPEP=True TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 DEEPEP_NVSHMEM_COMMIT= GDR_COPY_VERSION=v2.4.1 MCORE_REPO=https://github.com/NVIDIA/Megatron-LM.git MCORE_COMMIT=32ad5c89a6b6d7bb1ed75b81a4f845751d8955cc MCORE_VERSION=0.14.1 NEMO_COMMIT=b366d85e6619092257e7f3063e3838cdea34c054 NEMO_VERSION=2.5.3 NEMO_EXPORT_DEPLOY_COMMIT=b006b37634bf33a09faa7ffd57ef8394cd47c13e NEMO_EXPORT_DEPLOY_VERSION= NEMO_EVAL_COMMIT=b6fbfc652e48ffd9ef5f0cf9fd92eb14162a90a9 NEMO_EVAL_VERSION= NEMO_AUTOMODEL_COMMIT=0b58a59870a228220b3f270d904db655f8d13793 NEMO_AUTOMODEL_VERSION=0.1.1 MEGATRON_BRIDGE_COMMIT=a2884419541f9969b6fc34517cb3e94190c13ae4 MEGATRON_BRIDGE_VERSION=0.1.0rc4 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.35.1 NEMO_RUN_COMMIT=04f900a9c1cde79ce6beca6a175b4c62b99d7982 SKIP_TRTLLM=True URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True python -m ipykernel install --name=python3 --display-name="Python 3 (ipykernel)"
11/22/2025 2:51 AM UTC
555893838254173d30427c19916d1ae7bf0d434254ba9458a8e73b228f7ce92cRUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.7.2 REINSTALL_NSYS=True NSYS_VERSION=2025.4.1.172 REINSTALL_CUDNN=True CUDNN_VERSION=9.10.2.21 REINSTALL_NCCL=True NCCL_VERSION=2.27.3 INSTALL_DEEPEP=True TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 DEEPEP_NVSHMEM_COMMIT= GDR_COPY_VERSION=v2.4.1 MCORE_REPO=https://github.com/NVIDIA/Megatron-LM.git MCORE_COMMIT=32ad5c89a6b6d7bb1ed75b81a4f845751d8955cc MCORE_VERSION=0.14.1 NEMO_COMMIT=b366d85e6619092257e7f3063e3838cdea34c054 NEMO_VERSION=2.5.3 NEMO_EXPORT_DEPLOY_COMMIT=b006b37634bf33a09faa7ffd57ef8394cd47c13e NEMO_EXPORT_DEPLOY_VERSION= NEMO_EVAL_COMMIT=b6fbfc652e48ffd9ef5f0cf9fd92eb14162a90a9 NEMO_EVAL_VERSION= NEMO_AUTOMODEL_COMMIT=0b58a59870a228220b3f270d904db655f8d13793 NEMO_AUTOMODEL_VERSION=0.1.1 MEGATRON_BRIDGE_COMMIT=a2884419541f9969b6fc34517cb3e94190c13ae4 MEGATRON_BRIDGE_VERSION=0.1.0rc4 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.35.1 NEMO_RUN_COMMIT=04f900a9c1cde79ce6beca6a175b4c62b99d7982 SKIP_TRTLLM=True URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True cd /usr/local/lib/python3.12/dist-packages &&
  patch -p1 $(python -c "import triton; print(triton.__path__[0])")/runtime/autotuner.py /opt/triton-lang_triton_6570_lazy_init.patch &&
  rm /opt/triton-lang_triton_6570_lazy_init.patch
11/22/2025 2:51 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.