ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported
LayerLabelCreated
597dbc704e744222c39dd29bf12c5810f3c8ce461481f2a70656f346b1575320CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp
10/20/2025 9:50 PM UTC
ed1eaafbc07bcb0f43ee7bf1fde8b2b03ed16457e9387420b9fe40788fc4380cARG
NVIDIA_BUILD_REF=f8b8fb81f8249985d7ec996ec9343741d27d4e3c
10/20/2025 9:50 PM UTC
ae0943bbf8b0d0ff8cc1ee8fa7ce454b0b5f9d66ae26534d7731e1cb6787dca3LABEL
com.nvidia.build.id=223417775
10/20/2025 9:50 PM UTC
696eb891a76d8a2881551025060c1fa806732ca3a13901285028dcd42581ded8ENV
NVIDIA_BUILD_ID=223417775
10/20/2025 9:50 PM UTC
e4c155e03619be3724f348f4eabba86035642fb6212dcdafd76cf1655be8658bARG
NVIDIA_BUILD_ID=223417775
10/20/2025 9:50 PM UTC
37771406321bf1cf0d7f9d9286ffee431641c95352f201261a72e34e9610f23cRUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.7.2 REINSTALL_NSYS=True NSYS_VERSION=2025.4.1.172 REINSTALL_CUDNN=True CUDNN_VERSION=9.10.2.21 REINSTALL_NCCL=True NCCL_VERSION=2.27.3 INSTALL_DEEPEP=True TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 DEEPEP_NVSHMEM_COMMIT= GDR_COPY_VERSION=v2.4.1 MCORE_REPO=https://github.com/NVIDIA/Megatron-LM.git MCORE_COMMIT=32ad5c89a6b6d7bb1ed75b81a4f845751d8955cc MCORE_VERSION=0.14.1 NEMO_COMMIT=f53c2cd982f63e9e1e7534a84227a47671035574 NEMO_VERSION=2.5.1 NEMO_EXPORT_DEPLOY_COMMIT=b006b37634bf33a09faa7ffd57ef8394cd47c13e NEMO_EXPORT_DEPLOY_VERSION= NEMO_EVAL_COMMIT=b6fbfc652e48ffd9ef5f0cf9fd92eb14162a90a9 NEMO_EVAL_VERSION= NEMO_AUTOMODEL_COMMIT=0b58a59870a228220b3f270d904db655f8d13793 NEMO_AUTOMODEL_VERSION=0.1.1 MEGATRON_BRIDGE_COMMIT=a2884419541f9969b6fc34517cb3e94190c13ae4 MEGATRON_BRIDGE_VERSION=0.1.0rc4 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.35.1 NEMO_RUN_COMMIT=04f900a9c1cde79ce6beca6a175b4c62b99d7982 SKIP_TRTLLM=True URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True chmod -R a+w /workspace
10/20/2025 9:50 PM UTC
ef0323ac5038d7a1c1d053e2837079788f723c588c74528ff3237963fbaa7e7bWORKDIR
/workspace
10/20/2025 9:50 PM UTC
2ec23e25daabb5a1f1f2ca06515784333e1ea122d0f21045c9025837ae82c8c3RUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.7.2 REINSTALL_NSYS=True NSYS_VERSION=2025.4.1.172 REINSTALL_CUDNN=True CUDNN_VERSION=9.10.2.21 REINSTALL_NCCL=True NCCL_VERSION=2.27.3 INSTALL_DEEPEP=True TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 DEEPEP_NVSHMEM_COMMIT= GDR_COPY_VERSION=v2.4.1 MCORE_REPO=https://github.com/NVIDIA/Megatron-LM.git MCORE_COMMIT=32ad5c89a6b6d7bb1ed75b81a4f845751d8955cc MCORE_VERSION=0.14.1 NEMO_COMMIT=f53c2cd982f63e9e1e7534a84227a47671035574 NEMO_VERSION=2.5.1 NEMO_EXPORT_DEPLOY_COMMIT=b006b37634bf33a09faa7ffd57ef8394cd47c13e NEMO_EXPORT_DEPLOY_VERSION= NEMO_EVAL_COMMIT=b6fbfc652e48ffd9ef5f0cf9fd92eb14162a90a9 NEMO_EVAL_VERSION= NEMO_AUTOMODEL_COMMIT=0b58a59870a228220b3f270d904db655f8d13793 NEMO_AUTOMODEL_VERSION=0.1.1 MEGATRON_BRIDGE_COMMIT=a2884419541f9969b6fc34517cb3e94190c13ae4 MEGATRON_BRIDGE_VERSION=0.1.0rc4 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.35.1 NEMO_RUN_COMMIT=04f900a9c1cde79ce6beca6a175b4c62b99d7982 SKIP_TRTLLM=True URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True if [ -f /usr/local/bin/torchrun ]; then sed -i '1s|#!/usr/bin/python|#!/usr/bin/env python|' /usr/local/bin/torchrun; fi
10/20/2025 9:50 PM UTC
5ff8d6e501c77b856c15ecf2c244301c4c6bc7ab56782e45f11c9ff1ea41f819RUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.7.2 REINSTALL_NSYS=True NSYS_VERSION=2025.4.1.172 REINSTALL_CUDNN=True CUDNN_VERSION=9.10.2.21 REINSTALL_NCCL=True NCCL_VERSION=2.27.3 INSTALL_DEEPEP=True TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 DEEPEP_NVSHMEM_COMMIT= GDR_COPY_VERSION=v2.4.1 MCORE_REPO=https://github.com/NVIDIA/Megatron-LM.git MCORE_COMMIT=32ad5c89a6b6d7bb1ed75b81a4f845751d8955cc MCORE_VERSION=0.14.1 NEMO_COMMIT=f53c2cd982f63e9e1e7534a84227a47671035574 NEMO_VERSION=2.5.1 NEMO_EXPORT_DEPLOY_COMMIT=b006b37634bf33a09faa7ffd57ef8394cd47c13e NEMO_EXPORT_DEPLOY_VERSION= NEMO_EVAL_COMMIT=b6fbfc652e48ffd9ef5f0cf9fd92eb14162a90a9 NEMO_EVAL_VERSION= NEMO_AUTOMODEL_COMMIT=0b58a59870a228220b3f270d904db655f8d13793 NEMO_AUTOMODEL_VERSION=0.1.1 MEGATRON_BRIDGE_COMMIT=a2884419541f9969b6fc34517cb3e94190c13ae4 MEGATRON_BRIDGE_VERSION=0.1.0rc4 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.35.1 NEMO_RUN_COMMIT=04f900a9c1cde79ce6beca6a175b4c62b99d7982 SKIP_TRTLLM=True URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True python -m ipykernel install --name=python3 --display-name="Python 3 (ipykernel)"
10/20/2025 9:50 PM UTC
83b67b6d8277fbb464306f4092889afb286485700a80448f60cc5a85695be9d2RUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.7.2 REINSTALL_NSYS=True NSYS_VERSION=2025.4.1.172 REINSTALL_CUDNN=True CUDNN_VERSION=9.10.2.21 REINSTALL_NCCL=True NCCL_VERSION=2.27.3 INSTALL_DEEPEP=True TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 DEEPEP_NVSHMEM_COMMIT= GDR_COPY_VERSION=v2.4.1 MCORE_REPO=https://github.com/NVIDIA/Megatron-LM.git MCORE_COMMIT=32ad5c89a6b6d7bb1ed75b81a4f845751d8955cc MCORE_VERSION=0.14.1 NEMO_COMMIT=f53c2cd982f63e9e1e7534a84227a47671035574 NEMO_VERSION=2.5.1 NEMO_EXPORT_DEPLOY_COMMIT=b006b37634bf33a09faa7ffd57ef8394cd47c13e NEMO_EXPORT_DEPLOY_VERSION= NEMO_EVAL_COMMIT=b6fbfc652e48ffd9ef5f0cf9fd92eb14162a90a9 NEMO_EVAL_VERSION= NEMO_AUTOMODEL_COMMIT=0b58a59870a228220b3f270d904db655f8d13793 NEMO_AUTOMODEL_VERSION=0.1.1 MEGATRON_BRIDGE_COMMIT=a2884419541f9969b6fc34517cb3e94190c13ae4 MEGATRON_BRIDGE_VERSION=0.1.0rc4 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.35.1 NEMO_RUN_COMMIT=04f900a9c1cde79ce6beca6a175b4c62b99d7982 SKIP_TRTLLM=True URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True cd /usr/local/lib/python3.12/dist-packages &&
  patch -p1 $(python -c "import triton; print(triton.__path__[0])")/runtime/autotuner.py /opt/triton-lang_triton_6570_lazy_init.patch &&
  rm /opt/triton-lang_triton_6570_lazy_init.patch
10/20/2025 9:50 PM UTC
...