ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported
LayerLabelCreated
38c6acd20f6f216a7d14ae41ba473e2f4d90546552212a9cdf0e359bc8cbf9b4CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp
07/18/2025 7:49 PM UTC
578a175489f8d314cbdc8c2fb38ce969eac72557eee5ff1ef1a91c86b0ebd2a8ARG
NVIDIA_BUILD_REF=5cd98ec43702e56ba0c98a5857da03f2eb99ce85
07/18/2025 7:49 PM UTC
0596a3b927e2d9fef9a77f5899b352f18cc9d546ff311d23a9f7bddcf10e125aLABEL
com.nvidia.build.id=190140144
07/18/2025 7:49 PM UTC
a61a00f6e43a0bbd84005f3e5878691f20d4fc7849624a7db5e7d57eea9043e6ENV
NVIDIA_BUILD_ID=190140144
07/18/2025 7:49 PM UTC
dba2f5eb46822316817f1aedfb2ec2819af17d76a38ce251f0a1ead002a2ec69ARG
NVIDIA_BUILD_ID=190140144
07/18/2025 7:49 PM UTC
124bc04fca95426ad9bd0bc121f78f6dae45ddb2452cd497c560fbfc57d134f7RUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.7.2 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 REINSTALL_CUDNN=True CUDNN_VERSION=9.10.1.4 REINSTALL_NCCL=True NCCL_VERSION=2.26.5 INSTALL_DEEPEP=True TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 DEEPEP_NVSHMEM_COMMIT= GDR_COPY_VERSION=v2.4.1 REINSTALL_APEX=False APEX_COMMIT=2eda0ac9ed590863dce5eb8ccaa3a6eede559460 MCORE_COMMIT=7ad1490524e2d3b0b48126f40012341bac975261 MCORE_VERSION=0.13.0rc4 NEMO_COMMIT=1f7ce26be03ba49035d1b2d77ae43be03ec9e40e NEMO_VERSION=2.4.0rc3 NEMO_EXPORT_DEPLOY_COMMIT=75e25d47c2430c600dde63d317122034d10e2995 NEMO_EXPORT_DEPLOY_VERSION= SKIP_TRTLLM=True NEMO_EVAL_COMMIT=97331474f317d84768ea551fa32b16becbeaa56f NEMO_EVAL_VERSION= NVFSDP_COMMIT=c4180101296d8bbfcd6a5f65ca28416fce89f131 NVFSDP_VERSION=0.2.0rc0 NEMO_AUTOMODEL_COMMIT=36076d22c13695c1e0268d27d45db10fc8dc3783 NEMO_AUTOMODEL_VERSION=0.2.0rc0 MEGATRON_BRIDGE_COMMIT=039b26f78695a05ac4304de72a206781788de48f MEGATRON_BRIDGE_VERSION=0.2.0rc0 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.31.0 NEMO_RUN_COMMIT=ddb1c4b4e406a11be291729e22f68c52f394b0f0 URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True chmod -R a+w /workspace
07/18/2025 7:49 PM UTC
8f78ed990a933e35c1619d70531ac23dfef816074e4520794a0f29b48a53d05eWORKDIR
/workspace
07/18/2025 7:49 PM UTC
7e6fc58811377dfc1e5016647afd3a00695960cc2b55bdb57dbd2e8715f8b900RUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.7.2 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 REINSTALL_CUDNN=True CUDNN_VERSION=9.10.1.4 REINSTALL_NCCL=True NCCL_VERSION=2.26.5 INSTALL_DEEPEP=True TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 DEEPEP_NVSHMEM_COMMIT= GDR_COPY_VERSION=v2.4.1 REINSTALL_APEX=False APEX_COMMIT=2eda0ac9ed590863dce5eb8ccaa3a6eede559460 MCORE_COMMIT=7ad1490524e2d3b0b48126f40012341bac975261 MCORE_VERSION=0.13.0rc4 NEMO_COMMIT=1f7ce26be03ba49035d1b2d77ae43be03ec9e40e NEMO_VERSION=2.4.0rc3 NEMO_EXPORT_DEPLOY_COMMIT=75e25d47c2430c600dde63d317122034d10e2995 NEMO_EXPORT_DEPLOY_VERSION= SKIP_TRTLLM=True NEMO_EVAL_COMMIT=97331474f317d84768ea551fa32b16becbeaa56f NEMO_EVAL_VERSION= NVFSDP_COMMIT=c4180101296d8bbfcd6a5f65ca28416fce89f131 NVFSDP_VERSION=0.2.0rc0 NEMO_AUTOMODEL_COMMIT=36076d22c13695c1e0268d27d45db10fc8dc3783 NEMO_AUTOMODEL_VERSION=0.2.0rc0 MEGATRON_BRIDGE_COMMIT=039b26f78695a05ac4304de72a206781788de48f MEGATRON_BRIDGE_VERSION=0.2.0rc0 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.31.0 NEMO_RUN_COMMIT=ddb1c4b4e406a11be291729e22f68c52f394b0f0 URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True cd /usr/local/lib/python3.12/dist-packages &&
  patch -p1 $(python -c "import triton; print(triton.__path__[0])")/runtime/autotuner.py /opt/triton-lang_triton_6570_lazy_init.patch &&
  rm /opt/triton-lang_triton_6570_lazy_init.patch
07/18/2025 7:49 PM UTC
8a6ed6d1cfefa20ba920f3f206076fd87209f87d57f7a3cea14828a0fbae6351COPY
nemo2/patches/triton-lang_triton_6570_lazy_init.patch /opt/
07/18/2025 7:49 PM UTC
4a24c3488e5439820df31cb522d52b8f8d64a328ff3fefd55704e9635a1340b6RUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.7.2 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 REINSTALL_CUDNN=True CUDNN_VERSION=9.10.1.4 REINSTALL_NCCL=True NCCL_VERSION=2.26.5 INSTALL_DEEPEP=True TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 DEEPEP_NVSHMEM_COMMIT= GDR_COPY_VERSION=v2.4.1 REINSTALL_APEX=False APEX_COMMIT=2eda0ac9ed590863dce5eb8ccaa3a6eede559460 MCORE_COMMIT=7ad1490524e2d3b0b48126f40012341bac975261 MCORE_VERSION=0.13.0rc4 NEMO_COMMIT=1f7ce26be03ba49035d1b2d77ae43be03ec9e40e NEMO_VERSION=2.4.0rc3 NEMO_EXPORT_DEPLOY_COMMIT=75e25d47c2430c600dde63d317122034d10e2995 NEMO_EXPORT_DEPLOY_VERSION= SKIP_TRTLLM=True NEMO_EVAL_COMMIT=97331474f317d84768ea551fa32b16becbeaa56f NEMO_EVAL_VERSION= NVFSDP_COMMIT=c4180101296d8bbfcd6a5f65ca28416fce89f131 NVFSDP_VERSION=0.2.0rc0 NEMO_AUTOMODEL_COMMIT=36076d22c13695c1e0268d27d45db10fc8dc3783 NEMO_AUTOMODEL_VERSION=0.2.0rc0 MEGATRON_BRIDGE_COMMIT=039b26f78695a05ac4304de72a206781788de48f MEGATRON_BRIDGE_VERSION=0.2.0rc0 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.31.0 NEMO_RUN_COMMIT=ddb1c4b4e406a11be291729e22f68c52f394b0f0 URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True if [ $PRE_COMPILE_QUANT_KERNELS = "True" ]; then python -c "import modelopt.torch.quantization.extensions as ext; ext.precompile()"; fi
07/18/2025 7:49 PM UTC
...