ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported
LayerLabelCreated
00e25f6f5958b2ecda143dfa59532708dc6eb0baf2f286e3c2c08c1e2882b6fbCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp
11/04/2025 4:02 AM UTC
0a9d877ae572ca98bc7b60908ec45182b4c3f137b0ff48abebcf25673fae4fa4ARG
NVIDIA_BUILD_REF=91fde638e2bd1e3c8f910c2d14c23f0142997dc8
11/04/2025 4:02 AM UTC
3a42138302238a7fb6be0cda0bb6a6cb56a758b5f3569be24a28d6f64cf2df3fLABEL
com.nvidia.build.id=229075953
11/04/2025 4:02 AM UTC
753d4fc8c914c8967a5d37e3001d5da306cf964ac3e96cedc2f08049f602a91bENV
NVIDIA_BUILD_ID=229075953
11/04/2025 4:02 AM UTC
042b079fa0a32eec85460545908e23be2abf5d9cc9370c83fad71022d3a8f8ffARG
NVIDIA_BUILD_ID=229075953
11/04/2025 4:02 AM UTC
3e83f6e3fba686b084f29c27d71b58337b0efe236ad7bfb085b09087a0cabe95RUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.8.22 REINSTALL_NSYS=False NSYS_VERSION=2025.4.1.172 REINSTALL_CUDNN=True CUDNN_VERSION=9.13.0.50 REINSTALL_NCCL=True NCCL_VERSION=2.27.7 INSTALL_DEEPEP=True DEEPEP_COMMIT=ef73fd9a4c098e09929e48dfd696505ddc8e2043 TARGET_ARCH=x86 MCORE_REPO=https://gitlab-master.nvidia.com/ADLR/megatron-lm.git MCORE_COMMIT=04b0b576a64de4655705662d320f7f8398afd5cf MCORE_VERSION=0.14.0rc2 NEMO_COMMIT=048f57f71daae46852c066133d49234f7db85bf0 NEMO_VERSION=2.7.0rc0 NEMO_EXPORT_DEPLOY_COMMIT=6faee4f22e769e4af7e09da9e61996c2291b1a37 NEMO_EXPORT_DEPLOY_VERSION= NEMO_EVAL_COMMIT= NEMO_EVAL_VERSION= MEGATRON_BRIDGE_COMMIT=e9ee70de082891a60272221c91ecd24a8771aa3f INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.35.1 NEMO_RUN_COMMIT=7a13daa78e215345c2e7564a43259fb11394800a SKIP_TRTLLM=False URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True chmod -R a+w /workspace
11/04/2025 4:02 AM UTC
805110de353a606aeba9e41b435fd387df23025c5833c36de265c2a32a0849b3WORKDIR
/workspace
11/04/2025 4:02 AM UTC
5209914a78594987a0494feec06bef09dab3a42fe6a6f7a6d79319d0222005d0RUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.8.22 REINSTALL_NSYS=False NSYS_VERSION=2025.4.1.172 REINSTALL_CUDNN=True CUDNN_VERSION=9.13.0.50 REINSTALL_NCCL=True NCCL_VERSION=2.27.7 INSTALL_DEEPEP=True DEEPEP_COMMIT=ef73fd9a4c098e09929e48dfd696505ddc8e2043 TARGET_ARCH=x86 MCORE_REPO=https://gitlab-master.nvidia.com/ADLR/megatron-lm.git MCORE_COMMIT=04b0b576a64de4655705662d320f7f8398afd5cf MCORE_VERSION=0.14.0rc2 NEMO_COMMIT=048f57f71daae46852c066133d49234f7db85bf0 NEMO_VERSION=2.7.0rc0 NEMO_EXPORT_DEPLOY_COMMIT=6faee4f22e769e4af7e09da9e61996c2291b1a37 NEMO_EXPORT_DEPLOY_VERSION= NEMO_EVAL_COMMIT= NEMO_EVAL_VERSION= MEGATRON_BRIDGE_COMMIT=e9ee70de082891a60272221c91ecd24a8771aa3f INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.35.1 NEMO_RUN_COMMIT=7a13daa78e215345c2e7564a43259fb11394800a SKIP_TRTLLM=False URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True if [ -f /usr/local/bin/torchrun ]; then sed -i '1s|#!/usr/bin/python|#!/usr/bin/env python|' /usr/local/bin/torchrun; fi
11/04/2025 4:02 AM UTC
1f3dfc6555ba2232e0635871a49bb1d73cba5cc40ccf2ae459a175939dd15c4dRUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.8.22 REINSTALL_NSYS=False NSYS_VERSION=2025.4.1.172 REINSTALL_CUDNN=True CUDNN_VERSION=9.13.0.50 REINSTALL_NCCL=True NCCL_VERSION=2.27.7 INSTALL_DEEPEP=True DEEPEP_COMMIT=ef73fd9a4c098e09929e48dfd696505ddc8e2043 TARGET_ARCH=x86 MCORE_REPO=https://gitlab-master.nvidia.com/ADLR/megatron-lm.git MCORE_COMMIT=04b0b576a64de4655705662d320f7f8398afd5cf MCORE_VERSION=0.14.0rc2 NEMO_COMMIT=048f57f71daae46852c066133d49234f7db85bf0 NEMO_VERSION=2.7.0rc0 NEMO_EXPORT_DEPLOY_COMMIT=6faee4f22e769e4af7e09da9e61996c2291b1a37 NEMO_EXPORT_DEPLOY_VERSION= NEMO_EVAL_COMMIT= NEMO_EVAL_VERSION= MEGATRON_BRIDGE_COMMIT=e9ee70de082891a60272221c91ecd24a8771aa3f INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.35.1 NEMO_RUN_COMMIT=7a13daa78e215345c2e7564a43259fb11394800a SKIP_TRTLLM=False URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True python -m ipykernel install --name=python3 --display-name="Python 3 (ipykernel)"
11/04/2025 4:02 AM UTC
6eb0a0c7aee141214a0487ead2769e650547207a3f756870b257a7ef45a64d83RUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.8.22 REINSTALL_NSYS=False NSYS_VERSION=2025.4.1.172 REINSTALL_CUDNN=True CUDNN_VERSION=9.13.0.50 REINSTALL_NCCL=True NCCL_VERSION=2.27.7 INSTALL_DEEPEP=True DEEPEP_COMMIT=ef73fd9a4c098e09929e48dfd696505ddc8e2043 TARGET_ARCH=x86 MCORE_REPO=https://gitlab-master.nvidia.com/ADLR/megatron-lm.git MCORE_COMMIT=04b0b576a64de4655705662d320f7f8398afd5cf MCORE_VERSION=0.14.0rc2 NEMO_COMMIT=048f57f71daae46852c066133d49234f7db85bf0 NEMO_VERSION=2.7.0rc0 NEMO_EXPORT_DEPLOY_COMMIT=6faee4f22e769e4af7e09da9e61996c2291b1a37 NEMO_EXPORT_DEPLOY_VERSION= NEMO_EVAL_COMMIT= NEMO_EVAL_VERSION= MEGATRON_BRIDGE_COMMIT=e9ee70de082891a60272221c91ecd24a8771aa3f INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.35.1 NEMO_RUN_COMMIT=7a13daa78e215345c2e7564a43259fb11394800a SKIP_TRTLLM=False URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True if [ $PRE_COMPILE_QUANT_KERNELS = "True" ]; then python -c "import modelopt.torch.quantization.extensions as ext; ext.precompile()"; fi
11/04/2025 4:02 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.