ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported
LayerLabelCreated
b2e8b66bd483d3d7a5d53436025f77190d0bf571036ee6a254b867eb01d88cedCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /opt; ExposedPorts 6006/tcp, 8888/tcp
04/16/2025 9:22 PM UTC
eb3e55eecf29351b4dae54b26a842f639772c146e35499c9c35a872427509cdaRUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.9.0.34 CUDA_VER=12.8 CUDNN_VER=9.8.0.87-1 NCCL_VER=2.25.1-1+cuda12.8 CUBLAS_VER=12.8.4.1-1 NVRTC_VER=12.8.93-1 TRT_LLM_COMMIT=fe85b725df3e769b87a8fdb63154276f87032080 TRT_LLM_VERSION=0.17.1 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 REINSTALL_APEX=False APEX_COMMIT=e13873debc4699d39c6861074b9a3b2a02327f92 MCORE_COMMIT=baf1d05e3c518f71b0d41ae42381ecbada0469ab MCORE_VERSION=0.12.0rc0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=0d72d2829d34c07cd8685348c0f37f6b6b7e5834 ALIGNER_VERSION=0.7.0 CURATOR_COMMIT=r0.8.0 INSTALL_CURATOR=True CURATOR_VERSION=0.8.0rc4.dev0 NEMO_COMMIT=101ffd44487c4a230cb5b9022ec97823ddb8f610 NEMO_VERSION=2.4.0rc0 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=False MODELOPT_VERSION= NEMO_RUN_COMMIT=r0.4.0 PRE_COMPILE_QUANT_KERNELS=True NEMO_FW_PIPELINE_ID=27072633 NVIDIA_BUILD_ID=148941828 NVIDIA_BUILD_REF= pip uninstall -y triton &&
  pip install triton==3.2
04/16/2025 9:22 PM UTC
fafb3f82be691f741f5ac81e0a8afdf3a878e220ba92f3bcc94ebd930b9561bcRUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.9.0.34 CUDA_VER=12.8 CUDNN_VER=9.8.0.87-1 NCCL_VER=2.25.1-1+cuda12.8 CUBLAS_VER=12.8.4.1-1 NVRTC_VER=12.8.93-1 TRT_LLM_COMMIT=fe85b725df3e769b87a8fdb63154276f87032080 TRT_LLM_VERSION=0.17.1 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 REINSTALL_APEX=False APEX_COMMIT=e13873debc4699d39c6861074b9a3b2a02327f92 MCORE_COMMIT=baf1d05e3c518f71b0d41ae42381ecbada0469ab MCORE_VERSION=0.12.0rc0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=0d72d2829d34c07cd8685348c0f37f6b6b7e5834 ALIGNER_VERSION=0.7.0 CURATOR_COMMIT=r0.8.0 INSTALL_CURATOR=True CURATOR_VERSION=0.8.0rc4.dev0 NEMO_COMMIT=101ffd44487c4a230cb5b9022ec97823ddb8f610 NEMO_VERSION=2.4.0rc0 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=False MODELOPT_VERSION= NEMO_RUN_COMMIT=r0.4.0 PRE_COMPILE_QUANT_KERNELS=True NEMO_FW_PIPELINE_ID=27072633 NVIDIA_BUILD_ID=148941828 NVIDIA_BUILD_REF= rm -rf mamba &&
  git clone https://github.com/state-spaces/mamba.git &&
  cd mamba &&
  MAMBA_FORCE_BUILD=TRUE pip install . --no-build-isolation
04/16/2025 9:22 PM UTC
8bf9fac272cb24d81ef375f2634f29016663bca5146c8b818b02eb9c668f0755WORKDIR
/opt
04/16/2025 9:19 PM UTC
7286106fd250a18840a930b06295acad7785d73ed4703ae083ff18c2b6eee419RUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.9.0.34 CUDA_VER=12.8 CUDNN_VER=9.8.0.87-1 NCCL_VER=2.25.1-1+cuda12.8 CUBLAS_VER=12.8.4.1-1 NVRTC_VER=12.8.93-1 TRT_LLM_COMMIT=fe85b725df3e769b87a8fdb63154276f87032080 TRT_LLM_VERSION=0.17.1 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 REINSTALL_APEX=False APEX_COMMIT=e13873debc4699d39c6861074b9a3b2a02327f92 MCORE_COMMIT=baf1d05e3c518f71b0d41ae42381ecbada0469ab MCORE_VERSION=0.12.0rc0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=0d72d2829d34c07cd8685348c0f37f6b6b7e5834 ALIGNER_VERSION=0.7.0 CURATOR_COMMIT=r0.8.0 INSTALL_CURATOR=True CURATOR_VERSION=0.8.0rc4.dev0 NEMO_COMMIT=101ffd44487c4a230cb5b9022ec97823ddb8f610 NEMO_VERSION=2.4.0rc0 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=False MODELOPT_VERSION= NEMO_RUN_COMMIT=r0.4.0 PRE_COMPILE_QUANT_KERNELS=True NEMO_FW_PIPELINE_ID=27072633 NVIDIA_BUILD_ID=148941828 NVIDIA_BUILD_REF= pip install --upgrade wandb setuptools
04/16/2025 9:19 PM UTC
bfb676a48282aabdc2936a693b16171a98182ed9562eeb36b71828e7df858e7cLABEL
com.nvidia.build.ref=
04/16/2025 9:19 PM UTC
66f813e4348d90ee4610f30adc0c28dc427dc5b48628112715869d68f40e4e5aARG
NVIDIA_BUILD_REF
04/16/2025 9:19 PM UTC
bee8ff0467eb85bc921926d78eb529df870b21b35ac203cdea2c830ff3db232bLABEL
com.nvidia.build.id=148941828
04/16/2025 9:19 PM UTC
2821f9cd053bed5f10410568b5bd2350613e97e5d9da499040229a66c33c0291ENV
NVIDIA_BUILD_ID=148941828
04/16/2025 9:19 PM UTC
a29d7fef0d49e7b158f045a3343a8b5b601e2a512600882e2e731dacaa0896e4ARG
NVIDIA_BUILD_ID
04/16/2025 9:19 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.