ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported
LayerLabelCreated
f476ea52681326ef3e5764d9ffcac0dc135cf51acdc698a23911b105a7236e7aCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp
05/22/2025 2:57 AM UTC
ddcb6bf2caa8899e254722b9ecc2dfc8faf3862fa58ff855a41cbd37c3dca43cARG
NVIDIA_BUILD_REF
05/22/2025 2:57 AM UTC
65b892384aa98c3416b884f2e061d6fe9d1f369ff1ba1c34cc3c4f0cdf6d8306LABEL
com.nvidia.build.id=148941828
05/22/2025 2:57 AM UTC
4d10c93a8a142610b1cca436c2db47f303f9d3cf64038f8c1ad43c517db625b3ENV
NVIDIA_BUILD_ID=148941828
05/22/2025 2:57 AM UTC
f076096f89c81918bc2f1b162372749551c414249949299a133f2e9074f4667dARG
NVIDIA_BUILD_ID
05/22/2025 2:57 AM UTC
977d27caae274ed2c7410547b965a94c51f927f8996432a8e79971272fc16581ENV
NEMO_FW_PIPELINE_ID=28827164
05/22/2025 2:57 AM UTC
5f9f8e510875c7285e4be860221c9bceac1df8b662cc6b2c30bffb82c785530dARG
NEMO_FW_PIPELINE_ID=28827164
05/22/2025 2:57 AM UTC
43d9f3c7b99836d5741bcacd9f42f60b34d9315e661fbe0c2a9acaa86efb710dRUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.9.0.34 CUDA_VER=12.8 CUDNN_VER=9.8.0.87-1 NCCL_VER=2.25.1-1+cuda12.8 CUBLAS_VER=12.8.4.1-1 NVRTC_VER=12.8.93-1 TRT_LLM_COMMIT=3c5fe5eb86077f67febc42070be11f11de17c1e2 TRT_LLM_VERSION=0.18.0 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 GDR_COPY_VERSION=v2.4.1 REINSTALL_APEX=False APEX_COMMIT=e74a67bba3ee679f778670e17edc21639008ae0a MCORE_COMMIT=a845aa7e12b3a117e24c2352b9e3e60bad2e3a17 MCORE_VERSION=0.12.1 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build INSTALL_VLLM=True ALIGNER_COMMIT=dev ALIGNER_VERSION=0.6.0rc0.dev0 LAUNCHER_COMMIT=26e42fa91d9e608897ce485b4911c263a4b57008 CURATOR_COMMIT=33db56e304a3cb2d72d2038d393474905737a3e1 INSTALL_CURATOR=True CURATOR_VERSION=0.8.0rc4.dev0 NEMO_COMMIT=5ac3335a3dc2a76eb96889312f79904ba2cdcf70 NEMO_VERSION=2.3.1 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.27.1 NEMO_RUN_COMMIT=bc412ee5584ed3072717af59f54565ec0d265a6f PRE_COMPILE_QUANT_KERNELS=True chmod -R a+w /workspace
05/22/2025 2:57 AM UTC
c5bed1585c873c6ad3ac7595b9aadf0c255941f0b874fac636c85196221f734fWORKDIR
/workspace
05/22/2025 2:57 AM UTC
be6288b7c63d6c5cc8eb15656c265141aabd076ba7c01352fe53b5b7a3fe39a4RUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.9.0.34 CUDA_VER=12.8 CUDNN_VER=9.8.0.87-1 NCCL_VER=2.25.1-1+cuda12.8 CUBLAS_VER=12.8.4.1-1 NVRTC_VER=12.8.93-1 TRT_LLM_COMMIT=3c5fe5eb86077f67febc42070be11f11de17c1e2 TRT_LLM_VERSION=0.18.0 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 GDR_COPY_VERSION=v2.4.1 REINSTALL_APEX=False APEX_COMMIT=e74a67bba3ee679f778670e17edc21639008ae0a MCORE_COMMIT=a845aa7e12b3a117e24c2352b9e3e60bad2e3a17 MCORE_VERSION=0.12.1 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build INSTALL_VLLM=True ALIGNER_COMMIT=dev ALIGNER_VERSION=0.6.0rc0.dev0 LAUNCHER_COMMIT=26e42fa91d9e608897ce485b4911c263a4b57008 CURATOR_COMMIT=33db56e304a3cb2d72d2038d393474905737a3e1 INSTALL_CURATOR=True CURATOR_VERSION=0.8.0rc4.dev0 NEMO_COMMIT=5ac3335a3dc2a76eb96889312f79904ba2cdcf70 NEMO_VERSION=2.3.1 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.27.1 NEMO_RUN_COMMIT=bc412ee5584ed3072717af59f54565ec0d265a6f PRE_COMPILE_QUANT_KERNELS=True cd /usr/local/lib/python3.12/dist-packages &&
  patch -p1 < /opt/triton-lang_triton_6570_lazy_init.patch &&
  rm /opt/triton-lang_triton_6570_lazy_init.patch
05/22/2025 2:57 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.