NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
a3b7dd70ebcd8513f39e25767f15912c5639e54a1815e506768c053c385d2ea0	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp`	07/02/2025 3:50 AM UTC
2267a7f864421bc541412a9879f5760e7ba52d2f72b7aec719e3278b4bc838ee	ARG	`NVIDIA_BUILD_REF`	07/02/2025 3:50 AM UTC
83f9f4e3309b6c839a68acc315a707872ff736803b3fd4ff87c235f5aa3e86ec	LABEL	`com.nvidia.build.id=148941828`	07/02/2025 3:50 AM UTC
324ca4b434e993131a3c532b25bad2d15efbd88e9f924c64c375a525af8167ec	ENV	`NVIDIA_BUILD_ID=148941828`	07/02/2025 3:50 AM UTC
f1be9f42a43bd55add9ee93269e54026d25b8abef1a67322749c16bb397dc8ac	ARG	`NVIDIA_BUILD_ID`	07/02/2025 3:50 AM UTC
03077ed0597a15b7a634d556dbbc13ad69b2032d3f58b977a15293140b5c6b85	ENV	`NEMO_FW_PIPELINE_ID=30916987`	07/02/2025 3:50 AM UTC
e813d4c8ad84bc8c3d838e43b0c28254251e71b00aaaa86af2943fa8f8cd907c	ARG	`NEMO_FW_PIPELINE_ID=30916987`	07/02/2025 3:50 AM UTC
6b62ff66f28eadff19fe9e0a3ea3d226a19442add3ac471ca34960380582398f	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.9.0.34 CUDA_VER=12.8 CUDNN_VER=9.8.0.87-1 NCCL_VER=2.25.1-1+cuda12.8 CUBLAS_VER=12.8.4.1-1 NVRTC_VER=12.8.93-1 TRT_LLM_COMMIT=3c5fe5eb86077f67febc42070be11f11de17c1e2 TRT_LLM_VERSION=0.18.0 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 GDR_COPY_VERSION=v2.4.1 REINSTALL_APEX=False APEX_COMMIT=d8200a1bec8d29fe3f44d96b0a9e7b7fba850c77 MCORE_COMMIT=64cb6bd7a155c4e742514ed1024407fb97d0a367 MCORE_VERSION=0.12.2 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build INSTALL_VLLM=True ALIGNER_COMMIT=dev ALIGNER_VERSION=0.6.0rc0.dev0 LAUNCHER_COMMIT=26e42fa91d9e608897ce485b4911c263a4b57008 CURATOR_COMMIT=33db56e304a3cb2d72d2038d393474905737a3e1 INSTALL_CURATOR=True CURATOR_VERSION=0.8.0rc4.dev0 NEMO_COMMIT=229db50bb1885517dd414cc105378abb1d2576e7 NEMO_VERSION=2.3.2 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.27.1 NEMO_RUN_COMMIT=bc412ee5584ed3072717af59f54565ec0d265a6f PRE_COMPILE_QUANT_KERNELS=True chmod -R a+w /workspace	07/02/2025 3:50 AM UTC
21656a40ad15b5973e11cf83b2a508fd48d657e82671def15810c390eea796c9	WORKDIR	`/workspace`	07/02/2025 3:50 AM UTC
3f3355ef55fb07e3f36d180f1ce17b25144c8c88882cb49a0171f5dcc89352b6	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.9.0.34 CUDA_VER=12.8 CUDNN_VER=9.8.0.87-1 NCCL_VER=2.25.1-1+cuda12.8 CUBLAS_VER=12.8.4.1-1 NVRTC_VER=12.8.93-1 TRT_LLM_COMMIT=3c5fe5eb86077f67febc42070be11f11de17c1e2 TRT_LLM_VERSION=0.18.0 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 GDR_COPY_VERSION=v2.4.1 REINSTALL_APEX=False APEX_COMMIT=d8200a1bec8d29fe3f44d96b0a9e7b7fba850c77 MCORE_COMMIT=64cb6bd7a155c4e742514ed1024407fb97d0a367 MCORE_VERSION=0.12.2 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build INSTALL_VLLM=True ALIGNER_COMMIT=dev ALIGNER_VERSION=0.6.0rc0.dev0 LAUNCHER_COMMIT=26e42fa91d9e608897ce485b4911c263a4b57008 CURATOR_COMMIT=33db56e304a3cb2d72d2038d393474905737a3e1 INSTALL_CURATOR=True CURATOR_VERSION=0.8.0rc4.dev0 NEMO_COMMIT=229db50bb1885517dd414cc105378abb1d2576e7 NEMO_VERSION=2.3.2 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.27.1 NEMO_RUN_COMMIT=bc412ee5584ed3072717af59f54565ec0d265a6f PRE_COMPILE_QUANT_KERNELS=True cd /usr/local/lib/python3.12/dist-packages && patch -p1 < /opt/triton-lang_triton_6570_lazy_init.patch && rm /opt/triton-lang_triton_6570_lazy_init.patch	07/02/2025 3:50 AM UTC