NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.nvidia.build.ref=`	07/02/2025 4:00 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NVIDIA_BUILD_REF`	07/02/2025 4:00 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.nvidia.build.id=148941829`	07/02/2025 4:00 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NVIDIA_BUILD_ID=148941829`	07/02/2025 4:00 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NVIDIA_BUILD_ID`	07/02/2025 4:00 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NEMO_FW_PIPELINE_ID=30916987`	07/02/2025 4:00 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NEMO_FW_PIPELINE_ID=30916987`	07/02/2025 4:00 AM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.9.0.34 CUDA_VER=12.8 CUDNN_VER=9.8.0.87-1 NCCL_VER=2.25.1-1+cuda12.8 CUBLAS_VER=12.8.4.1-1 NVRTC_VER=12.8.93-1 TRT_LLM_COMMIT=3c5fe5eb86077f67febc42070be11f11de17c1e2 TRT_LLM_VERSION=0.18.0 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 TARGET_ARCH=arm DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 GDR_COPY_VERSION=v2.4.1 REINSTALL_APEX=False APEX_COMMIT=d8200a1bec8d29fe3f44d96b0a9e7b7fba850c77 MCORE_COMMIT=64cb6bd7a155c4e742514ed1024407fb97d0a367 MCORE_VERSION=0.12.2 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build INSTALL_VLLM=False ALIGNER_COMMIT=dev ALIGNER_VERSION=0.6.0rc0.dev0 LAUNCHER_COMMIT=26e42fa91d9e608897ce485b4911c263a4b57008 CURATOR_COMMIT=33db56e304a3cb2d72d2038d393474905737a3e1 INSTALL_CURATOR=True CURATOR_VERSION=0.8.0rc4.dev0 NEMO_COMMIT=229db50bb1885517dd414cc105378abb1d2576e7 NEMO_VERSION=2.3.2 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.27.1 NEMO_RUN_COMMIT=bc412ee5584ed3072717af59f54565ec0d265a6f PRE_COMPILE_QUANT_KERNELS=True chmod -R a+w /workspace	07/02/2025 4:00 AM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	WORKDIR	`/workspace`	07/02/2025 4:00 AM UTC
sha256:67f637ca9a7e603b989066b69ed040ce16c3b63f107d079be5c8012915826d67	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.9.0.34 CUDA_VER=12.8 CUDNN_VER=9.8.0.87-1 NCCL_VER=2.25.1-1+cuda12.8 CUBLAS_VER=12.8.4.1-1 NVRTC_VER=12.8.93-1 TRT_LLM_COMMIT=3c5fe5eb86077f67febc42070be11f11de17c1e2 TRT_LLM_VERSION=0.18.0 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 TARGET_ARCH=arm DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 GDR_COPY_VERSION=v2.4.1 REINSTALL_APEX=False APEX_COMMIT=d8200a1bec8d29fe3f44d96b0a9e7b7fba850c77 MCORE_COMMIT=64cb6bd7a155c4e742514ed1024407fb97d0a367 MCORE_VERSION=0.12.2 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build INSTALL_VLLM=False ALIGNER_COMMIT=dev ALIGNER_VERSION=0.6.0rc0.dev0 LAUNCHER_COMMIT=26e42fa91d9e608897ce485b4911c263a4b57008 CURATOR_COMMIT=33db56e304a3cb2d72d2038d393474905737a3e1 INSTALL_CURATOR=True CURATOR_VERSION=0.8.0rc4.dev0 NEMO_COMMIT=229db50bb1885517dd414cc105378abb1d2576e7 NEMO_VERSION=2.3.2 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.27.1 NEMO_RUN_COMMIT=bc412ee5584ed3072717af59f54565ec0d265a6f PRE_COMPILE_QUANT_KERNELS=True cd /usr/local/lib/python3.12/dist-packages && patch -p1 < /opt/triton-lang_triton_6570_lazy_init.patch && rm /opt/triton-lang_triton_6570_lazy_init.patch	07/02/2025 4:00 AM UTC