NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
11741e5698a815e767511921875a17cf02b19e66d067b70290c0277ba24819c0	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp`	01/31/2025 8:58 AM UTC
1b4d06955e62b91a451500792cfe4e45565ff6c42da879f2d199ac3e0bf36579	ARG	`NVIDIA_BUILD_REF`	01/31/2025 8:58 AM UTC
5cd12525c4fe47b5d334e81ef96e1e1126f1450d60f026112497e4182c303898	LABEL	`com.nvidia.build.id=134983853`	01/31/2025 8:58 AM UTC
724a372d7504ce83c233cfb82f93278d02b608c103a3a37bbe37d4a4b460f690	ENV	`NVIDIA_BUILD_ID=134983853`	01/31/2025 8:58 AM UTC
5de95d817f33abf4cd1e4aa2ac36f9f3ae151abae023b9f38971440cf5f5a0d7	ARG	`NVIDIA_BUILD_ID`	01/31/2025 8:58 AM UTC
09acd93856d51cb80f6c7ba634c1c5585777546e9780f49fbda672a5360ceda7	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.8.0.24 CUDA_VER=12.8 CUDNN_VER=9.5.1.17-1 NCCL_VER= CUBLAS_VER=12.6.1.4-1 NVRTC_VER=12.6.85-1 REINSTALL_APEX=False APEX_COMMIT= MCORE_COMMIT=pyt_2501 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev LAUNCHER_COMMIT= DATA_CURATOR_COMMIT=7ab04cefff64cb8914c3c871bc6626709fd3422a INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.21.0 NEMO_COMMIT= INSTALL_FAULT_TOLERANCE=False RESIL_COMMIT=98ebc4266a6b19203086c286f38b11b4fe38f4f1 NEMO_RUN_COMMIT= PRE_COMPILE_QUANT_KERNELS=False chmod -R a+w /workspace	01/31/2025 8:58 AM UTC
ba941b344a9123caa7c234b8ef1a469899960090401217e7b79b6f7264736f3c	WORKDIR	`/workspace`	01/31/2025 8:58 AM UTC
ee7b0a22f5f2c4b0a363a3144d7c4ff05daff16e20932173b8afdbd8f29aba5e	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.8.0.24 CUDA_VER=12.8 CUDNN_VER=9.5.1.17-1 NCCL_VER= CUBLAS_VER=12.6.1.4-1 NVRTC_VER=12.6.85-1 REINSTALL_APEX=False APEX_COMMIT= MCORE_COMMIT=pyt_2501 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev LAUNCHER_COMMIT= DATA_CURATOR_COMMIT=7ab04cefff64cb8914c3c871bc6626709fd3422a INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.21.0 NEMO_COMMIT= INSTALL_FAULT_TOLERANCE=False RESIL_COMMIT=98ebc4266a6b19203086c286f38b11b4fe38f4f1 NEMO_RUN_COMMIT= PRE_COMPILE_QUANT_KERNELS=False if [ $PRE_COMPILE_QUANT_KERNELS = "True" ]; then python -c "import modelopt.torch.quantization.extensions as ext; ext.precompile()"; fi	01/31/2025 8:58 AM UTC
65efc7514934a4485b6a87cd8606826bc03dbcab96cbdbe472651aa076097c52	ARG	`PRE_COMPILE_QUANT_KERNELS=False`	01/31/2025 8:58 AM UTC
5a5357b7e82bb52e5b31410f9370986fca305075471483e4acb7d8c4afa93b26	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.8.0.24 CUDA_VER=12.8 CUDNN_VER=9.5.1.17-1 NCCL_VER= CUBLAS_VER=12.6.1.4-1 NVRTC_VER=12.6.85-1 REINSTALL_APEX=False APEX_COMMIT= MCORE_COMMIT=pyt_2501 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev LAUNCHER_COMMIT= DATA_CURATOR_COMMIT=7ab04cefff64cb8914c3c871bc6626709fd3422a INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.21.0 NEMO_COMMIT= INSTALL_FAULT_TOLERANCE=False RESIL_COMMIT=98ebc4266a6b19203086c286f38b11b4fe38f4f1 NEMO_RUN_COMMIT= sed -i '/^LayerId/s/^/#/' /usr/local/lib/python3.12/dist-packages/cv2/typing/__init__.py	01/31/2025 8:58 AM UTC