NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
17e6df029f9e5c9007a577a163001a6aa4ae06bedfa2842169395abd81a3fee9	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp`	03/21/2025 6:26 AM UTC
422aa6d501f2973d1671ace02da319daaffcd29005d92fdc83a3cecef03c531a	ARG	`NVIDIA_BUILD_REF`	03/21/2025 6:26 AM UTC
eb90812429e34215ef0f264d7bdbde0f6f2fa438ca9b4c2bd157163b2d927ba4	LABEL	`com.nvidia.build.id=134983853`	03/21/2025 6:26 AM UTC
afc7d7578f55a46db18a4d64797db4cd5fcd345b22d86eff6fc1820069416c8d	ENV	`NVIDIA_BUILD_ID=134983853`	03/21/2025 6:26 AM UTC
28c2062fb70c303d656ce4fa004f904bd6f11f446013f3d6a3bf7e0f13f3bd96	ARG	`NVIDIA_BUILD_ID`	03/21/2025 6:26 AM UTC
5a3f19cfcc61ee72d1c22f29f8f92234d3eceadb832ad1f745821ead8e3f3c02	ENV	`NEMO_FW_PIPELINE_ID=25826913`	03/21/2025 6:26 AM UTC
8a91b80dedd14f732bd46b07d0da5035b280c76bf4d2e8db706bbcf264184727	ARG	`NEMO_FW_PIPELINE_ID=25826913`	03/21/2025 6:26 AM UTC
dbd40a0e5a0eab3e1c3c425cb251ac670bea956a627d980de4fbd1e80eac89d0	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.8.0.24 CUDA_VER=12.8 CUDNN_VER=9.5.1.17-1 NCCL_VER= CUBLAS_VER=12.6.1.4-1 NVRTC_VER=12.6.85-1 TRT_LLM_COMMIT=2830e4e8099c0d7e6402494865b9cb7433f51eb5 TRT_LLM_VERSION=0.17.0 REINSTALL_NSYS=True NSYS_VERSION=2025.1.1.65 REINSTALL_APEX=False APEX_COMMIT=b216eeee7dd91478745496919e9c0167cc4c41e3 MCORE_COMMIT=f62eb5b5c2bc75cb6e0c1d7a7c0813f84b223291 MCORE_VERSION=0.11.1 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=7454c5aa56b82d120442a17e75ed8bb72101a880 ALIGNER_VERSION=0.7.0rc1.dev0 LAUNCHER_COMMIT=4abd481402adc8a061942c486eda6d71f19de718 DATA_CURATOR_COMMIT=6ce39740e0687d0d180871b96f093a2371279f7d INSTALL_DATA_CURATOR=True DATA_CURATOR_VERSION=0.7.1 INSTALL_MODELOPT=False MODELOPT_VERSION= NEMO_COMMIT=06bbda337b51f91b2e1a97db7a6b5f43635b9bc4 NEMO_VERSION=2.2.1 INSTALL_RESIL=True RESIL_COMMIT=b6eb61dbf9fe272b1a943b1b0d9efdde99df0737 RESIL_VERSION=0.2.0 NEMO_RUN_COMMIT=451f781c67698582b7ba91ac86aac0e5b5c6ae52 PRE_COMPILE_QUANT_KERNELS=False chmod -R a+w /workspace	03/21/2025 6:26 AM UTC
6a1f3a1d9d1a919ed896d7bdafc32bb87a9afcc105fcbe8a8e9ab417ecd3cfa0	WORKDIR	`/workspace`	03/21/2025 6:26 AM UTC
a003bb7bf53a2237e07551717749a294ca53792e3343300b63269585fc2cefcb	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.8.0.24 CUDA_VER=12.8 CUDNN_VER=9.5.1.17-1 NCCL_VER= CUBLAS_VER=12.6.1.4-1 NVRTC_VER=12.6.85-1 TRT_LLM_COMMIT=2830e4e8099c0d7e6402494865b9cb7433f51eb5 TRT_LLM_VERSION=0.17.0 REINSTALL_NSYS=True NSYS_VERSION=2025.1.1.65 REINSTALL_APEX=False APEX_COMMIT=b216eeee7dd91478745496919e9c0167cc4c41e3 MCORE_COMMIT=f62eb5b5c2bc75cb6e0c1d7a7c0813f84b223291 MCORE_VERSION=0.11.1 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=7454c5aa56b82d120442a17e75ed8bb72101a880 ALIGNER_VERSION=0.7.0rc1.dev0 LAUNCHER_COMMIT=4abd481402adc8a061942c486eda6d71f19de718 DATA_CURATOR_COMMIT=6ce39740e0687d0d180871b96f093a2371279f7d INSTALL_DATA_CURATOR=True DATA_CURATOR_VERSION=0.7.1 INSTALL_MODELOPT=False MODELOPT_VERSION= NEMO_COMMIT=06bbda337b51f91b2e1a97db7a6b5f43635b9bc4 NEMO_VERSION=2.2.1 INSTALL_RESIL=True RESIL_COMMIT=b6eb61dbf9fe272b1a943b1b0d9efdde99df0737 RESIL_VERSION=0.2.0 NEMO_RUN_COMMIT=451f781c67698582b7ba91ac86aac0e5b5c6ae52 PRE_COMPILE_QUANT_KERNELS=False if [ $PRE_COMPILE_QUANT_KERNELS = "True" ]; then python -c "import modelopt.torch.quantization.extensions as ext; ext.precompile()"; fi	03/21/2025 6:26 AM UTC