NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
e3be92f14b5ef5a0bcb7ad24b0cbb4dc3af0cdf1f7df6cf662f9df83b9833f49	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp`	02/22/2025 11:34 PM UTC
bc63a7274c7f5c7257786babb42d71c7cab8f22e856626699e0f5c35afbf8a79	ARG	`NVIDIA_BUILD_REF`	02/22/2025 11:34 PM UTC
507229733b62753dafaf943a3e960b239c3aa0beccc89729ba55a810e884d2ea	LABEL	`com.nvidia.build.id=134983853`	02/22/2025 11:34 PM UTC
013423b733f295fd9588e2cdfdcd146ede2cfce632db1b5aa88d4078d95f22b1	ENV	`NVIDIA_BUILD_ID=134983853`	02/22/2025 11:34 PM UTC
13b4555e556c2a2a21686f7279a8531741eecf748701ab2d52a61d9657bdfdac	ARG	`NVIDIA_BUILD_ID`	02/22/2025 11:34 PM UTC
12ffc0b4d80b252aa1c8dd445301cf330649c69530dc4cdacd152e35c20378b4	ENV	`NEMO_FW_PIPELINE_ID=24413267`	02/22/2025 11:34 PM UTC
86a8b3adca1e0d721a2fd4848c541b82e08a005383eb3bcef8fef7eec18c399f	ARG	`NEMO_FW_PIPELINE_ID=24413267`	02/22/2025 11:34 PM UTC
f75467451ca85a9ad349d7212646a47cbbe96dfbaa5cd6e81f63ebc1cbc4ab3d	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.8.0.24 CUDA_VER=12.8 CUDNN_VER=9.5.1.17-1 NCCL_VER= CUBLAS_VER=12.6.1.4-1 NVRTC_VER=12.6.85-1 TRT_LLM_COMMIT=2830e4e8099c0d7e6402494865b9cb7433f51eb5 TRT_LLM_VERSION=0.17.0 REINSTALL_APEX=False APEX_COMMIT=b216eeee7dd91478745496919e9c0167cc4c41e3 MCORE_COMMIT=59505b31eab8250a981adc96115387a1aa846159 MCORE_VERSION=0.11.0rc1 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=r0.7.0 ALIGNER_VERSION=0.7.0rc1.dev0 LAUNCHER_COMMIT=4abd481402adc8a061942c486eda6d71f19de718 DATA_CURATOR_COMMIT=r0.7.0 INSTALL_DATA_CURATOR=True DATA_CURATOR_VERSION=0.7.0rc2.dev0 INSTALL_MODELOPT=False MODELOPT_VERSION= NEMO_COMMIT=r2.2.0 NEMO_VERSION=2.2.0rc2 INSTALL_RESIL=True RESIL_COMMIT=b6eb61dbf9fe272b1a943b1b0d9efdde99df0737 RESIL_VERSION=0.2.0 NEMO_RUN_COMMIT=451f781c67698582b7ba91ac86aac0e5b5c6ae52 PRE_COMPILE_QUANT_KERNELS=False chmod -R a+w /workspace	02/22/2025 11:34 PM UTC
de17e0ba1b4d9c129857fb7f35e972b03968a53f083c49066b24d4d21f466b31	WORKDIR	`/workspace`	02/22/2025 11:34 PM UTC
3306e6a9ec75fc0c6a1406f21396b15bf4132272061100299629d9a1a3a8d56d	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.8.0.24 CUDA_VER=12.8 CUDNN_VER=9.5.1.17-1 NCCL_VER= CUBLAS_VER=12.6.1.4-1 NVRTC_VER=12.6.85-1 TRT_LLM_COMMIT=2830e4e8099c0d7e6402494865b9cb7433f51eb5 TRT_LLM_VERSION=0.17.0 REINSTALL_APEX=False APEX_COMMIT=b216eeee7dd91478745496919e9c0167cc4c41e3 MCORE_COMMIT=59505b31eab8250a981adc96115387a1aa846159 MCORE_VERSION=0.11.0rc1 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=r0.7.0 ALIGNER_VERSION=0.7.0rc1.dev0 LAUNCHER_COMMIT=4abd481402adc8a061942c486eda6d71f19de718 DATA_CURATOR_COMMIT=r0.7.0 INSTALL_DATA_CURATOR=True DATA_CURATOR_VERSION=0.7.0rc2.dev0 INSTALL_MODELOPT=False MODELOPT_VERSION= NEMO_COMMIT=r2.2.0 NEMO_VERSION=2.2.0rc2 INSTALL_RESIL=True RESIL_COMMIT=b6eb61dbf9fe272b1a943b1b0d9efdde99df0737 RESIL_VERSION=0.2.0 NEMO_RUN_COMMIT=451f781c67698582b7ba91ac86aac0e5b5c6ae52 PRE_COMPILE_QUANT_KERNELS=False if [ $PRE_COMPILE_QUANT_KERNELS = "True" ]; then python -c "import modelopt.torch.quantization.extensions as ext; ext.precompile()"; fi	02/22/2025 11:34 PM UTC