NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
bf6b4514a57ef05248b7a679cb05f6637116a3f12d167e1ed4d3072544fd0bd7	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp`	03/08/2025 2:39 AM UTC
986985f8d95c64e07fbbae6bbfeed7b1434bc4dead8bea1d45c7f191e880d18f	ARG	`NVIDIA_BUILD_REF`	03/08/2025 2:39 AM UTC
613860b0f1f6da407b2da286c4e442373dd5eaf31af2b8aa600723c44169f84f	LABEL	`com.nvidia.build.id=134983853`	03/08/2025 2:39 AM UTC
8e7c4fa1f683bf95a96eebfe0f6db81be94627df0d7eff7adb8962c4728fd0d3	ENV	`NVIDIA_BUILD_ID=134983853`	03/08/2025 2:39 AM UTC
866f2bc9b35f3739fc305e211c4c7629c0953bc4b6aeb65d19491c12e770f5be	ARG	`NVIDIA_BUILD_ID`	03/08/2025 2:39 AM UTC
abf2625da1abb17b7191f885f476e706f337bf8bdb8451071f18b1973fced996	ENV	`NEMO_FW_PIPELINE_ID=25090188`	03/08/2025 2:39 AM UTC
5b64bdebe5b5eb3bd803e4640a0da4a5c6b98c9e7f75bde7b0cc9c71da3a53c2	ARG	`NEMO_FW_PIPELINE_ID=25090188`	03/08/2025 2:39 AM UTC
8a9458e13773ad039557f0851d0ac406f3085e46d7c18dee9e6980926460048e	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.8.0.24 CUDA_VER=12.8 CUDNN_VER=9.5.1.17-1 NCCL_VER= CUBLAS_VER=12.6.1.4-1 NVRTC_VER=12.6.85-1 TRT_LLM_COMMIT=2830e4e8099c0d7e6402494865b9cb7433f51eb5 TRT_LLM_VERSION=0.17.0 REINSTALL_APEX=False APEX_COMMIT=b216eeee7dd91478745496919e9c0167cc4c41e3 MCORE_COMMIT=791b70e031dc6905f77e29c25f1e2ac5b8dd4870 MCORE_VERSION=0.11.0rc1 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=r0.7.0 ALIGNER_VERSION=0.7.0rc1.dev0 LAUNCHER_COMMIT=4abd481402adc8a061942c486eda6d71f19de718 DATA_CURATOR_COMMIT=r0.7.0 INSTALL_DATA_CURATOR=True DATA_CURATOR_VERSION=0.7.0rc3.dev0 INSTALL_MODELOPT=False MODELOPT_VERSION= NEMO_COMMIT=r2.2.0 NEMO_VERSION=2.2.0rc4 INSTALL_RESIL=True RESIL_COMMIT=b6eb61dbf9fe272b1a943b1b0d9efdde99df0737 RESIL_VERSION=0.2.0 NEMO_RUN_COMMIT=451f781c67698582b7ba91ac86aac0e5b5c6ae52 PRE_COMPILE_QUANT_KERNELS=False chmod -R a+w /workspace	03/08/2025 2:39 AM UTC
a8fa4b444e717d5ba01c697447357d3d8eb8b423a68696d07420e43d9f49c620	WORKDIR	`/workspace`	03/08/2025 2:39 AM UTC
6e1e1ebfdd5758a0d4c48b2096da753484aeea68a01b96ff04fec0d4098d7b2f	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.8.0.24 CUDA_VER=12.8 CUDNN_VER=9.5.1.17-1 NCCL_VER= CUBLAS_VER=12.6.1.4-1 NVRTC_VER=12.6.85-1 TRT_LLM_COMMIT=2830e4e8099c0d7e6402494865b9cb7433f51eb5 TRT_LLM_VERSION=0.17.0 REINSTALL_APEX=False APEX_COMMIT=b216eeee7dd91478745496919e9c0167cc4c41e3 MCORE_COMMIT=791b70e031dc6905f77e29c25f1e2ac5b8dd4870 MCORE_VERSION=0.11.0rc1 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=r0.7.0 ALIGNER_VERSION=0.7.0rc1.dev0 LAUNCHER_COMMIT=4abd481402adc8a061942c486eda6d71f19de718 DATA_CURATOR_COMMIT=r0.7.0 INSTALL_DATA_CURATOR=True DATA_CURATOR_VERSION=0.7.0rc3.dev0 INSTALL_MODELOPT=False MODELOPT_VERSION= NEMO_COMMIT=r2.2.0 NEMO_VERSION=2.2.0rc4 INSTALL_RESIL=True RESIL_COMMIT=b6eb61dbf9fe272b1a943b1b0d9efdde99df0737 RESIL_VERSION=0.2.0 NEMO_RUN_COMMIT=451f781c67698582b7ba91ac86aac0e5b5c6ae52 PRE_COMPILE_QUANT_KERNELS=False if [ $PRE_COMPILE_QUANT_KERNELS = "True" ]; then python -c "import modelopt.torch.quantization.extensions as ext; ext.precompile()"; fi	03/08/2025 2:39 AM UTC