NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
aa6ff907bc5c554dcd3ed977bc3fbe4c7006f1c59087ce576c2da91ea8ecb499	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp`	02/11/2025 3:15 AM UTC
7ce499e92efb15d8b5e3db922b4a914463f7bb0456ffdbdba84647b933c3a865	ARG	`NVIDIA_BUILD_REF`	02/11/2025 3:15 AM UTC
92d1fd3656afeb142424e6a717615cc0d268484253772d0eaa441d42223c2200	LABEL	`com.nvidia.build.id=134983853`	02/11/2025 3:15 AM UTC
bbbb69a89ba09b3a3a6bf141eb2a9f297a4473264061c33562d2e59fcba74f9e	ENV	`NVIDIA_BUILD_ID=134983853`	02/11/2025 3:15 AM UTC
82b2b00f71cd64e99fcf82aad6e105af90cefab9223c0b0f97c3b588f1e8387b	ARG	`NVIDIA_BUILD_ID`	02/11/2025 3:15 AM UTC
fce06460d9760d70847462b4efc71cb5dc4d39813cc3506a5116a27de6219aba	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.8.0.24 CUDA_VER=12.8 CUDNN_VER=9.5.1.17-1 NCCL_VER= CUBLAS_VER=12.6.1.4-1 NVRTC_VER=12.6.85-1 TRT_LLM_COMMIT=2830e4e8099c0d7e6402494865b9cb7433f51eb5 REINSTALL_APEX=False APEX_COMMIT=b216eeee7dd91478745496919e9c0167cc4c41e3 MCORE_COMMIT=0dd78ddcdb117ce4f2e9761449274d87af717674 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev LAUNCHER_COMMIT=4abd481402adc8a061942c486eda6d71f19de718 DATA_CURATOR_COMMIT=2d55eaa6e8217817cf5e8f82eac0a82571621f1a INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.21.0 NEMO_COMMIT=36af8af31bc8ff117fb249161aa28fdfb3e5f423 INSTALL_RESIL=True RESIL_COMMIT=b6eb61dbf9fe272b1a943b1b0d9efdde99df0737 NEMO_RUN_COMMIT=f07f44688e42e5500bf28ff83dd3e0f4bead0c8d PRE_COMPILE_QUANT_KERNELS=False chmod -R a+w /workspace	02/11/2025 3:15 AM UTC
407646d3d95b6426c56c5dcfc2933f7ad91c5ee114b259d080e7358a98c5b090	WORKDIR	`/workspace`	02/11/2025 3:15 AM UTC
8426fe46fc121f6f5e100593fa4b5116e30dc7ae8976c284ab9607a42ecfbb01	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.8.0.24 CUDA_VER=12.8 CUDNN_VER=9.5.1.17-1 NCCL_VER= CUBLAS_VER=12.6.1.4-1 NVRTC_VER=12.6.85-1 TRT_LLM_COMMIT=2830e4e8099c0d7e6402494865b9cb7433f51eb5 REINSTALL_APEX=False APEX_COMMIT=b216eeee7dd91478745496919e9c0167cc4c41e3 MCORE_COMMIT=0dd78ddcdb117ce4f2e9761449274d87af717674 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev LAUNCHER_COMMIT=4abd481402adc8a061942c486eda6d71f19de718 DATA_CURATOR_COMMIT=2d55eaa6e8217817cf5e8f82eac0a82571621f1a INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.21.0 NEMO_COMMIT=36af8af31bc8ff117fb249161aa28fdfb3e5f423 INSTALL_RESIL=True RESIL_COMMIT=b6eb61dbf9fe272b1a943b1b0d9efdde99df0737 NEMO_RUN_COMMIT=f07f44688e42e5500bf28ff83dd3e0f4bead0c8d PRE_COMPILE_QUANT_KERNELS=False if [ $PRE_COMPILE_QUANT_KERNELS = "True" ]; then python -c "import modelopt.torch.quantization.extensions as ext; ext.precompile()"; fi	02/11/2025 3:15 AM UTC
e38b231f6c969fcee39b0934ec6cbcbf054ddd51df0d6ebe502873eb583e2804	ARG	`PRE_COMPILE_QUANT_KERNELS=False`	02/11/2025 3:15 AM UTC
1aaeb24a18f7193da5b24890c59526440482bc451d5d9c2f041ccafc8e9b18a7	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.8.0.24 CUDA_VER=12.8 CUDNN_VER=9.5.1.17-1 NCCL_VER= CUBLAS_VER=12.6.1.4-1 NVRTC_VER=12.6.85-1 TRT_LLM_COMMIT=2830e4e8099c0d7e6402494865b9cb7433f51eb5 REINSTALL_APEX=False APEX_COMMIT=b216eeee7dd91478745496919e9c0167cc4c41e3 MCORE_COMMIT=0dd78ddcdb117ce4f2e9761449274d87af717674 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev LAUNCHER_COMMIT=4abd481402adc8a061942c486eda6d71f19de718 DATA_CURATOR_COMMIT=2d55eaa6e8217817cf5e8f82eac0a82571621f1a INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.21.0 NEMO_COMMIT=36af8af31bc8ff117fb249161aa28fdfb3e5f423 INSTALL_RESIL=True RESIL_COMMIT=b6eb61dbf9fe272b1a943b1b0d9efdde99df0737 NEMO_RUN_COMMIT=f07f44688e42e5500bf28ff83dd3e0f4bead0c8d sed -i '/^LayerId/s/^/#/' /usr/local/lib/python3.12/dist-packages/cv2/typing/__init__.py	02/11/2025 3:15 AM UTC