NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
0c1080e2d3e2e38a463d41686c9a28a86df079d4381be862ef11f8280a1b640a	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp`	02/03/2025 7:18 AM UTC
1e17878bdcb19bab645fe88be06651b6f9ee0e1d8f54e5b9307fc53b031f5e6b	ARG	`NVIDIA_BUILD_REF`	02/03/2025 7:18 AM UTC
88b676ba3980f117e696db539915db223c3418371aec1feeb04fa131cf2cf24a	LABEL	`com.nvidia.build.id=134983853`	02/03/2025 7:18 AM UTC
73658506d34374822a6774c4b5090d163757ca23e46e7ebb3a64e71ac0e33156	ENV	`NVIDIA_BUILD_ID=134983853`	02/03/2025 7:18 AM UTC
c5cd29eb62b2f405da39793ac178743e3c50e39fb611008ab966d73414d4b70d	ARG	`NVIDIA_BUILD_ID`	02/03/2025 7:18 AM UTC
a7d8f08b29045e7f54ce0a59f2165be94cd031bd94136afe13754a9a1c9e2b47	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.8.0.24 CUDA_VER=12.8 CUDNN_VER=9.5.1.17-1 NCCL_VER= CUBLAS_VER=12.6.1.4-1 NVRTC_VER=12.6.85-1 REINSTALL_APEX=False APEX_COMMIT= MCORE_COMMIT=pyt_2501 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev LAUNCHER_COMMIT= DATA_CURATOR_COMMIT= INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.21.0 NEMO_COMMIT= INSTALL_FAULT_TOLERANCE=False RESIL_COMMIT=98ebc4266a6b19203086c286f38b11b4fe38f4f1 NEMO_RUN_COMMIT= PRE_COMPILE_QUANT_KERNELS=False chmod -R a+w /workspace	02/03/2025 7:18 AM UTC
6297ed27a6bf51307867e6126afab28f49601c6c00c0702e7691fa2e4186ea18	WORKDIR	`/workspace`	02/03/2025 7:18 AM UTC
3f9a6e30e70cf09b3d84d34adfb343381cb36fbc2a7418660c4e5054187fa6d6	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.8.0.24 CUDA_VER=12.8 CUDNN_VER=9.5.1.17-1 NCCL_VER= CUBLAS_VER=12.6.1.4-1 NVRTC_VER=12.6.85-1 REINSTALL_APEX=False APEX_COMMIT= MCORE_COMMIT=pyt_2501 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev LAUNCHER_COMMIT= DATA_CURATOR_COMMIT= INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.21.0 NEMO_COMMIT= INSTALL_FAULT_TOLERANCE=False RESIL_COMMIT=98ebc4266a6b19203086c286f38b11b4fe38f4f1 NEMO_RUN_COMMIT= PRE_COMPILE_QUANT_KERNELS=False if [ $PRE_COMPILE_QUANT_KERNELS = "True" ]; then python -c "import modelopt.torch.quantization.extensions as ext; ext.precompile()"; fi	02/03/2025 7:18 AM UTC
5571e329b07bb6ffe97b8db34856ed33749214f91ea03b99f000ab060ac9856b	ARG	`PRE_COMPILE_QUANT_KERNELS=False`	02/03/2025 7:18 AM UTC
44f8306e1242d9bfe0de29704b1b72f4afa9d9f0ef877e443852491ff15047f8	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.8.0.24 CUDA_VER=12.8 CUDNN_VER=9.5.1.17-1 NCCL_VER= CUBLAS_VER=12.6.1.4-1 NVRTC_VER=12.6.85-1 REINSTALL_APEX=False APEX_COMMIT= MCORE_COMMIT=pyt_2501 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev LAUNCHER_COMMIT= DATA_CURATOR_COMMIT= INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.21.0 NEMO_COMMIT= INSTALL_FAULT_TOLERANCE=False RESIL_COMMIT=98ebc4266a6b19203086c286f38b11b4fe38f4f1 NEMO_RUN_COMMIT= sed -i '/^LayerId/s/^/#/' /usr/local/lib/python3.12/dist-packages/cv2/typing/__init__.py	02/03/2025 7:18 AM UTC