NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
70be688499d118b7bef5d35c406da52823f32e9b0ee87ad5af8c0e314bb0b2a5	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp`	03/31/2025 6:21 AM UTC
6b58dbc38bbe4167a79c9209c51b48838ad29e47454ded1bcf25447e4f272fb3	ARG	`NVIDIA_BUILD_REF`	03/31/2025 6:21 AM UTC
fa8e5dee05816c4f16384c79137f8b4a202adf73e0474d91efb8eb586294a785	LABEL	`com.nvidia.build.id=148941828`	03/31/2025 6:21 AM UTC
2f9817c81ca6acb3f8272a530d4f49dababc51e10304aeed895edf986b5af9a6	ENV	`NVIDIA_BUILD_ID=148941828`	03/31/2025 6:21 AM UTC
867725dd9088149d000b492bd27397816284197615c5468c1635bcf1b72d97fb	ARG	`NVIDIA_BUILD_ID`	03/31/2025 6:21 AM UTC
5bb0bb033db2a5fe65ed73604998cc5cfc94caea7d64b7a92022175104bb070d	ENV	`NEMO_FW_PIPELINE_ID=26200739`	03/31/2025 6:21 AM UTC
f04574dcb88092633c3e125e8e8cc68c3513c737103a4e99536b536df433febe	ARG	`NEMO_FW_PIPELINE_ID=26200739`	03/31/2025 6:21 AM UTC
b0f89167d7f526200e568bb17f90b9b81dfeba7c8709a15de0717850968aef73	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.9.0.34 CUDA_VER=12.8 CUDNN_VER=9.8.0.87-1 NCCL_VER=2.25.1-1+cuda12.8 CUBLAS_VER=12.8.4.1-1 NVRTC_VER=12.8.93-1 TRT_LLM_COMMIT=fe85b725df3e769b87a8fdb63154276f87032080 TRT_LLM_VERSION=0.17.1 REINSTALL_NSYS=True NSYS_VERSION=2025.1.1.65 REINSTALL_APEX=False APEX_COMMIT=c02c6c891eedfabf91f0de8127d7636d4292356d MCORE_COMMIT=dc7ab0fd4b86830ad26385c6473f8b90d70686d9 MCORE_VERSION=0.12.0rc0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev ALIGNER_VERSION=0.6.0rc0.dev0 LAUNCHER_COMMIT=9b715db12f8c78fa33cfd2414e12d1dabfa8e8ad CURATOR_COMMIT=450c264489101f4686f41aa868b800df436f2912 INSTALL_CURATOR=True CURATOR_VERSION=0.8.0rc0.dev0 NEMO_COMMIT=dc8c441fda39206601006c0d9144c262ffe18067 NEMO_VERSION=2.3.0rc0 INSTALL_RESIL=True RESIL_COMMIT=b6eb61dbf9fe272b1a943b1b0d9efdde99df0737 RESIL_VERSION=0.2.0 INSTALL_MODELOPT=False MODELOPT_VERSION= NEMO_RUN_COMMIT=595c4361dad3e8d10c49e5d39fda1394adcbe9e2 PRE_COMPILE_QUANT_KERNELS=True chmod -R a+w /workspace	03/31/2025 6:21 AM UTC
ac9048921d2a1994d9cee81b897c23de961b2477c54cc42f11b9fa85dc307419	WORKDIR	`/workspace`	03/31/2025 6:21 AM UTC
eaef27bb27eec3987059d368723b790ab1084577e48575e2289a5c726d537065	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.9.0.34 CUDA_VER=12.8 CUDNN_VER=9.8.0.87-1 NCCL_VER=2.25.1-1+cuda12.8 CUBLAS_VER=12.8.4.1-1 NVRTC_VER=12.8.93-1 TRT_LLM_COMMIT=fe85b725df3e769b87a8fdb63154276f87032080 TRT_LLM_VERSION=0.17.1 REINSTALL_NSYS=True NSYS_VERSION=2025.1.1.65 REINSTALL_APEX=False APEX_COMMIT=c02c6c891eedfabf91f0de8127d7636d4292356d MCORE_COMMIT=dc7ab0fd4b86830ad26385c6473f8b90d70686d9 MCORE_VERSION=0.12.0rc0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev ALIGNER_VERSION=0.6.0rc0.dev0 LAUNCHER_COMMIT=9b715db12f8c78fa33cfd2414e12d1dabfa8e8ad CURATOR_COMMIT=450c264489101f4686f41aa868b800df436f2912 INSTALL_CURATOR=True CURATOR_VERSION=0.8.0rc0.dev0 NEMO_COMMIT=dc8c441fda39206601006c0d9144c262ffe18067 NEMO_VERSION=2.3.0rc0 INSTALL_RESIL=True RESIL_COMMIT=b6eb61dbf9fe272b1a943b1b0d9efdde99df0737 RESIL_VERSION=0.2.0 INSTALL_MODELOPT=False MODELOPT_VERSION= NEMO_RUN_COMMIT=595c4361dad3e8d10c49e5d39fda1394adcbe9e2 PRE_COMPILE_QUANT_KERNELS=True if [ $PRE_COMPILE_QUANT_KERNELS = "True" ]; then python -c "import modelopt.torch.quantization.extensions as ext; ext.precompile()"; fi	03/31/2025 6:21 AM UTC