NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
3b1972460cd1804e0211d690b1e2f6176525b3ba7b7c47ccb9b07ae51e098a20	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp`	03/25/2025 4:55 PM UTC
fee882a07a3dc39109f6873258a836a489e08fa2227ac413598b1beca4b6e6c3	ARG	`NVIDIA_BUILD_REF`	03/25/2025 4:55 PM UTC
4d3db668ba9b2cbb64e6934a50068ab96e76ff578e649e0cf2999e0f0c8c6e8b	LABEL	`com.nvidia.build.id=148941828`	03/25/2025 4:55 PM UTC
3d7be5d7d331259354437a2b599559cdc079508d6e1955304ae09ec3352647ef	ENV	`NVIDIA_BUILD_ID=148941828`	03/25/2025 4:55 PM UTC
4625b05759f38b2f1f57a1ff88e67bb95478381a1a3f9077091d48adddaaf2d2	ARG	`NVIDIA_BUILD_ID`	03/25/2025 4:55 PM UTC
d982175b806eae4644c6aeeb326e0629389a474395e261a9528d43cd155d38e5	ENV	`NEMO_FW_PIPELINE_ID=26015665`	03/25/2025 4:55 PM UTC
02eeee67d8843da0ba805da75c6d980f7f64c967d2bac44836bcc8b835c9b81c	ARG	`NEMO_FW_PIPELINE_ID=26015665`	03/25/2025 4:55 PM UTC
0227837b4d5b523930ad62624246073820f18a9b65745b59def13ff50acea5df	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.9.0.34 CUDA_VER=12.8 CUDNN_VER=9.8.0.87-1 NCCL_VER=2.25.1-1+cuda12.8 CUBLAS_VER=12.8.4.1-1 NVRTC_VER=12.8.93-1 TRT_LLM_COMMIT=fe85b725df3e769b87a8fdb63154276f87032080 TRT_LLM_VERSION=0.17.1 REINSTALL_NSYS=True NSYS_VERSION=2025.1.1.65 REINSTALL_APEX=False APEX_COMMIT=8c23de079580a9266f2bc53b9c64e6a1a17667de MCORE_COMMIT=dc7ab0fd4b86830ad26385c6473f8b90d70686d9 MCORE_VERSION=0.12.0rc0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev ALIGNER_VERSION=0.6.0rc0.dev0 LAUNCHER_COMMIT=9b715db12f8c78fa33cfd2414e12d1dabfa8e8ad CURATOR_COMMIT=0f14b96999ace531285de9f73bf5221cdb6427d1 INSTALL_CURATOR=True CURATOR_VERSION=0.8.0rc0.dev0 NEMO_COMMIT=46abcaa291449150ff756ada251f21a68387fbcd NEMO_VERSION=2.3.0rc0 INSTALL_RESIL=True RESIL_COMMIT=b6eb61dbf9fe272b1a943b1b0d9efdde99df0737 RESIL_VERSION=0.2.0 INSTALL_MODELOPT=False MODELOPT_VERSION= NEMO_RUN_COMMIT=ddc130cc3f9a8dbe87a5314bf7e8e95c324f55d6 PRE_COMPILE_QUANT_KERNELS=True chmod -R a+w /workspace	03/25/2025 4:55 PM UTC
5e3942f5038557d1cf4b560c61be27d4a4962548eb6fc334fc94119dd8f06ea5	WORKDIR	`/workspace`	03/25/2025 4:55 PM UTC
a4825d467d5695ba56d15baf8235353248f5f0419d282840eaa8e0b012ee1220	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.9.0.34 CUDA_VER=12.8 CUDNN_VER=9.8.0.87-1 NCCL_VER=2.25.1-1+cuda12.8 CUBLAS_VER=12.8.4.1-1 NVRTC_VER=12.8.93-1 TRT_LLM_COMMIT=fe85b725df3e769b87a8fdb63154276f87032080 TRT_LLM_VERSION=0.17.1 REINSTALL_NSYS=True NSYS_VERSION=2025.1.1.65 REINSTALL_APEX=False APEX_COMMIT=8c23de079580a9266f2bc53b9c64e6a1a17667de MCORE_COMMIT=dc7ab0fd4b86830ad26385c6473f8b90d70686d9 MCORE_VERSION=0.12.0rc0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev ALIGNER_VERSION=0.6.0rc0.dev0 LAUNCHER_COMMIT=9b715db12f8c78fa33cfd2414e12d1dabfa8e8ad CURATOR_COMMIT=0f14b96999ace531285de9f73bf5221cdb6427d1 INSTALL_CURATOR=True CURATOR_VERSION=0.8.0rc0.dev0 NEMO_COMMIT=46abcaa291449150ff756ada251f21a68387fbcd NEMO_VERSION=2.3.0rc0 INSTALL_RESIL=True RESIL_COMMIT=b6eb61dbf9fe272b1a943b1b0d9efdde99df0737 RESIL_VERSION=0.2.0 INSTALL_MODELOPT=False MODELOPT_VERSION= NEMO_RUN_COMMIT=ddc130cc3f9a8dbe87a5314bf7e8e95c324f55d6 PRE_COMPILE_QUANT_KERNELS=True if [ $PRE_COMPILE_QUANT_KERNELS = "True" ]; then python -c "import modelopt.torch.quantization.extensions as ext; ext.precompile()"; fi	03/25/2025 4:55 PM UTC