NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
c90bde30fe17b4017179fe4189dbd21fe334e49df513c36c3c0b1a9168ab3840	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp`	01/28/2025 9:48 PM UTC
c5272bafc2c7b651524c8209d3802ef46ea213bd7dce788cabc8fe9967e518c9	ARG	`NVIDIA_BUILD_REF`	01/28/2025 9:48 PM UTC
d9efe19892600ca753b32bd3af526d8fe712bf757a669b2c7d387e5c2b6f3400	LABEL	`com.nvidia.build.id=114410972`	01/28/2025 9:48 PM UTC
1e9661f7f0e62172af5a5172090379c050271a3789eef0c47ecca9ab4d0198e7	ENV	`NVIDIA_BUILD_ID=114410972`	01/28/2025 9:48 PM UTC
73f7a4565e420e6ae84693931bb3d177437ba924b9a63f6ff552197ea4dc8eea	ARG	`NVIDIA_BUILD_ID`	01/28/2025 9:48 PM UTC
8f9d72d43d3e38437419124e099d745b98a7c608ccbc73e593d7d0307e930f6b	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.5.0.18 CUDA_VER=12.6 CUDNN_VER=9.5.0.50-1 NCCL_VER= CUBLAS_VER=12.6.3.3-1 NVRTC_VER=12.6.77-1 REINSTALL_APEX=False APEX_COMMIT=73375b3bbcb59a5d6ff43f2fafd00b9ecdbe0417 MCORE_COMMIT=core_r0.10.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=r0.6.0 LAUNCHER_COMMIT=5730fac6f97795931325cab0ac5dce1924cdcb3f DATA_CURATOR_COMMIT=r0.6.0 INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.19.0 NEMO_COMMIT=r2.1.1 RESIL_COMMIT=97aad77609d2e25ed38ac5c99f0c13f93c48464e NEMO_RUN_COMMIT=b4e2258f61b88c53b77996b5f9ed871ee666d85f PRE_COMPILE_QUANT_KERNELS=True chmod -R a+w /workspace	01/28/2025 9:48 PM UTC
debd4d5b90a232a786627ef7d4eef69cde0d7ca6aa5f3fae7e93c4e2c57de03f	WORKDIR	`/workspace`	01/28/2025 9:48 PM UTC
a786a5b0b57b83e6803cba665001f7481c85cf3a71a77c8058263f7656a3fa40	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.5.0.18 CUDA_VER=12.6 CUDNN_VER=9.5.0.50-1 NCCL_VER= CUBLAS_VER=12.6.3.3-1 NVRTC_VER=12.6.77-1 REINSTALL_APEX=False APEX_COMMIT=73375b3bbcb59a5d6ff43f2fafd00b9ecdbe0417 MCORE_COMMIT=core_r0.10.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=r0.6.0 LAUNCHER_COMMIT=5730fac6f97795931325cab0ac5dce1924cdcb3f DATA_CURATOR_COMMIT=r0.6.0 INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.19.0 NEMO_COMMIT=r2.1.1 RESIL_COMMIT=97aad77609d2e25ed38ac5c99f0c13f93c48464e NEMO_RUN_COMMIT=b4e2258f61b88c53b77996b5f9ed871ee666d85f PRE_COMPILE_QUANT_KERNELS=True if [ $PRE_COMPILE_QUANT_KERNELS = "True" ]; then python -c "import modelopt.torch.quantization.extensions as ext; ext.precompile()"; fi	01/28/2025 9:48 PM UTC
6557233b03d9ddf830a453aab982957ad076254ea0a38d254ddcbb4cc680c2d3	ARG	`PRE_COMPILE_QUANT_KERNELS=True`	01/28/2025 9:43 PM UTC
4731e7ce560df715fb99f14051e2e31304da6e5552b39c5aa246c7ddb5ff9f11	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.5.0.18 CUDA_VER=12.6 CUDNN_VER=9.5.0.50-1 NCCL_VER= CUBLAS_VER=12.6.3.3-1 NVRTC_VER=12.6.77-1 REINSTALL_APEX=False APEX_COMMIT=73375b3bbcb59a5d6ff43f2fafd00b9ecdbe0417 MCORE_COMMIT=core_r0.10.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=r0.6.0 LAUNCHER_COMMIT=5730fac6f97795931325cab0ac5dce1924cdcb3f DATA_CURATOR_COMMIT=r0.6.0 INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.19.0 NEMO_COMMIT=r2.1.1 RESIL_COMMIT=97aad77609d2e25ed38ac5c99f0c13f93c48464e NEMO_RUN_COMMIT=b4e2258f61b88c53b77996b5f9ed871ee666d85f sed -i '/^LayerId/s/^/#/' /usr/local/lib/python3.10/dist-packages/cv2/typing/__init__.py	01/28/2025 9:43 PM UTC