NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
a7be5a24bdc49c2d820b552af72585459bc19fc5715637bc76ea543eb275eb85	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp`	12/21/2024 7:06 PM UTC
c17bbd4d18c0117dd6ede0b89a9b5fade26b0702967fc3907c52d4af98a9f65d	ARG	`NVIDIA_BUILD_REF`	12/21/2024 7:06 PM UTC
6c1c3646b4b4b6caa05825e3bf849f82fa45097358e4fd0ecdc673cf0a348c69	LABEL	`com.nvidia.build.id=114410972`	12/21/2024 7:06 PM UTC
7ab040bf46ae8296f38b86b510e461094fc404c13ca6337fbfa52ff2d74943fe	ENV	`NVIDIA_BUILD_ID=114410972`	12/21/2024 7:06 PM UTC
326feeeae7b9674a432a7247ae372c7012ae0592ce53c4d189d76de0a2bbeefb	ARG	`NVIDIA_BUILD_ID`	12/21/2024 7:06 PM UTC
2044e72fb1094c328188f766ab0ac38f099f5da6c6b7f89342b7d23d212054fb	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.5.0.18 CUDA_VER=12.6 CUDNN_VER=9.5.0.50-1 NCCL_VER= CUBLAS_VER=12.6.3.3-1 NVRTC_VER=12.6.77-1 REINSTALL_APEX=False APEX_COMMIT=73375b3bbcb59a5d6ff43f2fafd00b9ecdbe0417 MCORE_COMMIT=core_r0.10.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=r0.6.0 LAUNCHER_COMMIT=5730fac6f97795931325cab0ac5dce1924cdcb3f DATA_CURATOR_COMMIT=r0.6.0 INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.19.0 NEMO_COMMIT=r2.1.0 RESIL_COMMIT=97aad77609d2e25ed38ac5c99f0c13f93c48464e NEMO_RUN_COMMIT=b4e2258f61b88c53b77996b5f9ed871ee666d85f PRE_COMPILE_QUANT_KERNELS=True chmod -R a+w /workspace	12/21/2024 7:06 PM UTC
40aa10c5dffea4adbcacc034e75018f457496ca27c12369d796e96f2b9cd4fd1	WORKDIR	`/workspace`	12/21/2024 7:06 PM UTC
c710cbadaf5ea3e67023de4569ee5b81bf8c5fa4c6596319ac4ae11671379cc6	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.5.0.18 CUDA_VER=12.6 CUDNN_VER=9.5.0.50-1 NCCL_VER= CUBLAS_VER=12.6.3.3-1 NVRTC_VER=12.6.77-1 REINSTALL_APEX=False APEX_COMMIT=73375b3bbcb59a5d6ff43f2fafd00b9ecdbe0417 MCORE_COMMIT=core_r0.10.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=r0.6.0 LAUNCHER_COMMIT=5730fac6f97795931325cab0ac5dce1924cdcb3f DATA_CURATOR_COMMIT=r0.6.0 INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.19.0 NEMO_COMMIT=r2.1.0 RESIL_COMMIT=97aad77609d2e25ed38ac5c99f0c13f93c48464e NEMO_RUN_COMMIT=b4e2258f61b88c53b77996b5f9ed871ee666d85f PRE_COMPILE_QUANT_KERNELS=True if [ $PRE_COMPILE_QUANT_KERNELS = "True" ]; then python -c "import modelopt.torch.quantization.extensions as ext; ext.precompile()"; fi	12/21/2024 7:06 PM UTC
5f55cfd1ea6c058665d55a0b4a241f8be08d4797991229088abf0a53c48d2be5	ARG	`PRE_COMPILE_QUANT_KERNELS=True`	12/21/2024 6:59 PM UTC
71d8dad669a6dee6ac6df9bef45c0ff5cbd496f38cf648181c9871e11e90a713	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.5.0.18 CUDA_VER=12.6 CUDNN_VER=9.5.0.50-1 NCCL_VER= CUBLAS_VER=12.6.3.3-1 NVRTC_VER=12.6.77-1 REINSTALL_APEX=False APEX_COMMIT=73375b3bbcb59a5d6ff43f2fafd00b9ecdbe0417 MCORE_COMMIT=core_r0.10.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=r0.6.0 LAUNCHER_COMMIT=5730fac6f97795931325cab0ac5dce1924cdcb3f DATA_CURATOR_COMMIT=r0.6.0 INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.19.0 NEMO_COMMIT=r2.1.0 RESIL_COMMIT=97aad77609d2e25ed38ac5c99f0c13f93c48464e NEMO_RUN_COMMIT=b4e2258f61b88c53b77996b5f9ed871ee666d85f sed -i '/^LayerId/s/^/#/' /usr/local/lib/python3.10/dist-packages/cv2/typing/__init__.py	12/21/2024 6:59 PM UTC