NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
f6032a8f73a95760d7281cdeff743d3beb35fac0e9c9d873ebc66c677a9f66eb	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp`	12/10/2024 3:22 AM UTC
40954b2f0c881805e16e39ddfca507b7445012f1fe9a55e3ae534b8771755e93	ARG	`NVIDIA_BUILD_REF`	12/10/2024 3:22 AM UTC
3ce63d1bc726a72e0ead4168642e9faae9fb2c29d5d5b84d91b4914dd8f2ce5a	LABEL	`com.nvidia.build.id=114410972`	12/10/2024 3:22 AM UTC
b4923f1c9041ee10dfb8facc9df31b517021e1d7b64346d9eb91cbbd4d054e0c	ENV	`NVIDIA_BUILD_ID=114410972`	12/10/2024 3:22 AM UTC
3beb99e7ffd7293b17453929f0fcbc469abaa1698c069501a1ae52c532e4a7d8	ARG	`NVIDIA_BUILD_ID`	12/10/2024 3:22 AM UTC
832ccebc34cb146e4f6b5c98561c2b66d0cdf97df7d793ab33c384bce451702b	RUN	`NVIDIA_BIGNLP_VERSION= TRT_VER=10.5.0.18 CUDA_VER=12.6 CUDNN_VER=9.5.0.50-1 NCCL_VER= CUBLAS_VER=12.6.3.3-1 NVRTC_VER=12.6.77-1 REINSTALL_APEX=False APEX_COMMIT= MCORE_COMMIT=core_r0.10.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev LAUNCHER_COMMIT= DATA_CURATOR_COMMIT= INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.19.0 NEMO_COMMIT= NEMO_RUN_COMMIT= PRE_COMPILE_QUANT_KERNELS=True chmod -R a+w /workspace`	12/10/2024 3:22 AM UTC
f9b71199147e09ea27800b17415aeed0ea5b10f6b76b86a1296e70c698b1020b	WORKDIR	`/workspace`	12/10/2024 3:22 AM UTC
77a25c752f9e7542a3f1a6febf582f5b1d71af268a91dedd66180c14ac86e6aa	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.5.0.18 CUDA_VER=12.6 CUDNN_VER=9.5.0.50-1 NCCL_VER= CUBLAS_VER=12.6.3.3-1 NVRTC_VER=12.6.77-1 REINSTALL_APEX=False APEX_COMMIT= MCORE_COMMIT=core_r0.10.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev LAUNCHER_COMMIT= DATA_CURATOR_COMMIT= INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.19.0 NEMO_COMMIT= NEMO_RUN_COMMIT= PRE_COMPILE_QUANT_KERNELS=True if [ $PRE_COMPILE_QUANT_KERNELS = "True" ]; then python -c "import modelopt.torch.quantization.extensions as ext; ext.precompile()"; fi	12/10/2024 3:22 AM UTC
2e5e528ed88b173bd48d5b1b36c354e4f2d1f0e9d0973bc3d05fa40b19feb41a	ARG	`PRE_COMPILE_QUANT_KERNELS=True`	12/10/2024 3:15 AM UTC
95785313acebad4aac5d9a556dac62216eec7d6e771106f5211abd668a4192ba	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER=10.5.0.18 CUDA_VER=12.6 CUDNN_VER=9.5.0.50-1 NCCL_VER= CUBLAS_VER=12.6.3.3-1 NVRTC_VER=12.6.77-1 REINSTALL_APEX=False APEX_COMMIT= MCORE_COMMIT=core_r0.10.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=dev LAUNCHER_COMMIT= DATA_CURATOR_COMMIT= INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.19.0 NEMO_COMMIT= NEMO_RUN_COMMIT= sed -i '/^LayerId/s/^/#/' /usr/local/lib/python3.10/dist-packages/cv2/typing/__init__.py	12/10/2024 3:15 AM UTC