NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.nvidia.build.ref=`	06/27/2024 7:25 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NVIDIA_BUILD_REF`	06/27/2024 7:25 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.nvidia.build.id=82611821`	06/27/2024 7:25 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NVIDIA_BUILD_ID=82611821`	06/27/2024 7:25 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NVIDIA_BUILD_ID`	06/27/2024 7:25 AM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	RUN	`NVIDIA_BIGNLP_VERSION= TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= APEX_COMMIT=810ffae374a2b9cb4b5c5e28eaeca7d7998fca0c TE_COMMIT=a51ff542dcb1f605aa54f9b0e1aaadb132acd53d MCORE_COMMIT=core_r0.7.0 ALIGNER_COMMIT=dev LAUNCHER_COMMIT=24.05rc DATA_CURATOR_COMMIT=e927313dbc602e2310628dec70f9f25490fedb29 NEMO_COMMIT=r2.0.0rc0 chmod -R a+w /workspace`	06/27/2024 7:25 AM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	WORKDIR	`/workspace`	06/27/2024 7:25 AM UTC
sha256:488558df44e19f1e63d33c1f6f667a1ef9d893e1da2473993c0ef81c2cdd7377	RUN	`NVIDIA_BIGNLP_VERSION= TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= APEX_COMMIT=810ffae374a2b9cb4b5c5e28eaeca7d7998fca0c TE_COMMIT=a51ff542dcb1f605aa54f9b0e1aaadb132acd53d MCORE_COMMIT=core_r0.7.0 ALIGNER_COMMIT=dev LAUNCHER_COMMIT=24.05rc DATA_CURATOR_COMMIT=e927313dbc602e2310628dec70f9f25490fedb29 NEMO_COMMIT=r2.0.0rc0 pip uninstall -y causal-conv1d && pip install --no-cache-dir 'causal-conv1d==1.2.0.post2'`	06/27/2024 7:25 AM UTC
sha256:5991902ca8ac841e4f2b45ba64076ca23f65cf49f1d7188a97efde01144d9f49	RUN	`NVIDIA_BIGNLP_VERSION= TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= APEX_COMMIT=810ffae374a2b9cb4b5c5e28eaeca7d7998fca0c TE_COMMIT=a51ff542dcb1f605aa54f9b0e1aaadb132acd53d MCORE_COMMIT=core_r0.7.0 ALIGNER_COMMIT=dev LAUNCHER_COMMIT=24.05rc DATA_CURATOR_COMMIT=e927313dbc602e2310628dec70f9f25490fedb29 NEMO_COMMIT=r2.0.0rc0 pip uninstall -y jupyterlab aiohttp onnx && pip install --no-cache-dir jupyterlab==3.6.7 aiohttp==3.9.5 onnx==1.16.0`	06/27/2024 7:24 AM UTC
sha256:eca1597c9a2deb9da635e6d5bd2479e85ef30fdf611326a968541f8d9e4fbbb1	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= APEX_COMMIT=810ffae374a2b9cb4b5c5e28eaeca7d7998fca0c TE_COMMIT=a51ff542dcb1f605aa54f9b0e1aaadb132acd53d MCORE_COMMIT=core_r0.7.0 ALIGNER_COMMIT=dev LAUNCHER_COMMIT=24.05rc DATA_CURATOR_COMMIT=e927313dbc602e2310628dec70f9f25490fedb29 NEMO_COMMIT=r2.0.0rc0 python -c "from transformers import CLIPImageProcessor; vit_p=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14'); vit_p_336=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14-336');"	06/27/2024 7:24 AM UTC