NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.nvidia.build.ref=`	05/29/2024 10:33 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NVIDIA_BUILD_REF`	05/29/2024 10:33 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.nvidia.build.id=82611821`	05/29/2024 10:33 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NVIDIA_BUILD_ID=82611821`	05/29/2024 10:33 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NVIDIA_BUILD_ID`	05/29/2024 10:33 AM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	RUN	`NEMO_COMMIT=r2.0.0rc0 chmod -R a+w /workspace`	05/29/2024 10:33 AM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	WORKDIR	`/workspace`	05/29/2024 10:33 AM UTC
sha256:c14507976096909c5cd47ddef2c56d960774d6d58d41c1cb1bbec1f809ae940b	RUN	`NEMO_COMMIT=r2.0.0rc0 pip uninstall -y causal-conv1d && pip install --no-cache-dir 'causal-conv1d==1.2.0.post2'`	05/29/2024 10:33 AM UTC
sha256:4a1ef4d3d2c93a31167897e3b0d9692ba773c6c962bb161448d2f6474de82950	RUN	`NEMO_COMMIT=r2.0.0rc0 pip uninstall -y jupyterlab aiohttp onnx && pip install --no-cache-dir jupyterlab==3.6.7 aiohttp==3.9.5 onnx==1.16.0`	05/29/2024 10:33 AM UTC
sha256:a3c50a0e46b96d9be2c381cc7ce0b766b4fd5457873e9440656013a6978afbf4	RUN	`NEMO_COMMIT=r2.0.0rc0 python -c "from transformers import CLIPImageProcessor; vit_p=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14'); vit_p_336=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14-336');"`	05/29/2024 10:32 AM UTC