NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:13ba0522776ae844a4220ff90dba8fcc7c2f636dcd42da332bcaac5d0354e11d	RUN	`NEMO_VERSION=1.8.2 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh && chmod +x start-jupyter.sh`	04/27/2022 11:21 PM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	RUN	`NEMO_VERSION=1.8.2 rm -rf /opt/conda/pkgs/conda-4.11.0-py38h578d9bd_0/info/test/tests/data/env_metadata/`	04/27/2022 11:21 PM UTC
sha256:018e1daaca939b5686da586a112bb1e8d8e372c580b2a2b5220b6bf11748d058	COPY	`tutorials /workspace/nemo/tutorials`	04/27/2022 11:21 PM UTC
sha256:6184a4179c40d796286b6f5cf22460e06d1599caf8ad2d7969cab30c03b1997c	COPY	`tests /workspace/nemo/tests`	04/27/2022 11:21 PM UTC
sha256:965053d05467fc647316fa745f4b8c740c36bc9aa17a25e7a29f79dffba7bf29	COPY	`examples /workspace/nemo/examples`	04/27/2022 11:21 PM UTC
sha256:f21f52b51e9615632c7693c8b22dcf11216c2a1896bfa213359da9c356d2724f	COPY	`scripts /workspace/nemo/scripts`	04/27/2022 11:21 PM UTC
sha256:7e89482856cf5807227a067dc8e5ba42d891bd4b26b035464cdaabbc00f679ad	WORKDIR	`/workspace/nemo`	04/27/2022 11:21 PM UTC
sha256:d69dcb5b6b3fc22e6b060d70d14d33b71413255c372652800c8903952d12067a	RUN	`NEMO_VERSION=1.8.2 cd /tmp/nemo && pip install ".[all]" && sed -i "s/_module_available(\"torchtext\")/False/g" /opt/conda/lib/python3.8/site-packages/pytorch_lightning/utilities/imports.py && python -c "import nemo.collections.asr as nemo_asr" && python -c "import nemo.collections.nlp as nemo_nlp" && python -c "import nemo.collections.tts as nemo_tts" && python -c "import nemo_text_processing.text_normalization as text_normalization"`	04/27/2022 11:21 PM UTC
sha256:ec824f362d5343fe5b9dd08da9b69f0f5db0c8eefe5aab3bf83c5be3e1d4d552	RUN	`NEMO_VERSION=1.8.2 /usr/bin/test -n "$NEMO_VERSION" && /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc && /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc`	04/27/2022 11:21 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NEMO_VERSION=1.8.2`	04/27/2022 11:21 PM UTC