NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	RUN	`NEMO_VERSION=1.10.0 rm -rf /opt/conda/pkgs/conda-4.11.0-py38h578d9bd_0/info/test/tests/data/env_metadata/`	07/05/2022 8:58 PM UTC
sha256:23a0c7f16b0c95ea63053168561e75929cb0bdaa66b34a34fc35dfcd69462bd2	RUN	`NEMO_VERSION=1.10.0 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh && chmod +x start-jupyter.sh`	07/05/2022 8:58 PM UTC
sha256:2e51b713a6fa1cea35d0fce1c3ed81342bd1964a80fab0cb245cfe36a73c7f25	COPY	`tutorials /workspace/nemo/tutorials`	07/05/2022 8:58 PM UTC
sha256:533a49f09bc2bd58ea9fbed8acaeb226b1779901a886dd0a5e2b967f9a52a31c	COPY	`tests /workspace/nemo/tests`	07/05/2022 8:58 PM UTC
sha256:1e2fd7f683379e7a8213dfc41cfe2a89a97abd7864f18203086e455fd8732e5b	COPY	`examples /workspace/nemo/examples`	07/05/2022 8:58 PM UTC
sha256:77ad9bd489c0427ad24915c4673737a7b226d673b81ef538c8307089c41ac1ec	COPY	`scripts /workspace/nemo/scripts`	07/05/2022 8:58 PM UTC
sha256:69cdbc5b5cc922c423ab5c0b30ea5f961a58e3c81dee867e10c1c6ba4b62ee06	WORKDIR	`/workspace/nemo`	07/05/2022 8:58 PM UTC
sha256:967149d30e24d0c8541c92f1aa9574a385603838b41bb007d42c48766e3f5029	RUN	`NEMO_VERSION=1.10.0 cd /tmp/nemo && pip install ".[all]" && sed -i "s/_module_available(\"torchtext\")/False/g" /opt/conda/lib/python3.8/site-packages/pytorch_lightning/utilities/imports.py && python -c "import nemo.collections.asr as nemo_asr" && python -c "import nemo.collections.nlp as nemo_nlp" && python -c "import nemo.collections.tts as nemo_tts" && python -c "import nemo_text_processing.text_normalization as text_normalization"`	07/05/2022 8:58 PM UTC
sha256:cc4f0ee0173ba0d0e2a0670d38917e29eb8e920b76be7b6003225a3fa40193ec	RUN	`NEMO_VERSION=1.10.0 /usr/bin/test -n "$NEMO_VERSION" && /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc && /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc`	07/05/2022 8:58 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NEMO_VERSION=1.10.0`	07/05/2022 8:58 PM UTC