NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
f83a1b015774e7831eecdf30d43244784c443cbcc1ea664914b7303a1a84e89a	CONFIG	`Entrypoint /usr/local/bin/nvidia_entrypoint.sh; WorkingDir /workspace/nemo; ExposedPorts 6006/tcp, 8888/tcp`	07/16/2021 11:51 PM UTC
79e2fdb0562b14ca5042ea2faa61fb28de14ac4683fe96821ef7fa4a97c8f2ba	COPY	`tutorials /workspace/nemo/tutorials`	07/16/2021 11:51 PM UTC
0660b815b1ceb27b3637e4125d158b35104f9db8c6ac0c6f402cb8eff1c998ed	COPY	`tests /workspace/nemo/tests`	07/16/2021 11:51 PM UTC
8f14196deb2bae1ca8dd448778524bdff820d9baa9f538de64d1a1ffc1e98227	COPY	`examples /workspace/nemo/examples`	07/16/2021 11:51 PM UTC
eaf03d8d2fd5d2b579387859d0d51ce6a026c72c965376798de27bedf5c8b508	COPY	`scripts /workspace/nemo/scripts`	07/16/2021 11:51 PM UTC
e57bef634634447dff79861a6e614a6d54e6c99364d20876eca09a3f81e455b0	WORKDIR	`/workspace/nemo`	07/16/2021 11:51 PM UTC
72c703be6c6dc5eaf2ceae0c5345032b44a98a9ff40c43ff09220b69063dc222	RUN	`NEMO_VERSION=1.0.2 conda update -c numba numba -y`	07/16/2021 11:51 PM UTC
c42af1860a2234e65e6915077451c009283e04030b4b1a001542df8490b6f951	RUN	`NEMO_VERSION=1.0.2 cd /tmp/nemo && pip install ".[all]" && python -c "import nemo.collections.asr as nemo_asr" && python -c "import nemo.collections.nlp as nemo_nlp" && python -c "import nemo.collections.tts as nemo_tts" && python -c "import nemo_text_processing.text_normalization as text_normalization"`	07/16/2021 11:50 PM UTC
ab6e02b36d5250b07d380ea8e31b859a36a585f1795db04566552ac243301786	RUN	`NEMO_VERSION=1.0.2 /usr/bin/test -n "$NEMO_VERSION" && /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc && /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc`	07/16/2021 11:50 PM UTC
c49833b611f5f616e597c7f047aaffe3ba81370bcc0d129d560a3fecd17f2f02	ARG	`NEMO_VERSION=1.0.2`	07/16/2021 11:50 PM UTC