NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	RUN	`NEMO_VERSION=1.22.0 if [ "${REQUIRE_AIS_CLI}" = true ]; then INSTALL_MSG=$(/bin/bash scripts/installers/install_ais_cli_latest.sh); INSTALL_CODE=$?; echo ${INSTALL_MSG}; if [ ${INSTALL_CODE} -ne 0 ]; then echo "AIS CLI installation failed"; exit ${INSTALL_CODE}; else echo "AIS CLI installed successfully"; fi else echo "Skipping AIS CLI installation"; fi`	01/10/2024 7:04 PM UTC
sha256:653f2f301dc934a9122600affbb0452aa96c2cd7fda3d2c4179a5887efdaec03	RUN	`NEMO_VERSION=1.22.0 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh && chmod +x start-jupyter.sh`	01/10/2024 7:04 PM UTC
sha256:c0dc2a184fafbb9d73c6d8b32c684a2bc06f5408f397a9ba496caaf6f92c2d3b	COPY	`tutorials /workspace/nemo/tutorials`	01/10/2024 7:04 PM UTC
sha256:556ddf63bd41e79404f0cbefe082c46319450ecb9852fd087f19bfa8f80b86f2	COPY	`tests /workspace/nemo/tests`	01/10/2024 7:04 PM UTC
sha256:508ff474239a108aede370235bab8b5f763366c36325f583ce0824a2d1e006ab	COPY	`examples /workspace/nemo/examples`	01/10/2024 7:04 PM UTC
sha256:a35298b2127bec54a2a5f8237cece63076d368646a4b1cd8bce4a7674b921d1f	COPY	`scripts /workspace/nemo/scripts`	01/10/2024 7:04 PM UTC
sha256:7946c14c78655e9a75977a6d07b91e0782bf43dccbedb75b7f39ad848b2e20d3	WORKDIR	`/workspace/nemo`	01/10/2024 7:04 PM UTC
sha256:e84caf36f419ebd869abfef2ad0b81b85e3201b89b79eba566166997970405e2	RUN	`NEMO_VERSION=1.22.0 python -c "import nemo.collections.nlp as nemo_nlp" && python -c "import nemo.collections.tts as nemo_tts" && python -c "import nemo_text_processing.text_normalization as text_normalization"`	01/10/2024 7:04 PM UTC
sha256:56428fb3c3d6e3517bdbba0dde1e0d6bd5f799f86abfa0ba80b503da7c2b7d5a	RUN	`NEMO_VERSION=1.22.0 cd /tmp/nemo && pip install ".[all]"`	01/10/2024 7:04 PM UTC
sha256:94b791aa461fefd9041650b06675a694441be8dccc50cddf70cae519ff7b4824	RUN	`NEMO_VERSION=1.22.0 /usr/bin/test -n "$NEMO_VERSION" && /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc && /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc`	01/10/2024 7:03 PM UTC