NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

LayerLabelCreated
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
NEMO_VERSION=1.21.0 if [ "${REQUIRE_AIS_CLI}" = true ]; then INSTALL_MSG=$(/bin/bash scripts/installers/install_ais_cli_latest.sh); INSTALL_CODE=$?; echo ${INSTALL_MSG}; if [ ${INSTALL_CODE} -ne 0 ]; then echo "AIS CLI installation failed"; exit ${INSTALL_CODE}; else echo "AIS CLI installed successfully"; fi else echo "Skipping AIS CLI installation"; fi
10/26/2023 10:21 PM UTC
sha256:7dde71ae6ab1822fa1804145bdf19bdb397fa39ae57c8c353871220ce7355c6dRUN
NEMO_VERSION=1.21.0 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
  chmod +x start-jupyter.sh
10/26/2023 10:21 PM UTC
sha256:ba4443e94f4caec34676fe880001c388f6994181de350b8b5fb663c6b068b4cfCOPY
tutorials /workspace/nemo/tutorials
10/26/2023 10:21 PM UTC
sha256:2d246e2360d668fc13e479699ff6f26f51ec2c6597ca31796abc1bf3d11260ffCOPY
tests /workspace/nemo/tests
10/26/2023 10:21 PM UTC
sha256:b77128f75ac3b34f7a42a9faa87ae55b1fe4726701a6d038fb978ec8db934badCOPY
examples /workspace/nemo/examples
10/26/2023 10:21 PM UTC
sha256:67d18d4cbd718e4807eeb5ba9349c391225bd769313222edb357f117e6bc2fd7COPY
scripts /workspace/nemo/scripts
10/26/2023 10:21 PM UTC
sha256:8b81479dbd4944bc5832c76cb41f64cc218e15a7048d9de0b04568c557bc1b49WORKDIR
/workspace/nemo
10/26/2023 10:21 PM UTC
sha256:6b38f974016bce2dfd339e85fcdcde7062ec66b048874d9c1f6e9a337371a5a8RUN
NEMO_VERSION=1.21.0 python -c "import nemo.collections.nlp as nemo_nlp" &&
  python -c "import nemo.collections.tts as nemo_tts" &&
  python -c "import nemo_text_processing.text_normalization as text_normalization"
10/26/2023 10:21 PM UTC
sha256:8edd2d9b60747fa1e9c608326766d7f3e02a15f9bfd009dd2a21bb4ced99c8f9RUN
NEMO_VERSION=1.21.0 cd /tmp/nemo &&
  pip install ".[all]"
10/26/2023 10:21 PM UTC
sha256:bbfb49d5ce3ac84d4de60c842ef4c3a5e66f31ab71e0c5c233b8210001d1c6fbRUN
NEMO_VERSION=1.21.0 /usr/bin/test -n "$NEMO_VERSION" &&
  /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
  /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
10/26/2023 10:20 PM UTC
...