NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
    NEMO_VERSION=1.19.0 if [ "${REQUIRE_AIS_CLI}" = true ]; then INSTALL_MSG=$(/bin/bash scripts/installers/install_ais_cli_latest.sh); INSTALL_CODE=$?; echo ${INSTALL_MSG}; if [ ${INSTALL_CODE} -ne 0 ]; then echo "AIS CLI installation failed"; exit ${INSTALL_CODE}; else echo "AIS CLI installed successfully"; fi else echo "Skipping AIS CLI installation"; fi
    06/19/2023 7:06 PM UTC
    sha256:b5f078e24a3d03bdb2526725f63ac7b939ffd529449e15ab9391d126a72cbd21RUN
    NEMO_VERSION=1.19.0 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
      chmod +x start-jupyter.sh
    06/19/2023 7:06 PM UTC
    sha256:52861436396bcb18d9ed18172d8ef5eafcc476e801bdec4ba3cef4c0230bec38COPY
    tutorials /workspace/nemo/tutorials
    06/19/2023 7:06 PM UTC
    sha256:afc78e299722941d2e7fd93b2bb3642008d3a93d2608f0f88b6f9503a8a4ef8dCOPY
    tests /workspace/nemo/tests
    06/19/2023 7:06 PM UTC
    sha256:1da101f21b1c716437c295de2bd22c557c5028e6cd7d4842eaf3a43639a30671COPY
    examples /workspace/nemo/examples
    06/19/2023 7:06 PM UTC
    sha256:998de6eff073656513c557ff24ac2248c14376641611244a08e2b04f15333897COPY
    scripts /workspace/nemo/scripts
    06/19/2023 7:06 PM UTC
    sha256:2cdb8fee95b773e3d0cdec0d1255d29331725e1aa332697cc9fc6939474ea1b2WORKDIR
    /workspace/nemo
    06/19/2023 7:06 PM UTC
    sha256:96b032331350dded83f361119c87a2adb1b85247795bbc1dc20dfe9115725e11RUN
    NEMO_VERSION=1.19.0 python -c "import nemo.collections.nlp as nemo_nlp" &&
      python -c "import nemo.collections.tts as nemo_tts" &&
      python -c "import nemo_text_processing.text_normalization as text_normalization"
    06/19/2023 7:06 PM UTC
    sha256:5ca1422999936a740e57b59a65afa5530735b9c1769b1091f80468e0306fbc40RUN
    NEMO_VERSION=1.19.0 cd /tmp/nemo &&
      pip install ".[all]"
    06/19/2023 7:05 PM UTC
    sha256:372ba9ae929c69a9ff2d7e746e1c7ed2a6fc2bee258c0d0777abc8778101dba4RUN
    NEMO_VERSION=1.19.0 /usr/bin/test -n "$NEMO_VERSION" &&
      /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
      /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
    06/19/2023 7:05 PM UTC
    ...