NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
    NEMO_VERSION=1.13.0 rm -rf /opt/conda/pkgs/conda-4.11.0-py38h578d9bd_0/info/test/tests/data/env_metadata
    12/09/2022 6:38 AM UTC
    sha256:76b387a28783aee4a5e37e52b2673d657c18c4d26790087887cbc45e8c91a58eRUN
    NEMO_VERSION=1.13.0 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
      chmod +x start-jupyter.sh
    12/09/2022 6:38 AM UTC
    sha256:07865c5ca047ad73c93c103f1fefa3d03d04dabc51f01fe6e06194c9606f99f6COPY
    tutorials /workspace/nemo/tutorials
    12/09/2022 6:38 AM UTC
    sha256:aa2552847cfc88607b62ffe1e5c271ef9b9d0165a9145ffad5fe5a219e83d8a6COPY
    tests /workspace/nemo/tests
    12/09/2022 6:38 AM UTC
    sha256:56ca67a38dd241845f29d51a4c06fa1cc0ec7760d98a4630c510c62dcbb059f0COPY
    examples /workspace/nemo/examples
    12/09/2022 6:38 AM UTC
    sha256:1d313caea3d189f1203b9ef2969f2ac7e0be04e81787739b9d5b961e09a008deCOPY
    scripts /workspace/nemo/scripts
    12/09/2022 6:38 AM UTC
    sha256:5ca83f52c2a054b547847d86e821233cef972c8797f531b6b86a888fa6fa27e8WORKDIR
    /workspace/nemo
    12/09/2022 6:38 AM UTC
    sha256:bb62dde773d6463d2b81df4d16b6f7a813e303149b52ca690a5347b0d6471757RUN
    NEMO_VERSION=1.13.0 cd /tmp/nemo &&
      pip install ".[all]" &&
      sed -i "s/_module_available(\"torchtext\")/False/g" /opt/conda/lib/python3.8/site-packages/pytorch_lightning/utilities/imports.py &&
      python -c "import nemo.collections.asr as nemo_asr" &&
      python -c "import nemo.collections.nlp as nemo_nlp" &&
      python -c "import nemo.collections.tts as nemo_tts" &&
      python -c "import nemo_text_processing.text_normalization as text_normalization"
    12/09/2022 6:38 AM UTC
    sha256:597178b9e6b09db1b710dc04965b97d0088f848793fa424db314b910ca9f3e7eRUN
    NEMO_VERSION=1.13.0 /usr/bin/test -n "$NEMO_VERSION" &&
      /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
      /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
    12/09/2022 6:38 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NEMO_VERSION=1.13.0
    12/09/2022 6:37 AM UTC
    ...