Skip to main content
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
    NEMO_VERSION=1.13.0 rm -rf /opt/conda/pkgs/conda-4.11.0-py38h578d9bd_0/info/test/tests/data/env_metadata
    12/09/2022 6:38 AM UTC
    sha256:76b387a28783aee4a5e37e52b2673d657c18c4d26790087887cbc45e8c91a58eRUN
    NEMO_VERSION=1.13.0 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
      chmod +x start-jupyter.sh
    12/09/2022 6:38 AM UTC
    sha256:07865c5ca047ad73c93c103f1fefa3d03d04dabc51f01fe6e06194c9606f99f6COPY
    tutorials /workspace/nemo/tutorials
    12/09/2022 6:38 AM UTC
    sha256:aa2552847cfc88607b62ffe1e5c271ef9b9d0165a9145ffad5fe5a219e83d8a6COPY
    tests /workspace/nemo/tests
    12/09/2022 6:38 AM UTC
    sha256:56ca67a38dd241845f29d51a4c06fa1cc0ec7760d98a4630c510c62dcbb059f0COPY
    examples /workspace/nemo/examples
    12/09/2022 6:38 AM UTC
    sha256:1d313caea3d189f1203b9ef2969f2ac7e0be04e81787739b9d5b961e09a008deCOPY
    scripts /workspace/nemo/scripts
    12/09/2022 6:38 AM UTC
    sha256:5ca83f52c2a054b547847d86e821233cef972c8797f531b6b86a888fa6fa27e8WORKDIR
    /workspace/nemo
    12/09/2022 6:38 AM UTC
    sha256:bb62dde773d6463d2b81df4d16b6f7a813e303149b52ca690a5347b0d6471757RUN
    NEMO_VERSION=1.13.0 cd /tmp/nemo &&
      pip install ".[all]" &&
      sed -i "s/_module_available(\"torchtext\")/False/g" /opt/conda/lib/python3.8/site-packages/pytorch_lightning/utilities/imports.py &&
      python -c "import nemo.collections.asr as nemo_asr" &&
      python -c "import nemo.collections.nlp as nemo_nlp" &&
      python -c "import nemo.collections.tts as nemo_tts" &&
      python -c "import nemo_text_processing.text_normalization as text_normalization"
    12/09/2022 6:38 AM UTC
    sha256:597178b9e6b09db1b710dc04965b97d0088f848793fa424db314b910ca9f3e7eRUN
    NEMO_VERSION=1.13.0 /usr/bin/test -n "$NEMO_VERSION" &&
      /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
      /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
    12/09/2022 6:38 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NEMO_VERSION=1.13.0
    12/09/2022 6:37 AM UTC
    ...

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.