NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
    NEMO_VERSION=1.11.0 rm -rf /opt/conda/pkgs/conda-4.11.0-py38h578d9bd_0/info/test/tests/data/env_metadata/
    09/26/2022 7:42 AM UTC
    sha256:93da79c880a42f07d11d783f146c373acbdd485d4d28db5aa271e9d1d1a10916RUN
    NEMO_VERSION=1.11.0 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
      chmod +x start-jupyter.sh
    09/26/2022 7:42 AM UTC
    sha256:75127e55e2358010bf5f928aad54dd8c62e64a52a9fbedc780de8d36041cd8a6COPY
    tutorials /workspace/nemo/tutorials
    09/26/2022 7:42 AM UTC
    sha256:1f14afa6850708f9f1b3cdb74b338f179dc4cd12a55d33aaa80c08c32fb94d4eCOPY
    tests /workspace/nemo/tests
    09/26/2022 7:42 AM UTC
    sha256:79a1cc0389f0f76c963f60d4b35e139c6e357dca9ab1a5b9eb2b6396dc687303COPY
    examples /workspace/nemo/examples
    09/26/2022 7:42 AM UTC
    sha256:a196c78c9ad594a59eea5f6115333c6f3455f448c2bffcbaf7e0c384718d7f8eCOPY
    scripts /workspace/nemo/scripts
    09/26/2022 7:42 AM UTC
    sha256:6c6713a2e37665af44d08fe7073b4b8b7cd9801d32119f3259844d165db7b9f5WORKDIR
    /workspace/nemo
    09/26/2022 7:42 AM UTC
    sha256:dca889d197ee89d26a93ce957a890df289c5c84c27ab3ee0d04d0699ebb6a925RUN
    NEMO_VERSION=1.11.0 cd /tmp/nemo &&
      pip install ".[all]" &&
      sed -i "s/_module_available(\"torchtext\")/False/g" /opt/conda/lib/python3.8/site-packages/pytorch_lightning/utilities/imports.py &&
      python -c "import nemo.collections.asr as nemo_asr" &&
      python -c "import nemo.collections.nlp as nemo_nlp" &&
      python -c "import nemo.collections.tts as nemo_tts" &&
      python -c "import nemo_text_processing.text_normalization as text_normalization"
    09/26/2022 7:42 AM UTC
    sha256:25f3edd82f1fce23b0403e34f530e55158d4d0a5ab80bf0ac6a7aba97a2dcabeRUN
    NEMO_VERSION=1.11.0 /usr/bin/test -n "$NEMO_VERSION" &&
      /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
      /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
    09/14/2022 9:26 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NEMO_VERSION=1.11.0
    09/14/2022 9:26 PM UTC
    ...

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.