Skip to main content
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:b0864f3aca0e8d8a61772e5663d2a3b5b6be6426a72547231e9e9de37724c16aRUN
    NEMO_VERSION=1.0.2 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
      chmod +x start-jupyter.sh
    07/16/2021 11:51 PM UTC
    sha256:871a89ed8941cffe8d4bdd647b888e3c2fe40510b0dcbddbccae9c044c0bb863COPY
    tutorials /workspace/nemo/tutorials
    07/16/2021 11:51 PM UTC
    sha256:ea71bb0c5d51e3d51f69ef820214e9ca407842bec6acf9fcd063f6966e9a44feCOPY
    tests /workspace/nemo/tests
    07/16/2021 11:51 PM UTC
    sha256:10948685e8037346b6a6ae5c41d78969630f38496e3cd2dc1f446b1a59dcb0b4COPY
    examples /workspace/nemo/examples
    07/16/2021 11:51 PM UTC
    sha256:343dcb77f159e3f318866e613e46c5f8cc523e9c0859d7a0f15b44b200b08cf6COPY
    scripts /workspace/nemo/scripts
    07/16/2021 11:51 PM UTC
    sha256:b2cb5d760ba506acf99475f6274e529388b4e444c952eb1e9476185822d49ba4WORKDIR
    /workspace/nemo
    07/16/2021 11:51 PM UTC
    sha256:07bd92ab483473fe81238c8e0bc0fc2fb28383dcec45066dd21de8373ef23a7aRUN
    NEMO_VERSION=1.0.2 conda update -c numba numba -y
    07/16/2021 11:51 PM UTC
    sha256:432b206b0f30e3800f751e588832b1a1264bb06e3730fbc850bbe5ff7824ecebRUN
    NEMO_VERSION=1.0.2 cd /tmp/nemo &&
      pip install ".[all]" &&
      python -c "import nemo.collections.asr as nemo_asr" &&
      python -c "import nemo.collections.nlp as nemo_nlp" &&
      python -c "import nemo.collections.tts as nemo_tts" &&
      python -c "import nemo_text_processing.text_normalization as text_normalization"
    07/16/2021 11:50 PM UTC
    sha256:d3b2e57ac397029fc31e09892e77a3843274b861b89440f74427a44855797869RUN
    NEMO_VERSION=1.0.2 /usr/bin/test -n "$NEMO_VERSION" &&
      /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
      /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
    07/16/2021 11:50 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NEMO_VERSION=1.0.2
    07/16/2021 11:50 PM UTC
    ...