NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:02c972e7bd1b4a531aa80ec693cb8711be7bd0980b98723b03f679451c6c6210RUN
    NEMO_VERSION=1.4.0 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
      chmod +x start-jupyter.sh
    10/01/2021 9:08 PM UTC
    sha256:86642ac3c22e304c4baa46f0453cd099c85904a0ff36c0cdf80cd25bf8380172COPY
    tutorials /workspace/nemo/tutorials
    10/01/2021 9:08 PM UTC
    sha256:42b599f9d7edb56a79978294276b6641cd9271769c477014b87a74cabf51be33COPY
    tests /workspace/nemo/tests
    10/01/2021 9:08 PM UTC
    sha256:123401177651898473375748f5e3503e2f94f4935fc0ea4aa7e4bce35741005dCOPY
    examples /workspace/nemo/examples
    10/01/2021 9:08 PM UTC
    sha256:884e3227152f7fb46ba8200a3a67c40deef3c53ba941cb6b542bbbbdc16937e5COPY
    scripts /workspace/nemo/scripts
    10/01/2021 9:08 PM UTC
    sha256:31c8a2b1293773135d91ef9cb577b2a7f9db2421e2132ad00b68852d3f35cec3WORKDIR
    /workspace/nemo
    10/01/2021 9:08 PM UTC
    sha256:8bf28985f8f4314ee45d404e916450b0404e1e2c5acb04192db748f6de074344RUN
    NEMO_VERSION=1.4.0 conda install -c numba numba=0.53.1
    10/01/2021 9:08 PM UTC
    sha256:07ee938b843fd7639bb289fc4b6bcd51d718a187e59cda98f45cfb0cce895d12RUN
    NEMO_VERSION=1.4.0 cd /tmp/nemo &&
      pip install ".[all]" &&
      python -c "import nemo.collections.asr as nemo_asr" &&
      python -c "import nemo.collections.nlp as nemo_nlp" &&
      python -c "import nemo.collections.tts as nemo_tts" &&
      python -c "import nemo_text_processing.text_normalization as text_normalization"
    10/01/2021 9:07 PM UTC
    sha256:13c28c0ef109f33838691e498f5def1084551bc3309857fe0ca6424a8e248825RUN
    NEMO_VERSION=1.4.0 /usr/bin/test -n "$NEMO_VERSION" &&
      /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
      /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
    10/01/2021 9:07 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NEMO_VERSION=1.4.0
    10/01/2021 9:07 PM UTC
    ...