NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:b3eaa802cd88294d130960b54d79753b48c1550549665a85d83401027f1f0e4fRUN
    NEMO_VERSION=1.6.1 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
      chmod +x start-jupyter.sh
    02/03/2022 11:32 PM UTC
    sha256:c5426889866d3fbab43e194e2af774e0046593c3c81e8aab0b5d86936c5fe25fCOPY
    tutorials /workspace/nemo/tutorials
    02/03/2022 11:32 PM UTC
    sha256:0313fc884925c86389f265b2f827ac32ded524f0ca169fc876c0984b8c2c78d6COPY
    tests /workspace/nemo/tests
    02/03/2022 11:32 PM UTC
    sha256:d60bea40d23dde032405df8e4be284bf5f2ebb450230177f5801447b6a60eff0COPY
    examples /workspace/nemo/examples
    02/03/2022 11:32 PM UTC
    sha256:e0bbf4707e69a26919512cff47000bde81f5619f812a33741f77d91d3ab35034COPY
    scripts /workspace/nemo/scripts
    02/03/2022 11:32 PM UTC
    sha256:1624fa87734ce5459881e71eaa5e97a53553137792b52eeb63362bfbc907faceWORKDIR
    /workspace/nemo
    02/03/2022 11:32 PM UTC
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
    NEMO_VERSION=1.6.1 rm -rf /opt/conda/pkgs/conda-4.11.0-py38h578d9bd_0/info/test/tests/data/env_metadata/
    02/03/2022 11:32 PM UTC
    sha256:44587bfa678979b1a754babee47a8bb680a788033ecff9a98c0eafce2d2c9d4aRUN
    NEMO_VERSION=1.6.1 conda install -c numba numba=0.54.1
    02/03/2022 11:32 PM UTC
    sha256:048d808a1607667683ecdd7dfb691cc7783a9b97a1482b33495dc6242a68aba6RUN
    NEMO_VERSION=1.6.1 cd /tmp/nemo &&
      pip install ".[all]" &&
      python -c "import nemo.collections.asr as nemo_asr" &&
      python -c "import nemo.collections.nlp as nemo_nlp" &&
      python -c "import nemo.collections.tts as nemo_tts" &&
      python -c "import nemo_text_processing.text_normalization as text_normalization"
    02/03/2022 11:31 PM UTC
    sha256:d5748ae659a598efc3c4d148a241d5a5ffe276f260b40f83371a818cdd0f215dRUN
    NEMO_VERSION=1.6.1 /usr/bin/test -n "$NEMO_VERSION" &&
      /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
      /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
    02/02/2022 9:03 AM UTC
    ...