NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:79211ea298e6fc33b6b76e0ca665e708f19f0bee9f287fe9fbd15ea2d4228443RUN
    NEMO_VERSION=1.5.1 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
      chmod +x start-jupyter.sh
    12/09/2021 2:10 AM UTC
    sha256:8934af743289c77eb051b1701c7f075f8251f933547072c7398551092e6eefedCOPY
    tutorials /workspace/nemo/tutorials
    12/09/2021 2:10 AM UTC
    sha256:e29a001a1bdf5e617f27a6a4d46315419003562a4bb3b152b99a7c115586a68aCOPY
    tests /workspace/nemo/tests
    12/09/2021 2:10 AM UTC
    sha256:5ca0f19556699d738639622725eb1488208091053c3302afaccdb7a5f14c9136COPY
    examples /workspace/nemo/examples
    12/09/2021 2:10 AM UTC
    sha256:9c360b71cf70af339e5be1a566737d42f7c2c734b5f176d0aca59d9bc9a93cfeCOPY
    scripts /workspace/nemo/scripts
    12/09/2021 2:10 AM UTC
    sha256:727c9bbafd7ca10a66bf4e98622788eb71bf7bdb798120025672f28d94189a9cWORKDIR
    /workspace/nemo
    12/09/2021 2:10 AM UTC
    sha256:20a70e64881c4cf3ee386210b20df2ea2e6c83dcffd8f5a2a138147178ad7355RUN
    NEMO_VERSION=1.5.1 rm -rf /opt/conda/pkgs/conda-4.11.0-py38h578d9bd_0/info/test/tests/data/env_metadata/
    12/09/2021 2:10 AM UTC
    sha256:acb47a2831afadcd5cb2369de9379ffc7c2e720083d10466b121584c5e9da5daRUN
    NEMO_VERSION=1.5.1 conda install -c conda-forge numba=0.54.1
    12/09/2021 2:10 AM UTC
    sha256:f84a126d0876b852bff9b565c68da718954e9cc5432a701acb2d75befa54be8aRUN
    NEMO_VERSION=1.5.1 cd /tmp/nemo &&
      pip install ".[all]" &&
      python -c "import nemo.collections.asr as nemo_asr" &&
      python -c "import nemo.collections.nlp as nemo_nlp" &&
      python -c "import nemo.collections.tts as nemo_tts" &&
      python -c "import nemo_text_processing.text_normalization as text_normalization"
    12/09/2021 2:10 AM UTC
    sha256:961e26a67a60a4d2c16ebb37deb0118c87d2533c084813ed22febf8167e552f0RUN
    NEMO_VERSION=1.5.1 /usr/bin/test -n "$NEMO_VERSION" &&
      /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
      /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
    12/09/2021 2:09 AM UTC
    ...