NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
    NEMO_VERSION=1.18.0 if [ "${REQUIRE_AIS_CLI}" = true ]; then INSTALL_MSG=$(/bin/bash scripts/installers/install_ais_cli_latest.sh); INSTALL_CODE=$?; echo ${INSTALL_MSG}; if [ ${INSTALL_CODE} -ne 0 ]; then echo "AIS CLI installation failed"; exit ${INSTALL_CODE}; else echo "AIS CLI installed successfully"; fi else echo "Skipping AIS CLI installation"; fi
    05/17/2023 10:29 PM UTC
    sha256:b437cb74ad8b87ea36dd195b455c3c6b698e5f3658e7c14fc124458728e74078RUN
    NEMO_VERSION=1.18.0 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
      chmod +x start-jupyter.sh
    05/17/2023 10:29 PM UTC
    sha256:91464708db9d10ed3bfcc2c6a321d94aac4cac25bc49bb4d5f123e304d8b8225COPY
    tutorials /workspace/nemo/tutorials
    05/17/2023 10:29 PM UTC
    sha256:13cc14d949ba09f539722907d66f59529ee8be6429f1d90b29fec0bd1fc18722COPY
    tests /workspace/nemo/tests
    05/17/2023 10:29 PM UTC
    sha256:241fc21f3a1ceee1251e4ca84ae1f4a4f59fb09f8fb943d2417007db657f3099COPY
    examples /workspace/nemo/examples
    05/17/2023 10:29 PM UTC
    sha256:18310022ffe9ce257e7cf7fdcdecc90895f579a70b9d036185419ce9d7c1db0bCOPY
    scripts /workspace/nemo/scripts
    05/17/2023 10:29 PM UTC
    sha256:79be89f4394d1d6d0d69bc840dd6b7038b8e8f1e1cd0f751780d21e093605371WORKDIR
    /workspace/nemo
    05/17/2023 10:29 PM UTC
    sha256:cded24f6c2e3a86713bf7489d74c4ad9a0602a9dd44af903a1bedf488d1c6d35RUN
    NEMO_VERSION=1.18.0 python -c "import nemo.collections.nlp as nemo_nlp" &&
      python -c "import nemo.collections.tts as nemo_tts" &&
      python -c "import nemo_text_processing.text_normalization as text_normalization"
    05/17/2023 10:29 PM UTC
    sha256:44092d06c9a1ac27e0fc47227bbc78c22395cbd7fb2e75014985926ed39adc01RUN
    NEMO_VERSION=1.18.0 cd /tmp/nemo &&
      pip install ".[all]"
    05/17/2023 10:29 PM UTC
    sha256:70db4b4397af3919a7e961ec6a08fea3f7b92ef04f9074f043782c3c5fd03fedRUN
    NEMO_VERSION=1.18.0 /usr/bin/test -n "$NEMO_VERSION" &&
      /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
      /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
    05/12/2023 7:28 PM UTC
    ...

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.