NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
    NEMO_VERSION=1.21.0 if [ "${REQUIRE_AIS_CLI}" = true ]; then INSTALL_MSG=$(/bin/bash scripts/installers/install_ais_cli_latest.sh); INSTALL_CODE=$?; echo ${INSTALL_MSG}; if [ ${INSTALL_CODE} -ne 0 ]; then echo "AIS CLI installation failed"; exit ${INSTALL_CODE}; else echo "AIS CLI installed successfully"; fi else echo "Skipping AIS CLI installation"; fi
    10/26/2023 10:21 PM UTC
    sha256:7dde71ae6ab1822fa1804145bdf19bdb397fa39ae57c8c353871220ce7355c6dRUN
    NEMO_VERSION=1.21.0 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
      chmod +x start-jupyter.sh
    10/26/2023 10:21 PM UTC
    sha256:ba4443e94f4caec34676fe880001c388f6994181de350b8b5fb663c6b068b4cfCOPY
    tutorials /workspace/nemo/tutorials
    10/26/2023 10:21 PM UTC
    sha256:2d246e2360d668fc13e479699ff6f26f51ec2c6597ca31796abc1bf3d11260ffCOPY
    tests /workspace/nemo/tests
    10/26/2023 10:21 PM UTC
    sha256:b77128f75ac3b34f7a42a9faa87ae55b1fe4726701a6d038fb978ec8db934badCOPY
    examples /workspace/nemo/examples
    10/26/2023 10:21 PM UTC
    sha256:67d18d4cbd718e4807eeb5ba9349c391225bd769313222edb357f117e6bc2fd7COPY
    scripts /workspace/nemo/scripts
    10/26/2023 10:21 PM UTC
    sha256:8b81479dbd4944bc5832c76cb41f64cc218e15a7048d9de0b04568c557bc1b49WORKDIR
    /workspace/nemo
    10/26/2023 10:21 PM UTC
    sha256:6b38f974016bce2dfd339e85fcdcde7062ec66b048874d9c1f6e9a337371a5a8RUN
    NEMO_VERSION=1.21.0 python -c "import nemo.collections.nlp as nemo_nlp" &&
      python -c "import nemo.collections.tts as nemo_tts" &&
      python -c "import nemo_text_processing.text_normalization as text_normalization"
    10/26/2023 10:21 PM UTC
    sha256:8edd2d9b60747fa1e9c608326766d7f3e02a15f9bfd009dd2a21bb4ced99c8f9RUN
    NEMO_VERSION=1.21.0 cd /tmp/nemo &&
      pip install ".[all]"
    10/26/2023 10:21 PM UTC
    sha256:bbfb49d5ce3ac84d4de60c842ef4c3a5e66f31ab71e0c5c233b8210001d1c6fbRUN
    NEMO_VERSION=1.21.0 /usr/bin/test -n "$NEMO_VERSION" &&
      /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
      /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
    10/26/2023 10:20 PM UTC
    ...

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.