NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:a29d2dbda14eb1042155f8d030c95e7fe2ba551ae967c6ae668f69d5ab05bdcdRUN
    NEMO_VERSION=v0.10.1-428-g4b7bbc4a BASE_IMAGE=nvcr.io/nvidia/pytorch:20.01-py3 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
      chmod +x start-jupyter.sh
    07/09/2020 11:15 PM UTC
    sha256:2659e7bcaa1350261ebbb379d3527ebd49dff6292b095fa915fc201a6c2b6071COPY
    README.rst LICENSE /workspace/nemo/
    07/09/2020 11:15 PM UTC
    sha256:6e3e7aa7f6502cbfbed100f3ce51e9a70f433a0c1291ef2a6664c41b8cae5adaCOPY
    tests /workspace/nemo/tests
    07/09/2020 11:15 PM UTC
    sha256:594c1cd63a0dfa086149cc53f9db31a56108ca287b9f62c775c59f72dcae3e66COPY
    examples /workspace/nemo/examples
    07/09/2020 11:15 PM UTC
    sha256:e438cc1e10e1989c961e5b8863790afefb3499213f9706bd35198e213afbf656COPY
    scripts /workspace/nemo/scripts
    07/09/2020 11:15 PM UTC
    sha256:92d28c95add14241782239bfe38d17a94d66f685c38a4f080e30d4ecb9f7e4d9WORKDIR
    /workspace/nemo
    07/09/2020 11:15 PM UTC
    sha256:0d28b578ee86ac86f45d43b3aed20c3e816f2f9e56b18058cbb7ba48f6e507c2RUN
    NEMO_VERSION=v0.10.1-428-g4b7bbc4a BASE_IMAGE=nvcr.io/nvidia/pytorch:20.01-py3 cd /tmp/nemo &&
      pip install ".[all]"
    07/09/2020 11:15 PM UTC
    sha256:06231b9c7c2f45f03e418c27400ce9710779e66903eb2bd9a0654205ed0fbd96RUN
    NEMO_VERSION=v0.10.1-428-g4b7bbc4a BASE_IMAGE=nvcr.io/nvidia/pytorch:20.01-py3 /usr/bin/test -n "$NEMO_VERSION" &&
      /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
      /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
    07/09/2020 11:15 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    BASE_IMAGE
    07/01/2020 10:21 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NEMO_VERSION
    07/01/2020 10:21 PM UTC
    ...