Skip to main content
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:a4b6dac9251a353566a8b04248d41bf50a81d4b3836e1445417ff3882e170af1RUN
    NEMO_VERSION=1.16.0 AIS_VERSION=v1.3.15 AIS_BIN=https://github.com/NVIDIA/aistore/releases/download/v1.3.15/ais-linux-amd64.tar.gz curl -LO ${AIS_BIN} &&
      tar -xzvf ais-linux-amd64.tar.gz &&
      mv ./ais /usr/local/bin/. &&
      rm ais-linux-amd64.tar.gz
    03/07/2023 9:37 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    AIS_BIN=https://github.com/NVIDIA/aistore/releases/download/v1.3.15/ais-linux-amd64.tar.gz
    03/07/2023 9:36 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    AIS_VERSION=v1.3.15
    03/07/2023 9:36 PM UTC
    sha256:1c3e4d660e74e9a4c52c8a12d0a9c7fc556765be7f6147ea81f5aba164570368RUN
    NEMO_VERSION=1.16.0 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
      chmod +x start-jupyter.sh
    03/07/2023 9:36 PM UTC
    sha256:e3588bbd6c9b2e113c36309d51869dfcc8fa5c21a48ad391ca96f7f2b8295fddCOPY
    tutorials /workspace/nemo/tutorials
    03/07/2023 9:36 PM UTC
    sha256:c49203a7a02762d9b814f67fe272e39fd4084cf4b0f8ba21937a772749484de8COPY
    tests /workspace/nemo/tests
    03/07/2023 9:36 PM UTC
    sha256:831ed86d47d52c2f4591933e498efb1a9b8cbb5d584ea2f24696d4585c6dd03bCOPY
    examples /workspace/nemo/examples
    03/07/2023 9:36 PM UTC
    sha256:29120656350752d82eca14c0c8f8ee22bc49fdf4eb1ba07dd62a4cf392906306COPY
    scripts /workspace/nemo/scripts
    03/07/2023 9:36 PM UTC
    sha256:9a56a43545a34bcad086fe507124aca33631765b1ec33a63cca75a4ac34ebf6fWORKDIR
    /workspace/nemo
    03/07/2023 9:36 PM UTC
    sha256:9dee85bd072aa91150f598955b2defafc5f6eb25d83d2bdd5e8dd2e80127fc30RUN
    NEMO_VERSION=1.16.0 pip install numba==0.53.1
    03/07/2023 9:36 PM UTC
    ...

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.