NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.ref=
    12/06/2023 1:42 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NVIDIA_BUILD_REF
    12/06/2023 1:42 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.id=71422337
    12/06/2023 1:42 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_BUILD_ID=71422337
    12/06/2023 1:42 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NVIDIA_BUILD_ID
    12/06/2023 1:42 AM UTC
    sha256:4d668b3aa25bdd376bf4907dc5267dea4a85dcc8b0039861c451821c3368cd25RUN
    chmod -R a+w /workspace
    12/06/2023 1:42 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4WORKDIR
    /workspace
    12/06/2023 1:42 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    GDRCOPY_VERSION=2.3 HPCX_VERSION=2.14 MOFED_VERSION=5.4-rdmacore36.0 OPENUCX_VERSION=1.14.0 OPENMPI_VERSION=4.1.4 RDMACORE_VERSION=36.0
    12/06/2023 1:42 AM UTC
    sha256:6d3b865658a5fe611dda0da0c85e274efed6fe704a9696d321dc5f38e0e45a9aRUN
    cd /opt/hpcx &&
      rm -rf * &&
      curl -f --proto '=https' https://content.mellanox.com/hpc/hpc-x/v2.14/hpcx-v2.14-gcc-inbox-ubuntu22.04-cuda12-gdrcopy2-nccl2.17-x86_64.tbz | tar jxf - --strip-components=1
    12/06/2023 1:42 AM UTC
    sha256:8374a31f0ed2145ce34d7eed92dd654779579256aa4885e55f1493688dc23b72RUN
    echo "    UserKnownHostsFile /dev/null" >> /etc/ssh/ssh_config &&
      sed -i 's/#\(StrictModes \).*/\1no/g' /etc/ssh/sshd_config &&
      sed -i 's/#   StrictHostKeyChecking ask/    StrictHostKeyChecking no/' /etc/ssh/ssh_config &&
      mkdir -p /var/run/sshd
    12/06/2023 1:41 AM UTC
    ...