Skip to main content
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:992af68c405658d2f2368e53964b196ac7582a452d1b17901e9b8738192da456COPY
    . /opt/NeMo
    03/31/2025 4:46 PM UTC
    sha256:073539d2a2e3934912850436879a2b9b079cf7adb199cec6ffa072db74bc9f5cRUN
    rm -rf /opt/NeMo
    03/05/2025 8:10 AM UTC
    sha256:ba0fba7d0c5b31768ca948874d88acefc3b976a5523c405818e670e9ac6ece6dRUN
    git clone --single-branch --branch cosmos1.0.1 https://github.com/NVIDIA/Megatron-LM.git /opt/megatron-lm &&
      cd /opt/megatron-lm &&
      git checkout 86dad2c39a52c241e372b774f07041201f8a57f4 &&
      pip install -e . &&
      cd megatron/core/datasets &&
      make
    03/05/2025 8:10 AM UTC
    sha256:f602df430825ed3c099dd2e438d481c87203c1d43a753a562a38cad048a95cdaRUN
    rm -rf /opt/megatron-lm
    03/05/2025 8:10 AM UTC
    sha256:c391da0217561515a5b81ba1c7050136f056f288f719b47098c6e6a78cd5348aRUN
    pip install moviepy==1.0.3
    03/05/2025 8:10 AM UTC
    sha256:b4f81959db7ffeb8161ed06168630db571f0006281c3032a10f4f718713be9ecRUN
    pip install --no-cache-dir imageio[ffmpeg] pyav iopath better_profanity peft lru-dict pyquaternion git+https://github.com/NVlabs/Pytorch_Retinaface.git@b843f45 git+https://github.com/NVIDIA/NeMo-Run.git@f07877f80dbfc91c4d37683864cf2552b96d62f1
    03/05/2025 8:10 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.ref=
    02/18/2025 9:19 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NVIDIA_BUILD_REF
    02/18/2025 9:19 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.id=134983853
    02/18/2025 9:19 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_BUILD_ID=134983853
    02/18/2025 9:19 PM UTC
    ...