Skip to main content
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:5df102642bb40046ea9e2594b261b22a8c66be71f76e46bf330a16f2f87088dbRUN
    GITLAB_CLONE_ACCESS_TOKEN=oauth2:glpat-nyxz6hjjnhnqCHxd9ztZ git clone --single-branch --branch yihuih/cosmos_diffusion_finetune_main https://${GITLAB_CLONE_ACCESS_TOKEN}@gitlab-master.nvidia.com/dl/nemo/nemo-vfm /opt/NeMo &&
      cd /opt/NeMo &&
      git checkout 9d999fcd46db2b580d3fb889ca0fef8a883ec004 &&
      rm -rf .git
    01/07/2025 6:02 AM UTC
    sha256:7215ca31dd8e071414d8e92cd64c5be1d4ba1f33d1265f4e6f25e0597701c308RUN
    GITLAB_CLONE_ACCESS_TOKEN=oauth2:glpat-nyxz6hjjnhnqCHxd9ztZ rm -rf /opt/NeMo
    01/05/2025 12:06 AM UTC
    sha256:07f22660fcdf82d72f61743ce55dc21de31f7c3f0e6c6059950a25a66bc22bb6RUN
    GITLAB_CLONE_ACCESS_TOKEN=oauth2:glpat-nyxz6hjjnhnqCHxd9ztZ git clone --single-branch --branch yihuih/cosmos_diffusion_finetune https://${GITLAB_CLONE_ACCESS_TOKEN}@gitlab-master.nvidia.com/dl/nemo/mcore-vfm /opt/megatron-lm &&
      cd /opt/megatron-lm &&
      pip install -e . &&
      rm -rf .git &&
      cd megatron/core/datasets &&
      make
    01/05/2025 12:06 AM UTC
    sha256:52b5080b006126c5ec8cffbeabac90060565b0ed757e590a5287050cf2cc0c32RUN
    GITLAB_CLONE_ACCESS_TOKEN=oauth2:glpat-nyxz6hjjnhnqCHxd9ztZ rm -rf /opt/megatron-lm
    01/05/2025 12:06 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    GITLAB_CLONE_ACCESS_TOKEN
    01/05/2025 12:06 AM UTC
    sha256:52a8763cca0814e2188ab94f05b2928c46dd45e43fb57a0d0537fd8c5fc0a035RUN
    pip install --no-cache-dir imageio[ffmpeg] pyav iopath better_profanity peft git+https://github.com/NVlabs/Pytorch_Retinaface.git@b843f45
    01/05/2025 12:06 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.ref=
    12/21/2024 7:06 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NVIDIA_BUILD_REF
    12/21/2024 7:06 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.id=114410972
    12/21/2024 7:06 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_BUILD_ID=114410972
    12/21/2024 7:06 PM UTC
    ...