NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

LayerLabelCreated
99442feea901bbce1ec8f8a3ba34e8210d2646e638576f3d35106aeb9814a2e2CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp
01/07/2025 6:02 AM UTC
acc127f72436825dbcb4958b7ad08e4ef284b6a820a95a649634317c46f958c6RUN
GITLAB_CLONE_ACCESS_TOKEN=oauth2:glpat-nyxz6hjjnhnqCHxd9ztZ rm -rf /opt/NeMo
01/05/2025 12:06 AM UTC
68cc983ee443ac5abfc347202f62abb0994cf8ecdb20d276707525a37940dd18RUN
GITLAB_CLONE_ACCESS_TOKEN=oauth2:glpat-nyxz6hjjnhnqCHxd9ztZ git clone --single-branch --branch yihuih/cosmos_diffusion_finetune https://${GITLAB_CLONE_ACCESS_TOKEN}@gitlab-master.nvidia.com/dl/nemo/mcore-vfm /opt/megatron-lm &&
  cd /opt/megatron-lm &&
  pip install -e . &&
  rm -rf .git &&
  cd megatron/core/datasets &&
  make
01/05/2025 12:06 AM UTC
4e0026896b909ccf77e4d9dacae66bdbe93fad554e33452c7a658e39ffb602fcRUN
GITLAB_CLONE_ACCESS_TOKEN=oauth2:glpat-nyxz6hjjnhnqCHxd9ztZ rm -rf /opt/megatron-lm
01/05/2025 12:06 AM UTC
c180a9650330f15ef9e5a0075568508063db0d81af6be7c8f0e19a6e0c4da8d4ARG
GITLAB_CLONE_ACCESS_TOKEN
01/05/2025 12:06 AM UTC
87311597f73e43ad4b1f103ff2b7c5d39e4a8436a0ca8ffcb2ef3f7635696a5bRUN
pip install --no-cache-dir imageio[ffmpeg] pyav iopath better_profanity peft git+https://github.com/NVlabs/Pytorch_Retinaface.git@b843f45
01/05/2025 12:06 AM UTC
1ecd7dda86c2e375dbcef691233c0ca778e713fd26d5154f2214f9ad94f65cc7LABEL
com.nvidia.build.ref=
12/21/2024 7:06 PM UTC
c17bbd4d18c0117dd6ede0b89a9b5fade26b0702967fc3907c52d4af98a9f65dARG
NVIDIA_BUILD_REF
12/21/2024 7:06 PM UTC
6c1c3646b4b4b6caa05825e3bf849f82fa45097358e4fd0ecdc673cf0a348c69LABEL
com.nvidia.build.id=114410972
12/21/2024 7:06 PM UTC
7ab040bf46ae8296f38b86b510e461094fc404c13ca6337fbfa52ff2d74943feENV
NVIDIA_BUILD_ID=114410972
12/21/2024 7:06 PM UTC
...