NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:5df102642bb40046ea9e2594b261b22a8c66be71f76e46bf330a16f2f87088db	RUN	`GITLAB_CLONE_ACCESS_TOKEN=oauth2:glpat-nyxz6hjjnhnqCHxd9ztZ git clone --single-branch --branch yihuih/cosmos_diffusion_finetune_main https://${GITLAB_CLONE_ACCESS_TOKEN}@gitlab-master.nvidia.com/dl/nemo/nemo-vfm /opt/NeMo && cd /opt/NeMo && git checkout 9d999fcd46db2b580d3fb889ca0fef8a883ec004 && rm -rf .git`	01/07/2025 6:02 AM UTC
sha256:7215ca31dd8e071414d8e92cd64c5be1d4ba1f33d1265f4e6f25e0597701c308	RUN	`GITLAB_CLONE_ACCESS_TOKEN=oauth2:glpat-nyxz6hjjnhnqCHxd9ztZ rm -rf /opt/NeMo`	01/05/2025 12:06 AM UTC
sha256:07f22660fcdf82d72f61743ce55dc21de31f7c3f0e6c6059950a25a66bc22bb6	RUN	`GITLAB_CLONE_ACCESS_TOKEN=oauth2:glpat-nyxz6hjjnhnqCHxd9ztZ git clone --single-branch --branch yihuih/cosmos_diffusion_finetune https://${GITLAB_CLONE_ACCESS_TOKEN}@gitlab-master.nvidia.com/dl/nemo/mcore-vfm /opt/megatron-lm && cd /opt/megatron-lm && pip install -e . && rm -rf .git && cd megatron/core/datasets && make`	01/05/2025 12:06 AM UTC
sha256:52b5080b006126c5ec8cffbeabac90060565b0ed757e590a5287050cf2cc0c32	RUN	`GITLAB_CLONE_ACCESS_TOKEN=oauth2:glpat-nyxz6hjjnhnqCHxd9ztZ rm -rf /opt/megatron-lm`	01/05/2025 12:06 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`GITLAB_CLONE_ACCESS_TOKEN`	01/05/2025 12:06 AM UTC
sha256:52a8763cca0814e2188ab94f05b2928c46dd45e43fb57a0d0537fd8c5fc0a035	RUN	`pip install --no-cache-dir imageio[ffmpeg] pyav iopath better_profanity peft git+https://github.com/NVlabs/Pytorch_Retinaface.git@b843f45`	01/05/2025 12:06 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.nvidia.build.ref=`	12/21/2024 7:06 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NVIDIA_BUILD_REF`	12/21/2024 7:06 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.nvidia.build.id=114410972`	12/21/2024 7:06 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NVIDIA_BUILD_ID=114410972`	12/21/2024 7:06 PM UTC