NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

LayerLabelCreated
sha256:98c4ccd0b8eee70266070eefdc1bc337cfd8520bc1893c20c5dce4fa9524ede6RUN
cd /opt/NeMo &&
  git fetch origin physicalai &&
  git checkout 9a49037bfdf8010237228623e1784cd3717a3900
02/08/2025 12:08 AM UTC
sha256:779362a1a58ed7842f0d0ab47fe118b133df85d699a29ed068e868a41653a112RUN
git clone --single-branch --branch cosmos https://github.com/NVIDIA/Megatron-LM.git /opt/megatron-lm &&
  cd /opt/megatron-lm &&
  pip install -e . &&
  cd megatron/core/datasets &&
  make
02/08/2025 12:08 AM UTC
sha256:9a400ae9bac419b9e2b6aba48ab3be00bcf38eeb5f83eb876864f4de62038c08RUN
rm -rf /opt/megatron-lm
02/08/2025 12:07 AM UTC
sha256:52a8763cca0814e2188ab94f05b2928c46dd45e43fb57a0d0537fd8c5fc0a035RUN
pip install --no-cache-dir imageio[ffmpeg] pyav iopath better_profanity peft git+https://github.com/NVlabs/Pytorch_Retinaface.git@b843f45
01/05/2025 12:06 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
com.nvidia.build.ref=
12/21/2024 7:06 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
NVIDIA_BUILD_REF
12/21/2024 7:06 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
com.nvidia.build.id=114410972
12/21/2024 7:06 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NVIDIA_BUILD_ID=114410972
12/21/2024 7:06 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
NVIDIA_BUILD_ID
12/21/2024 7:06 PM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.5.0.18 CUDA_VER=12.6 CUDNN_VER=9.5.0.50-1 NCCL_VER= CUBLAS_VER=12.6.3.3-1 NVRTC_VER=12.6.77-1 REINSTALL_APEX=False APEX_COMMIT=73375b3bbcb59a5d6ff43f2fafd00b9ecdbe0417 MCORE_COMMIT=core_r0.10.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build TARGET_ARCH=x86 INSTALL_VLLM=True ALIGNER_COMMIT=r0.6.0 LAUNCHER_COMMIT=5730fac6f97795931325cab0ac5dce1924cdcb3f DATA_CURATOR_COMMIT=r0.6.0 INSTALL_DATA_CURATOR=True MODELOPT_VERSION=0.19.0 NEMO_COMMIT=r2.1.0 RESIL_COMMIT=97aad77609d2e25ed38ac5c99f0c13f93c48464e NEMO_RUN_COMMIT=b4e2258f61b88c53b77996b5f9ed871ee666d85f PRE_COMPILE_QUANT_KERNELS=True chmod -R a+w /workspace
12/21/2024 7:06 PM UTC
...