NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

LayerLabelCreated
867645fee06fe68143412b8630098c06b7ea42f2cbb9556dab821cb838924c7aCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp
06/09/2025 10:34 PM UTC
1d0d99599c24fc1e5eedceace1a61692973cf79ca29e0036de15265fc0d7a428RUN
MCORE_COMMIT=4116e1be5a39497ee32595087ba62121daa69d54 MCORE_VERSION=0.12.0rc0 NEMO_COMMIT=2a05ed2594fcbd69ca833ab5a51409f2efa1df87 NEMO_VERSION=2.4.0rc0 pip install --upgrade jupyter-core==5.8.1
06/09/2025 10:34 PM UTC
2df9258a40f647295a26553542124e855ec6f6c15fec9d38ba1c0e82a7bf0f4bCOPY
export_deploy/trtllm_changes/llama /usr/local/lib/python3.12/dist-packages/tensorrt_llm/models/llama
06/09/2025 10:32 PM UTC
a376855bac54282f35f5c07bf8672fd9c8ef5de4af2d67d678e75b6518d29209RUN
MCORE_COMMIT=4116e1be5a39497ee32595087ba62121daa69d54 MCORE_VERSION=0.12.0rc0 NEMO_COMMIT=2a05ed2594fcbd69ca833ab5a51409f2efa1df87 NEMO_VERSION=2.4.0rc0 rm -rf /usr/local/lib/python3.12/dist-packages/tensorrt_llm/models/llama
06/09/2025 10:32 PM UTC
5edc19d1af9b53436392382b90b8a3e4b5a3b0296bb2b0446a88595d415c0e77RUN
MCORE_COMMIT=4116e1be5a39497ee32595087ba62121daa69d54 MCORE_VERSION=0.12.0rc0 NEMO_COMMIT=2a05ed2594fcbd69ca833ab5a51409f2efa1df87 NEMO_VERSION=2.4.0rc0 CI_JOB_TOKEN=$(cat /run/secrets/CI_JOB_TOKEN) &&
  rm -rf NeMo &&
  git clone https://gitlab-ci-token:${CI_JOB_TOKEN}@gitlab-master.nvidia.com/dl/JoC/nemo_multimodal.git NeMo &&
  cd NeMo &&
  git pull &&
  if [ ! -z $NEMO_COMMIT_GITLAB ]; then git fetch origin $NEMO_COMMIT_GITLAB &&
  git checkout FETCH_HEAD; fi &&
  HEAD_NEMO_COMMIT=$(git rev-parse HEAD) &&
  echo "Container built with NeMo commit hash: $HEAD_NEMO_COMMIT" &&
  rm -rf .git
06/09/2025 10:32 PM UTC
2a09fb6ca9bc77b82ba7cf734b17a809846a52101cbf7fff782d47c604b444e0ENV
NEMO_FW_NEMO_VERSION=2.4.0rc0
06/06/2025 4:13 PM UTC
cd4bcacca09d361851bd22a42e8fa5beb8ddafdc3adfb6c388c132f03d27a64cENV
NEMO_FW_NEMO_COMMIT=9576e5c2ae53529d37d992d8cf040a963c5d3717
06/06/2025 4:13 PM UTC
3375912141db77199f96851b2eb08dd89cd58b593e7fc9cd3a70addee90cb421ENV
NEMO_COMMIT_GITLAB=9576e5c2ae53529d37d992d8cf040a963c5d3717
06/06/2025 4:13 PM UTC
5aaf390467e0e466fc32290b905326282f4496f0e090f9ad62bb356717dad1cfARG
NEMO_VERSION=2.4.0rc0
06/06/2025 4:13 PM UTC
a0f237b26bb946ee1fa194b9de2db7b5ebf60d2dcbb9e3c113208eb9dce8d9a1ARG
NEMO_COMMIT=2a05ed2594fcbd69ca833ab5a51409f2efa1df87
06/06/2025 4:13 PM UTC
...