NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

LayerLabelCreated
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1WORKDIR
/workspace
06/09/2025 10:34 PM UTC
sha256:614afacc21ab43029960ea7d12e806b24c52461c69082fe28d97ff0d531d64fcRUN
MCORE_COMMIT=4116e1be5a39497ee32595087ba62121daa69d54 MCORE_VERSION=0.12.0rc0 NEMO_COMMIT=2a05ed2594fcbd69ca833ab5a51409f2efa1df87 NEMO_VERSION=2.4.0rc0 pip install --upgrade jupyter-core==5.8.1
06/09/2025 10:34 PM UTC
sha256:d2437a57291a9b74a0d87cf5968a5bda33294acd598965ecdf0f49b05af08ec4COPY
export_deploy/trtllm_changes/llama /usr/local/lib/python3.12/dist-packages/tensorrt_llm/models/llama
06/09/2025 10:32 PM UTC
sha256:9324451e04304ae55853728ce2d7c934cb4903690698905f6d082032db9fb926RUN
MCORE_COMMIT=4116e1be5a39497ee32595087ba62121daa69d54 MCORE_VERSION=0.12.0rc0 NEMO_COMMIT=2a05ed2594fcbd69ca833ab5a51409f2efa1df87 NEMO_VERSION=2.4.0rc0 rm -rf /usr/local/lib/python3.12/dist-packages/tensorrt_llm/models/llama
06/09/2025 10:32 PM UTC
sha256:381658ab1610439dff8e5899e784877204b3b0f2506fe3cec2065a7d12e5b66dRUN
MCORE_COMMIT=4116e1be5a39497ee32595087ba62121daa69d54 MCORE_VERSION=0.12.0rc0 NEMO_COMMIT=2a05ed2594fcbd69ca833ab5a51409f2efa1df87 NEMO_VERSION=2.4.0rc0 CI_JOB_TOKEN=$(cat /run/secrets/CI_JOB_TOKEN) &&
  rm -rf NeMo &&
  git clone https://gitlab-ci-token:${CI_JOB_TOKEN}@gitlab-master.nvidia.com/dl/JoC/nemo_multimodal.git NeMo &&
  cd NeMo &&
  git pull &&
  if [ ! -z $NEMO_COMMIT_GITLAB ]; then git fetch origin $NEMO_COMMIT_GITLAB &&
  git checkout FETCH_HEAD; fi &&
  HEAD_NEMO_COMMIT=$(git rev-parse HEAD) &&
  echo "Container built with NeMo commit hash: $HEAD_NEMO_COMMIT" &&
  rm -rf .git
06/09/2025 10:32 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NEMO_FW_NEMO_VERSION=2.4.0rc0
06/06/2025 4:13 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NEMO_FW_NEMO_COMMIT=9576e5c2ae53529d37d992d8cf040a963c5d3717
06/06/2025 4:13 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NEMO_COMMIT_GITLAB=9576e5c2ae53529d37d992d8cf040a963c5d3717
06/06/2025 4:13 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
NEMO_VERSION=2.4.0rc0
06/06/2025 4:13 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
NEMO_COMMIT=2a05ed2594fcbd69ca833ab5a51409f2efa1df87
06/06/2025 4:13 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.