NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

LayerLabelCreated
9ca59ba27e26553352b1cc5f438252a56d2c97a7b252439d04c4cb5b3e4e9515CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp
09/18/2025 6:28 PM UTC
8afb197785f500700b825521ed93130c14be0efb1bd26598809ff305dcbb39b9ARG
NVIDIA_BUILD_REF=fe7ab4e2c56349eedd534a6eae92dceacd0aee65
09/18/2025 6:28 PM UTC
01b70be57f26013b71941a73b65ece8b034fac1e64555d4a6ede286ed2230e60LABEL
com.nvidia.build.id=211400170
09/18/2025 6:28 PM UTC
51da5e966a1a4665c797f24a22bc9e3bb2999fe411be873abdc1a9589df1b20dENV
NVIDIA_BUILD_ID=211400170
09/18/2025 6:28 PM UTC
c932f9f5d688754e2a53fcdb868ff7d0ebce2efdafbb272306d9921fe1b281d6ARG
NVIDIA_BUILD_ID=211400170
09/18/2025 6:28 PM UTC
1c4f77959f95aed0b1b89b167c78ac7192844a8d18edc96d011006f95bc732dbRUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.7.2 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 REINSTALL_CUDNN=True CUDNN_VERSION=9.10.1.4 REINSTALL_NCCL=True NCCL_VERSION=2.26.5 TARGET_ARCH=x86 INSTALL_DEEPEP=True DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 DEEPEP_NVSHMEM_COMMIT= GDR_COPY_VERSION=v2.4.1 REINSTALL_APEX=False APEX_COMMIT=214c6b33270a6054933749845c32224fb825463d MCORE_COMMIT=ae0b6e7e6b9d6a8a87d14d714e0bcab09ed4a3f0 MCORE_VERSION=0.15.0rc0 NEMO_COMMIT=f6b1c7b227a1465e393ee7e684f289353708717a NEMO_VERSION=2.6.0rc0 NEMO_EXPORT_DEPLOY_COMMIT=75e25d47c2430c600dde63d317122034d10e2995 NEMO_EXPORT_DEPLOY_VERSION= SKIP_TRTLLM=True NEMO_EVAL_COMMIT=97331474f317d84768ea551fa32b16becbeaa56f NEMO_EVAL_VERSION= NVFSDP_COMMIT=c4180101296d8bbfcd6a5f65ca28416fce89f131 NVFSDP_VERSION=0.2.0rc0 NEMO_AUTOMODEL_COMMIT=36076d22c13695c1e0268d27d45db10fc8dc3783 NEMO_AUTOMODEL_VERSION=0.2.0rc0 MEGATRON_BRIDGE_COMMIT=039b26f78695a05ac4304de72a206781788de48f MEGATRON_BRIDGE_VERSION=0.2.0rc0 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.31.0 NEMO_RUN_COMMIT=ddb1c4b4e406a11be291729e22f68c52f394b0f0 URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True chmod -R a+w /workspace
09/18/2025 6:28 PM UTC
6c484397164fc6dce3caa54f7e1f67de37ce4028574f46e38a0a18bb8772f36fWORKDIR
/workspace
09/18/2025 6:28 PM UTC
485e346a9bec8970616d85585935ce7eb0cd1d8d047fdd1ce69787c5a0a2d177RUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.7.2 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 REINSTALL_CUDNN=True CUDNN_VERSION=9.10.1.4 REINSTALL_NCCL=True NCCL_VERSION=2.26.5 TARGET_ARCH=x86 INSTALL_DEEPEP=True DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 DEEPEP_NVSHMEM_COMMIT= GDR_COPY_VERSION=v2.4.1 REINSTALL_APEX=False APEX_COMMIT=214c6b33270a6054933749845c32224fb825463d MCORE_COMMIT=ae0b6e7e6b9d6a8a87d14d714e0bcab09ed4a3f0 MCORE_VERSION=0.15.0rc0 NEMO_COMMIT=f6b1c7b227a1465e393ee7e684f289353708717a NEMO_VERSION=2.6.0rc0 NEMO_EXPORT_DEPLOY_COMMIT=75e25d47c2430c600dde63d317122034d10e2995 NEMO_EXPORT_DEPLOY_VERSION= SKIP_TRTLLM=True NEMO_EVAL_COMMIT=97331474f317d84768ea551fa32b16becbeaa56f NEMO_EVAL_VERSION= NVFSDP_COMMIT=c4180101296d8bbfcd6a5f65ca28416fce89f131 NVFSDP_VERSION=0.2.0rc0 NEMO_AUTOMODEL_COMMIT=36076d22c13695c1e0268d27d45db10fc8dc3783 NEMO_AUTOMODEL_VERSION=0.2.0rc0 MEGATRON_BRIDGE_COMMIT=039b26f78695a05ac4304de72a206781788de48f MEGATRON_BRIDGE_VERSION=0.2.0rc0 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.31.0 NEMO_RUN_COMMIT=ddb1c4b4e406a11be291729e22f68c52f394b0f0 URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True cd /usr/local/lib/python3.12/dist-packages &&
  patch -p1 $(python -c "import triton; print(triton.__path__[0])")/runtime/autotuner.py /opt/triton-lang_triton_6570_lazy_init.patch &&
  rm /opt/triton-lang_triton_6570_lazy_init.patch
09/18/2025 6:28 PM UTC
d5220ba3efc3e3a5270f17e014a262ec6101f69527ec8a3a7a6d3cad7b4e6e59COPY
nemo2/patches/triton-lang_triton_6570_lazy_init.patch /opt/
09/18/2025 6:28 PM UTC
87e7c3b275658b8825a9b0d0e865762a948bd7d2a7d21526eae5d1a0f0d5772eRUN
NVIDIA_BIGNLP_VERSION= UV_VERSION=0.7.2 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 REINSTALL_CUDNN=True CUDNN_VERSION=9.10.1.4 REINSTALL_NCCL=True NCCL_VERSION=2.26.5 TARGET_ARCH=x86 INSTALL_DEEPEP=True DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 DEEPEP_NVSHMEM_COMMIT= GDR_COPY_VERSION=v2.4.1 REINSTALL_APEX=False APEX_COMMIT=214c6b33270a6054933749845c32224fb825463d MCORE_COMMIT=ae0b6e7e6b9d6a8a87d14d714e0bcab09ed4a3f0 MCORE_VERSION=0.15.0rc0 NEMO_COMMIT=f6b1c7b227a1465e393ee7e684f289353708717a NEMO_VERSION=2.6.0rc0 NEMO_EXPORT_DEPLOY_COMMIT=75e25d47c2430c600dde63d317122034d10e2995 NEMO_EXPORT_DEPLOY_VERSION= SKIP_TRTLLM=True NEMO_EVAL_COMMIT=97331474f317d84768ea551fa32b16becbeaa56f NEMO_EVAL_VERSION= NVFSDP_COMMIT=c4180101296d8bbfcd6a5f65ca28416fce89f131 NVFSDP_VERSION=0.2.0rc0 NEMO_AUTOMODEL_COMMIT=36076d22c13695c1e0268d27d45db10fc8dc3783 NEMO_AUTOMODEL_VERSION=0.2.0rc0 MEGATRON_BRIDGE_COMMIT=039b26f78695a05ac4304de72a206781788de48f MEGATRON_BRIDGE_VERSION=0.2.0rc0 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.31.0 NEMO_RUN_COMMIT=ddb1c4b4e406a11be291729e22f68c52f394b0f0 URM_USER_ACCOUNT=donghyukc PRE_COMPILE_QUANT_KERNELS=True if [ $PRE_COMPILE_QUANT_KERNELS = "True" ]; then python -c "import modelopt.torch.quantization.extensions as ext; ext.precompile()"; fi
09/18/2025 6:28 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.