ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported
LayerLabelCreated
6db778844f18e6d46a6a9b63c765d92f71d334c7d653bb5b4a81db4a1acb805aCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp
05/02/2025 10:25 PM UTC
4b9b30f2794efdf5241e679b26ea89f75923e002f5a2ee2bdf5d11cf8fcd3ceaARG
NVIDIA_BUILD_REF
05/02/2025 10:25 PM UTC
77c028203eb450841283f5a1dac701e172818551123e78c900ea6036f2d2a228LABEL
com.nvidia.build.id=148941828
05/02/2025 10:25 PM UTC
0a59821050e3b2bd4d3e3ab4d089cb057ca80cae32c8877cc2af025a085def97ENV
NVIDIA_BUILD_ID=148941828
05/02/2025 10:25 PM UTC
3b82bd7813f594fd3bdde7032cd8a4b5e0a8636d4494778c4ad9cb7d3ad7db6bARG
NVIDIA_BUILD_ID
05/02/2025 10:25 PM UTC
4ec253341d6c65e28dd1bc4e4ea227ea4aac33fdec19fdddd19c44f47cc79d29ENV
NEMO_FW_PIPELINE_ID=27869872
05/02/2025 10:25 PM UTC
b1d793fcb12ddc6e87ff737158c464ffa009c832768cdc9d06b6d9f87279d1f3ARG
NEMO_FW_PIPELINE_ID=27869872
05/02/2025 10:25 PM UTC
4634b769b0eb32b880965a794eb7a9b29eec3ecad3bcfe9614fd8b42f865300aRUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.9.0.34 CUDA_VER=12.8 CUDNN_VER=9.8.0.87-1 NCCL_VER=2.25.1-1+cuda12.8 CUBLAS_VER=12.8.4.1-1 NVRTC_VER=12.8.93-1 TRT_LLM_COMMIT=3c5fe5eb86077f67febc42070be11f11de17c1e2 TRT_LLM_VERSION=0.18.0 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 GDR_COPY_VERSION=v2.4.1 REINSTALL_APEX=False APEX_COMMIT=e13873debc4699d39c6861074b9a3b2a02327f92 MCORE_COMMIT=3cdfd613e68e8b734a3b9e28de579daaf81f4503 MCORE_VERSION=0.12.0rc4 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build INSTALL_VLLM=True ALIGNER_COMMIT=dev ALIGNER_VERSION=0.6.0rc0.dev0 LAUNCHER_COMMIT=26e42fa91d9e608897ce485b4911c263a4b57008 CURATOR_COMMIT=r0.8.0 INSTALL_CURATOR=True CURATOR_VERSION=0.8.0rc4.dev0 NEMO_COMMIT=r2.3.0 NEMO_VERSION=2.3.0rc5 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.27.1 NEMO_RUN_COMMIT=r0.4.0 PRE_COMPILE_QUANT_KERNELS=True chmod -R a+w /workspace
05/02/2025 10:25 PM UTC
e21c57dd7b68fe5224786e08161610d308693334fa3ab937e3faffd68d49a5a5WORKDIR
/workspace
05/02/2025 10:25 PM UTC
5e14c4b9468882b41f8e9d987b10ed2bcc638629a8141f38921fa73c13c83caeRUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.9.0.34 CUDA_VER=12.8 CUDNN_VER=9.8.0.87-1 NCCL_VER=2.25.1-1+cuda12.8 CUBLAS_VER=12.8.4.1-1 NVRTC_VER=12.8.93-1 TRT_LLM_COMMIT=3c5fe5eb86077f67febc42070be11f11de17c1e2 TRT_LLM_VERSION=0.18.0 REINSTALL_NSYS=False NSYS_VERSION=2025.1.1.65 TARGET_ARCH=x86 DEEPEP_COMMIT=a84a24808fb0ea732f49b874cc456a69dde69076 GDR_COPY_VERSION=v2.4.1 REINSTALL_APEX=False APEX_COMMIT=e13873debc4699d39c6861074b9a3b2a02327f92 MCORE_COMMIT=3cdfd613e68e8b734a3b9e28de579daaf81f4503 MCORE_VERSION=0.12.0rc4 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build INSTALL_VLLM=True ALIGNER_COMMIT=dev ALIGNER_VERSION=0.6.0rc0.dev0 LAUNCHER_COMMIT=26e42fa91d9e608897ce485b4911c263a4b57008 CURATOR_COMMIT=r0.8.0 INSTALL_CURATOR=True CURATOR_VERSION=0.8.0rc4.dev0 NEMO_COMMIT=r2.3.0 NEMO_VERSION=2.3.0rc5 INSTALL_RESIL=False RESIL_COMMIT=not_installed RESIL_VERSION=not_installed INSTALL_MODELOPT=True MODELOPT_VERSION=0.27.1 NEMO_RUN_COMMIT=r0.4.0 PRE_COMPILE_QUANT_KERNELS=True cd /usr/local/lib/python3.12/dist-packages &&
  patch -p1 < /opt/triton-lang_triton_6570_lazy_init.patch &&
  rm /opt/triton-lang_triton_6570_lazy_init.patch
05/02/2025 10:25 PM UTC
...