ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
09d6bcd2f0256cc2ae91639483f75ac86c92ce30eac6f68f9aa20e333975935cCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
11/20/2025 9:15 PM UTC
5fc63e8259e6061c07383f0f9ff8e1c295450d3cee0702100cca48e3e692c4e5ENV
LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
11/20/2025 9:15 PM UTC
05daae2663d18fb5aa84c6c1ba1256699c229eef911425bd2ac644d4108d47d9ENV
LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
11/20/2025 9:15 PM UTC
6e6597806c61bde25759d6392bfb01f6c75339844dc05f64946f8dcc293b4726ENV
PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
11/20/2025 9:15 PM UTC
f64638fe8da1f11fcb3df9357fcd9e0c484a15b295e339ed72994081bc0e60e6ENV
NVIDIA_BUILD_ID=236082570
11/20/2025 9:15 PM UTC
a2a0eff930de4c8cabc42a6ce0df789c55dffbd6a319e7fe6e8739a89208733bENV
NVIDIA_TRITON_SERVER_SDK_VERSION=25.11
11/20/2025 9:15 PM UTC
0a02853068fb8662fac6cadf42dce9386eefe7650a3c4cdfb31e379101d31952ARG
NVIDIA_BUILD_ID=236082570
11/20/2025 9:15 PM UTC
6fe9246674cb411b5f0a8296dd1b763dc0883101626c6522e5d1db39764b7e1aARG
NVIDIA_TRITON_SERVER_SDK_VERSION=25.11
11/20/2025 9:15 PM UTC
1f2b19653a93eab8bbe59af5820f4b5efd6b7d4c0a254905896dc8f0dcf83fb9RUN
DCGM_VERSION=4.4.0-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r25.11 TARGETPLATFORM=linux/arm64 TRITON_ENABLE_GPU=ON TRITON_MODEL_ANALYZER_REPO_TAG=r25.11 TRITON_MODEL_ANALYZER_REPO=https://github.com/triton-inference-server/model_analyzer@r25.11 sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new &&
  mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
11/20/2025 9:15 PM UTC
69a367249e802fec264bd5abc0b5154781d892ea20997c147d2b53715bf6c5dbCOPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
11/20/2025 9:15 PM UTC
...