NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

  • LayerLabelCreated
    sha256:3115998904863dc5b8480d56463fd186265bd0df82f6896485ad92d069f965f1RUN
    NVIDIA_TRITON_SERVER_BASE_VERSION=26.01 NVIDIA_BUILD_ID=259402043 sed 's/Server/Server Base/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/========/' > /opt/nvidia/entrypoint.d/10-banner.new &&
      mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
    01/27/2026 9:22 PM UTC
    sha256:79de17693f761146226b18ff7c76c1e36e83a0560742f15e7e21346fa0788e3fCOPY
    docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
    01/27/2026 9:22 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_PRODUCT_NAME=Triton Server Base
    01/27/2026 9:22 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_BUILD_ID=259402043
    01/27/2026 9:22 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_TRITON_SERVER_BASE_VERSION=26.01
    01/27/2026 9:22 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NVIDIA_BUILD_ID=259402043
    01/27/2026 9:22 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NVIDIA_TRITON_SERVER_BASE_VERSION=26.01
    01/27/2026 9:22 PM UTC
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
    TARGETARCH=arm64 ENABLE_FIPS=0 ENABLE_MITMPROXY=0 /tmp/manage_cert.sh uninstall
    01/09/2026 12:14 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    LIBRARY_PATH=/usr/local/cuda/lib64/stubs:/usr/local/cuda/lib64/stubs:
    01/09/2026 12:14 AM UTC
    sha256:75d208d24518c4ce7d21c2e53e85224b980ab8faa3476819e16c5bd2deee744fRUN
    TARGETARCH=arm64 ENABLE_FIPS=0 ENABLE_MITMPROXY=0 export DEVEL=1 BASE=0 &&
      /nvidia/build-scripts/installNCU.sh &&
      /nvidia/build-scripts/installCUDA.sh &&
      /nvidia/build-scripts/installLIBS.sh &&
      if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
      /nvidia/build-scripts/installCUDNN.sh &&
      /nvidia/build-scripts/installTRT.sh &&
      /nvidia/build-scripts/installNSYS.sh &&
      /nvidia/build-scripts/installCUSPARSELT.sh &&
      if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
      rm -f /tmp/cuda-*.patch
    01/09/2026 12:14 AM UTC
    ...