Triton Inference Server

NVIDIA

Container

NVIDIA

Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`TCMALLOC_RELEASE_RATE=200`	08/22/2025 1:21 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64`	08/22/2025 1:21 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64`	08/22/2025 1:21 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin`	08/22/2025 1:21 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NVIDIA_BUILD_ID=202022643`	08/22/2025 1:21 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NVIDIA_TRITON_SERVER_SDK_VERSION=25.08`	08/22/2025 1:21 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NVIDIA_BUILD_ID=202022643`	08/22/2025 1:21 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NVIDIA_TRITON_SERVER_SDK_VERSION=25.08`	08/22/2025 1:21 AM UTC
sha256:9a209a759b54164657dc29519bb7312fb435f3d72df0d0c2befad50ad18d54e3	RUN	`DCGM_VERSION=4.4.0-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r25.08 TARGETPLATFORM=linux/amd64 TRITON_ENABLE_GPU=ON sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt \| sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new && mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt`	08/22/2025 1:21 AM UTC
sha256:5022c8379b67fe09c2d4fa1270ccad82199492b92612a740ea5fbbdf047eb1c3	COPY	`docker/entrypoint.d/ /opt/nvidia/entrypoint.d/`	08/22/2025 1:21 AM UTC