Triton Inference Server

NVIDIA

Container

NVIDIA

Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:1b4595850f6739060d1ed73ccf6627a29194583164f3300632fb99c91cc8f6c8	COPY	`--chown=1000:1000 docker/sagemaker/serve /usr/bin/.`	07/28/2025 4:20 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.amazonaws.sagemaker.capabilities.multi-models=true`	07/28/2025 4:20 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.amazonaws.sagemaker.capabilities.accept-bind-to-port=true`	07/28/2025 4:20 PM UTC
sha256:abb19bc8915c1d8396ee02e52205ec984bd176b44f1c3fbcf8819f12bacb47c3	RUN	`TRITON_VERSION=2.59.1 TRITON_CONTAINER_VERSION=25.07 pip3 install -r python/openai/requirements.txt`	07/28/2025 4:20 PM UTC
sha256:ba605eeedd1dff515070694b50cb774c0b155bd4a3862b69528f2ce54b8f4a11	RUN	`TRITON_VERSION=2.59.1 TRITON_CONTAINER_VERSION=25.07 find /opt/tritonserver/python -maxdepth 1 -type f -name "tritonserver-.whl" \| xargs -I {} pip install --upgrade {}[all] && find /opt/tritonserver/python -maxdepth 1 -type f -name "tritonfrontend-.whl" \| xargs -I {} pip install --upgrade {}[all]`	07/28/2025 4:20 PM UTC
sha256:2b9586d930a593dc3aafb7823e6ad8d6b2d8e376593b438fc336fe8dd471b889	COPY	`--chown=1000:1000 NVIDIA_Deep_Learning_Container_License.pdf .`	07/28/2025 4:19 PM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	WORKDIR	`/opt/tritonserver`	07/28/2025 4:19 PM UTC
sha256:3e2a534224085da6299e016d0601e346725392542db69e2865fb0946a06881dd	COPY	`--chown=1000:1000 build/install tritonserver`	07/28/2025 4:19 PM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	WORKDIR	`/opt`	07/28/2025 4:19 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.nvidia.build.ref=94e3a7cf3e836818273f6a353849cd3f9fc26b5a`	07/28/2025 4:19 PM UTC