Triton Inference Server

NVIDIA

Container

NVIDIA

Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:89206e0418aa5135a441e670d888f1443cef451fa16e1dd8a017868b6735b0d7	COPY	`docker/sagemaker/serve /usr/bin/.`	08/26/2026 6:59 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.amazonaws.sagemaker.capabilities.multi-models=true`	08/26/2026 6:59 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.amazonaws.sagemaker.capabilities.accept-bind-to-port=true`	08/26/2026 6:59 PM UTC
sha256:9f0f4893fa0d6aa3e40e35ef1ac9920050dcb359b2bce954e5420e03adc5322f	RUN	`TRITON_VERSION=2.72.0 TRITON_CONTAINER_VERSION=26.08 /bin/bash -c pip3 install -r python/openai/requirements.txt`	08/26/2026 6:59 PM UTC
sha256:483a9d40512a412f84cbdb57bfd7e4d8b5aa9a34290d29e90de9d404a0794227	RUN	`TRITON_VERSION=2.72.0 TRITON_CONTAINER_VERSION=26.08 /bin/bash -c set -e; for pkg in tritonserver tritonfrontend; do wheels=$(find /opt/tritonserver/python -maxdepth 1 -type f -name "${pkg}-.whl"); if [ -z "$wheels" ]; then echo "ERROR: ${pkg}-.whl missing from /opt/tritonserver/python -- build did not stage the wheel into the image" >&2; exit 1; fi; printf '%s\n' "$wheels" \| xargs -I {} pip install --upgrade "{}[all]"; done`	08/26/2026 6:59 PM UTC
sha256:d8745e9242adf9ff67f8d573d58629ee0f3dc9db89e0e630b6bb01f43ab4341d	COPY	`NVIDIA_Deep_Learning_Container_License.pdf .`	08/26/2026 6:59 PM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	WORKDIR	`/opt/tritonserver`	08/26/2026 6:59 PM UTC
sha256:e7fc2b290c5cc8047c2a822550d4f3a87e9a14474a68bdf86b06229cae2a3a95	COPY	`build/install tritonserver`	08/26/2026 6:59 PM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	WORKDIR	`/opt`	08/26/2026 6:59 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.nvidia.build.ref=359b27005779277f7bc7781d5785f5669fe322cc`	08/26/2026 6:59 PM UTC