Triton Inference Server

NVIDIA

Container

NVIDIA

Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:ca7ca5914e755cd378a1e1bc79e88fa050b7ab32c97c639ca261f0c9d2cb4f6c	COPY	`--chown=1000:1000 docker/sagemaker/serve /usr/bin/.`	01/27/2026 10:29 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.amazonaws.sagemaker.capabilities.multi-models=true`	01/27/2026 10:29 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.amazonaws.sagemaker.capabilities.accept-bind-to-port=true`	01/27/2026 10:29 PM UTC
sha256:5e730fed8c2b30b1e66b3ec5cecee4f756b325e2e115dde04048846175143dcf	RUN	`TRITON_VERSION=2.65.0 TRITON_CONTAINER_VERSION=26.01 pip3 install -r python/openai/requirements.txt`	01/27/2026 10:29 PM UTC
sha256:f88faadcb56f1eeed2da04ed0306aa0574e04155bcc855cdbadfdf568dbeb56b	RUN	`TRITON_VERSION=2.65.0 TRITON_CONTAINER_VERSION=26.01 find /opt/tritonserver/python -maxdepth 1 -type f -name "tritonserver-.whl" \| xargs -I {} pip install --upgrade {}[all] && find /opt/tritonserver/python -maxdepth 1 -type f -name "tritonfrontend-.whl" \| xargs -I {} pip install --upgrade {}[all]`	01/27/2026 10:29 PM UTC
sha256:2bc46b0829593ebc73fe0ae7cd38f8514e2d29c6cb0e0e09cd82d4026f5d491b	COPY	`--chown=1000:1000 NVIDIA_Deep_Learning_Container_License.pdf .`	01/27/2026 10:28 PM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	WORKDIR	`/opt/tritonserver`	01/27/2026 10:28 PM UTC
sha256:5ca34a83baab22eec8237d8970c662168cf3417e7dee9d3c941e7d53540a0af9	COPY	`--chown=1000:1000 build/install tritonserver`	01/27/2026 10:28 PM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	WORKDIR	`/opt`	01/27/2026 10:28 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.nvidia.build.ref=c2536fda2e5c6fa09b84b08768f450a39a608761`	01/27/2026 10:28 PM UTC