Triton Inference Server

NVIDIA

Container

NVIDIA

Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:4f5dc394b9872bd55349f984513c657b71455d301983d6e2b370f0de66112f88	COPY	`--chown=1000:1000 /usr/bin/serve /usr/bin/.`	01/27/2026 11:08 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.amazonaws.sagemaker.capabilities.accept-bind-to-port=true`	01/27/2026 11:08 PM UTC
sha256:00532ed59a34fa21bfd464aa3eb3d143cd99f0fb88ca9543afd4ebbe2f3c06ea	RUN	`TRITON_VERSION=2.65.0 TRITON_CONTAINER_VERSION=26.01 chown triton-server:triton-server /opt/tritonserver/caches`	01/27/2026 11:08 PM UTC
sha256:5c4d675ab95214053682e05fafaed52d912907a7b8cc65a94a598905362968bc	COPY	`--chown=1000:1000 /opt/tritonserver/caches/local /opt/tritonserver/caches/local`	01/27/2026 11:08 PM UTC
sha256:88203395afaddb5c17004565e6a2f98ec94e36486170db1c68c89bf0242b02e1	RUN	`TRITON_VERSION=2.65.0 TRITON_CONTAINER_VERSION=26.01 chown triton-server:triton-server /opt/tritonserver/repoagents`	01/27/2026 11:08 PM UTC
sha256:45e238048b74dea8f761d064d01869d35306ee9610daba8cefbcbc4246195d87	COPY	`--chown=1000:1000 /opt/tritonserver/repoagents/checksum /opt/tritonserver/repoagents/checksum`	01/27/2026 11:08 PM UTC
sha256:811694a283c0d80eea572578c3b28e33ea66842a9a0342924a9ca21487992b9b	RUN	`TRITON_VERSION=2.65.0 TRITON_CONTAINER_VERSION=26.01 chown triton-server:triton-server /opt/tritonserver/backends`	01/27/2026 11:08 PM UTC
sha256:362eaf399c21863ed704abbc74bd6a847519fcf66c5e0aee239669e8e719e20f	COPY	`--chown=1000:1000 /opt/tritonserver/backends/python /opt/tritonserver/backends/python`	01/27/2026 11:08 PM UTC
sha256:9f5df1402d7454ee24841a2ca5ceb22711d70b7b11f7ec1e91d729f8d22bf630	COPY	`--chown=1000:1000 /opt/tritonserver/backends/identity /opt/tritonserver/backends/identity`	01/27/2026 11:08 PM UTC
sha256:c1d2136b2a8c4a08d1907bf1cf3867092709077fce6cd92e5e2302267a73418f	COPY	`--chown=1000:1000 /opt/tritonserver/backends/pytorch /opt/tritonserver/backends/pytorch`	01/27/2026 11:08 PM UTC