Triton Inference Server

NVIDIA

Container

NVIDIA

Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:07f854de5f1133646db0fcfe15c4eea54784ba5808a2890b2be8de01b7f37642	COPY	`/usr/bin/serve /usr/bin/.`	07/25/2026 8:17 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.amazonaws.sagemaker.capabilities.accept-bind-to-port=true`	07/25/2026 8:17 PM UTC
sha256:a426bf33406e1da097d90cf7ac9074a2d8cffcb6b471e2a6b53f862f20e2848d	COPY	`/opt/tritonserver/caches/local /opt/tritonserver/caches/local`	07/25/2026 8:17 PM UTC
sha256:3c6ab0d7bd393d134ef4dfc38d0580c2bfababa7ede4e90ff380e8327e874068	COPY	`/opt/tritonserver/repoagents/checksum /opt/tritonserver/repoagents/checksum`	07/25/2026 8:17 PM UTC
sha256:22d3bed41d04e411de37f3c6cb47ba4b493aaee2aadae5469b1bb292a400a880	COPY	`/opt/tritonserver/backends/python /opt/tritonserver/backends/python`	07/25/2026 8:17 PM UTC
sha256:e9097c1ffb84129524ac33c01ed2293333961ed05e456194c24adad386b40362	COPY	`/opt/tritonserver/backends/identity /opt/tritonserver/backends/identity`	07/25/2026 8:17 PM UTC
sha256:cd229f5e6fbe1b190416ca0f6d2d1a65a43c4a6fd76430321c9fe3d9364340b9	COPY	`/opt/tritonserver/backends/pytorch /opt/tritonserver/backends/pytorch`	07/25/2026 8:17 PM UTC
sha256:46a477ea8b72216d0be1ec8ced9b679c4eb8e87e98924c06cb783dbeba6fd09f	COPY	`/opt/tritonserver/include include/`	07/25/2026 8:17 PM UTC
sha256:920e9be9e74e148f26c2a3966c27bc25c8ccf799084e38e81374077596b83143	COPY	`/opt/tritonserver/lib lib/`	07/25/2026 8:17 PM UTC
sha256:7eacd62d2d2c9f1890a1bbcecbb5c54401711b2e48f27577a5ad0b3f6de70535	COPY	`/opt/tritonserver/bin bin/`	07/25/2026 8:17 PM UTC