Triton Inference Server

NVIDIA

Container

NVIDIA

Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported

Layer	Label		Created
6c29ac6ae4823d9796969504e961320a792258470cc3e185ccff1a4bbbe8289a	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /opt/tritonserver`	10/29/2025 6:22 PM UTC
f5149623ef09e4ea21b74b302fdadf6a51385c48ba35409d697b471fd32327e4	RUN	`TRITON_VERSION=2.62.0 TRITON_CONTAINER_VERSION=25.10 find /opt/tritonserver/python -maxdepth 1 -type f -name "tritonserver-.whl" \| xargs -I {} pip install --upgrade {}[all] && find /opt/tritonserver/python -maxdepth 1 -type f -name "tritonfrontend-.whl" \| xargs -I {} pip install --upgrade {}[all]`	10/29/2025 6:22 PM UTC
141a6d50725ca83330e4336d20b1773dce31396cb42191730899c391c80c4e66	COPY	`--chown=1000:1000 NVIDIA_Deep_Learning_Container_License.pdf .`	10/29/2025 6:22 PM UTC
138a61276a287d4a246b45121efc38a1d3022df54a01916efaaa549ff7c8fcee	WORKDIR	`/opt/tritonserver`	10/29/2025 6:22 PM UTC
0bc1b10f56cde02e9b69648d3f5a0c0d4bc0b7c478939eb911e87988606834c0	COPY	`--chown=1000:1000 build/install tritonserver`	10/29/2025 6:22 PM UTC
85785c258de06c96ed2d572a639ffe4b384a13b2241432d32e678751643bc7d8	WORKDIR	`/opt`	10/29/2025 4:22 PM UTC
ba2235aad1436bb0cf3713e80b7f4174f2966216583dd003c5526d205a7f4bbe	LABEL	`com.nvidia.build.ref=374194f9f494599a028053e9d3f6771b7e37ef76`	10/29/2025 4:22 PM UTC
4904805e2ad18ca85b2080838172e32f956a103e5c98fb471f34ddfb5e96ccbd	LABEL	`com.nvidia.build.id=226999240`	10/29/2025 4:22 PM UTC
2cfd9acaeececbe8044f0894521568ee83e91d034f0943b480c1c266cf02539e	ENV	`NVIDIA_BUILD_ID=226999240`	10/29/2025 4:22 PM UTC
649a03590d9a90c1969f8e38519177279eaa5dd19686cae15d38e212c3103380	COPY	`docker/entrypoint.d/ /opt/nvidia/entrypoint.d/`	10/29/2025 4:22 PM UTC