Triton Inference Server

NVIDIA

Container

NVIDIA

Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported

Layer	Label		Created
c010f0851df9b7a2a679f12a9054140f84561fcf387ec0fa930813976a171c32	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /opt/tritonserver`	10/03/2025 5:31 PM UTC
80157739fabfc4adad1b8426b8a0b83d3de14db10bd9be2fad4d10054c1c0ce2	RUN	`TRITON_VERSION=2.61.0 TRITON_CONTAINER_VERSION=25.09 find /opt/tritonserver/python -maxdepth 1 -type f -name "tritonserver-.whl" \| xargs -I {} pip install --upgrade {}[all] && find /opt/tritonserver/python -maxdepth 1 -type f -name "tritonfrontend-.whl" \| xargs -I {} pip install --upgrade {}[all]`	10/03/2025 5:30 PM UTC
27e25d0e2a133f823c69e5bd22c8a1895a29eba55df7208ef1dc52e9c20b9972	COPY	`--chown=1000:1000 NVIDIA_Deep_Learning_Container_License.pdf .`	10/03/2025 5:30 PM UTC
86103c9fc186bf20ce1a5a6cd3279fc93956d58e79e535e86071823380cf743b	WORKDIR	`/opt/tritonserver`	10/03/2025 5:30 PM UTC
5b6b6ddebfbf892318947b743cf9492390ead7095cdcc413b47523460e9dd178	COPY	`--chown=1000:1000 build/install tritonserver`	10/03/2025 5:30 PM UTC
3b73ba9ed832a1ff7cb5226ca817e6aa304c3c9a5a7e5677b87ded487e40ee39	WORKDIR	`/opt`	10/03/2025 5:30 PM UTC
6e3d15bb3357a1f14d89e30c318d8d33b4b40db05eece9e426bf7a7eeb74398b	LABEL	`com.nvidia.build.ref=e083729f123ef30ce5afc235aec51c3bcacb5c1a`	10/03/2025 5:30 PM UTC
ae959960c205e856991f2cf01bde00127d42655b7fccc2624138f612ee335d0a	LABEL	`com.nvidia.build.id=216994193`	10/03/2025 5:30 PM UTC
48c6723a91e3040e7631d944e211931ab033eb51af00b4dadc97b1aea9aac1ad	ENV	`NVIDIA_BUILD_ID=216994193`	10/03/2025 5:30 PM UTC
7765230c19b7b93edd7c5c91114b527696d0b967c8539cf2e16aac6f4aa9b02a	COPY	`docker/entrypoint.d/ /opt/nvidia/entrypoint.d/`	10/03/2025 5:30 PM UTC