Triton Inference Server

NVIDIA

Container

NVIDIA

Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported

Layer	Label		Created
35e1bfe2032180f5742094dae3ec0e3d53ed376890aab88b1ae0fa2ce38a16c7	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /opt/tritonserver`	11/20/2025 9:24 PM UTC
6ce9543d26218cd0b3269ae0f73e37b67d7716372ee4a63f5dd133a5a56412c3	RUN	`TRITON_VERSION=2.63.0 TRITON_CONTAINER_VERSION=25.11 find /opt/tritonserver/python -maxdepth 1 -type f -name "tritonserver-.whl" \| xargs -I {} pip install --upgrade {}[all] && find /opt/tritonserver/python -maxdepth 1 -type f -name "tritonfrontend-.whl" \| xargs -I {} pip install --upgrade {}[all]`	11/20/2025 9:24 PM UTC
607e7eb9a58aa008d88755ce872ea6ad73ce59a33195e9f621d51c481bf2ac87	COPY	`--chown=1000:1000 NVIDIA_Deep_Learning_Container_License.pdf .`	11/20/2025 9:24 PM UTC
d206f1727d469458602f9fdf54754cd4adefc6695e05bcbe7f7fe0946ec788c0	WORKDIR	`/opt/tritonserver`	11/20/2025 9:24 PM UTC
db6a9867ad01a9156fc999fe11269c9be9c403ff2da69a51438d5f81ca504364	COPY	`--chown=1000:1000 build/install tritonserver`	11/20/2025 9:24 PM UTC
98f0d2a2fe824f35584c3d911b2680f555ae31775abbf3309b80e7803b975756	WORKDIR	`/opt`	11/20/2025 9:24 PM UTC
5aac51843e5b79cb58b8ec5c80ecc8ef6eaae045561348baffcdcbcc2f13c521	LABEL	`com.nvidia.build.ref=cc221d499acd606668317ca89e5a056a30ec4c90`	11/20/2025 9:24 PM UTC
d51df7247230c0e4b26b1f74eaeaa7143f9956723d6aa93f19dbfa1489791a15	LABEL	`com.nvidia.build.id=236082569`	11/20/2025 9:24 PM UTC
66236294947735a30b09b1fe5b8a8ff09d9986bd69089a52ea23f269b776c3f9	ENV	`NVIDIA_BUILD_ID=236082569`	11/20/2025 9:24 PM UTC
5cce9b02f2567b9c15d298f6be28c37581aebcb5a92a725d5fcfc91ee626655d	COPY	`docker/entrypoint.d/ /opt/nvidia/entrypoint.d/`	11/20/2025 9:24 PM UTC