Triton Inference Server

NVIDIA

Container

NVIDIA

Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported

Layer	Label		Created
889949e8b622a322eeae8c9b1bafbdda0e4b5ae8e1a6fe66dc277060a0470b11	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	01/27/2026 11:16 PM UTC
77ff11739396fe3e623892c9d997e145354f200cfa840c948ae3a0be771af823	ENV	`LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64`	01/27/2026 11:16 PM UTC
fb9e6f2d6f940eae23a319c06410aa75de52d9c0c6d6b7890dd1753098ae9c55	ENV	`LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64`	01/27/2026 11:16 PM UTC
76bcff2a4c9106873c151e4d94018859132b3b28f746a766cb0850e006911adc	ENV	`PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin`	01/27/2026 11:16 PM UTC
5100e0defff0f94d9f537643e94a4ba6de9c4d7b340492f243cc2ae202c3a3ea	ENV	`NVIDIA_BUILD_ID=259443916`	01/27/2026 11:16 PM UTC
bd71c02f77fd29388d54fc32b57c30f5cb78ff938aa74eb331ab67ae1a898bcc	ENV	`NVIDIA_TRITON_SERVER_SDK_VERSION=26.01`	01/27/2026 11:16 PM UTC
e420aee2b97f6bf5b363ffd9469edc254c96688a29e31377f59bd36950efe6be	ARG	`NVIDIA_BUILD_ID=259443916`	01/27/2026 11:16 PM UTC
91e1163c1570a68a8af6a9d8b17bea723b949687dbdcc26d0115449d0b893881	ARG	`NVIDIA_TRITON_SERVER_SDK_VERSION=26.01`	01/27/2026 11:16 PM UTC
4f7236e753b72e05694cd3eb89b7bd8ace7f7f4f6219a32b9c4cb500ed60cccb	RUN	DCGM_VERSION=4.4.2-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r26.01 TARGETPLATFORM=linux/amd64 TRITON_ENABLE_GPU=ON TRITON_MODEL_ANALYZER_REPO_TAG=r26.01 TRITON_MODEL_ANALYZER_REPO=https://github.com/triton-inference-server/model_analyzer@r26.01 sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt \| sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new && mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt	01/27/2026 11:16 PM UTC
fcb8c0aa351fa58daa164adccc2e57cdfae6f90c4b3b99c3d3ec7c94f773a7e6	COPY	`docker/entrypoint.d/ /opt/nvidia/entrypoint.d/`	01/27/2026 11:16 PM UTC