NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

LayerLabelCreated
f9a9efa53c12570275562bd5000587608778394e72a571fb93cd1563b537e45cCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
06/24/2026 11:15 PM UTC
362cdfbcf2393f8a1ce7dfdeea1b904099ea388d686275b4dc880d3fbe4e63f3ENV
LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
06/24/2026 11:15 PM UTC
9986ea40ba7bc9e806d78037f2b23ca9829b42f9235becefae282571da9ccbb1ENV
LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
06/24/2026 11:15 PM UTC
36e19717b9faf8e217bb1a771d784b924f44ac8b14b5e7400efa60d183c94b5cENV
PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
06/24/2026 11:15 PM UTC
13519f4abcb64d6be6bd21f4ba960a9d36ceca900b4c2f72050e1529d19262d7ENV
NVIDIA_BUILD_ID=347409142
06/24/2026 11:15 PM UTC
38d58396ac53f07355305d22b0660148c178a749ff7fbac9bf87f67f2d81eb4fENV
NVIDIA_TRITON_SERVER_SDK_VERSION=26.06
06/24/2026 11:15 PM UTC
95aa886956366d4bff8a1998ad37fb3a002b26ce726da4f3ebff504867dac769ARG
NVIDIA_BUILD_ID=347409142
06/24/2026 11:15 PM UTC
87313815f7c8a6868f0fc499aa27c03391d0b87658f48bf10a014a2379a3f590ARG
NVIDIA_TRITON_SERVER_SDK_VERSION=26.06
06/24/2026 11:15 PM UTC
a618ce81644157be9bf98488b9c98e19d8c542a1b32a8418ada84d3b05a0b842RUN
DCGM_VERSION=4.5.3-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r26.06 TARGETPLATFORM=linux/amd64 TRITON_ENABLE_GPU=ON TRITON_MODEL_ANALYZER_REPO_TAG=r26.06 TRITON_MODEL_ANALYZER_REPO=https://github.com/triton-inference-server/model_analyzer@r26.06 sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new &&
  mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
06/24/2026 11:15 PM UTC
cbd4cbde2fda76a6e388e577dfc0838a2ee963aa7fb96d4f4fe141de3d086eb9COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
06/24/2026 11:15 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.