ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
787232d8c1ef6db915cbfcfdb5e5e0bed45c9c9d01d227c42f8b402b482161f2CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
10/29/2025 6:18 PM UTC
f4a84d9c5388ff630b798bb615802a467d508430f6479595529d87e218e3fd7dCOPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
10/29/2025 6:18 PM UTC
4081928dcc52ce7db356211929d8ec0653c07980c6a3b935530cb7bd88f446c5ENV
NVIDIA_PRODUCT_NAME=Triton Server Base
10/29/2025 6:18 PM UTC
29afbd2d402a9532c55e326ab38e576ae45a12f44fe0862652412b44359a0b10ENV
NVIDIA_BUILD_ID=226999240
10/29/2025 6:18 PM UTC
c3f23f1d543c8c3844dd6925d4de59bff89eb8dc9c6d864bab77846e2140a394ENV
NVIDIA_TRITON_SERVER_BASE_VERSION=25.10
10/29/2025 6:18 PM UTC
8cdb0532b1168d49966931a26c433ebbc0d0850ded95ca11440280fdf86c8ddbARG
NVIDIA_BUILD_ID=226999240
10/29/2025 6:18 PM UTC
e48746c0ee6ed836bd1a226368d4167c7469b05855d1288ca575a3078d7c47f6ARG
NVIDIA_TRITON_SERVER_BASE_VERSION=25.10
10/29/2025 6:18 PM UTC
1f00f0387911e57e5ba5945292afe9d9ee2f3c4d5a28b053b4240c6eddf525a5RUN
ENABLE_MITMPROXY=0 /tmp/manage_cert.sh uninstall
10/16/2025 11:48 PM UTC
356cb716b4f3aba6b570adaa5c77e897a247157f3ae5b3341906603389e99c44ENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:
10/16/2025 11:48 PM UTC
872a8ce8a62a14099444319f567200e5bbd14f1699719137df4a4987041d2a8fRUN
ENABLE_MITMPROXY=0 export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
10/16/2025 11:48 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.