ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
a7205e22e052f8dcdbfa6b4d4ab6aed737177c7b75c0796a6b3abd067feebcd0CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
10/03/2025 5:58 PM UTC
32b6fde4eac98bb6e5543265072452bcd094c2a7156eea499b0d3230c62bf4aeCOPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
10/03/2025 5:58 PM UTC
d25e871849d7d182f3dfc21989df8a3a59ce6064217b39a258ccb525e737da6dENV
NVIDIA_PRODUCT_NAME=Triton Server Base
10/03/2025 5:58 PM UTC
7db56051e15b03adf5e4a127b25b2d348532e218ee420179d1900178aefdb15bENV
NVIDIA_BUILD_ID=216994146
10/03/2025 5:58 PM UTC
10254336ac0e52a3801c90a54f39f97cf8f4eeb3b21abb3bc86667363be5f160ENV
NVIDIA_TRITON_SERVER_BASE_VERSION=25.09
10/03/2025 5:58 PM UTC
fa6d453925a57e56c99039dc7105668dfbf77db20f37e47a7e9f449c436f4f66ARG
NVIDIA_BUILD_ID=216994146
10/03/2025 5:58 PM UTC
432917756d2439321d4c206d6b86be1da16fbdc4a74e936b2a591088c5852293ARG
NVIDIA_TRITON_SERVER_BASE_VERSION=25.09
10/03/2025 5:58 PM UTC
7e0dad72d46034284e72ef704828be0524347aac0bbda49b02689e19f6469d3eRUN
ENABLE_MITMPROXY=0 /tmp/manage_cert.sh uninstall
09/05/2025 8:40 PM UTC
e301b355cdf39f74140ece10aa84b8289a9cefb426df6b55f93bc59346d9e66dENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:
09/05/2025 8:40 PM UTC
8328e5f600cb6a8a625da7618c19c2503b0f9a5322d9360c4f45e9873f1eecb5RUN
ENABLE_MITMPROXY=0 export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
09/05/2025 8:40 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.