ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
e50aad35c3557dcd5a95cf99222a90f46c6df01e3d6969fcb23ee3936f74ac0bCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
02/13/2026 6:43 PM UTC
24af413daf700a64de9bf815c891de0d47707f7f14635f6ef700d0197d95eaa8ENV
LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
02/13/2026 6:43 PM UTC
4e57e2f6a8c23677693e6c94442130ea75d25a2d45b1e721e0ae9b74295bdd9bENV
LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
02/13/2026 6:43 PM UTC
e5b00199bfc602efd797da312d96bf2db8d36b19b2ea6ee6009318e11584a814ENV
PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
02/13/2026 6:43 PM UTC
a4d8e74a184cc8d46f8fe02f9e78fcc4dfb07f49416fafa602093a5175b1ea2fENV
NVIDIA_BUILD_ID=267832308
02/13/2026 6:43 PM UTC
6042cad16c434da500956cf00363831b171e351ed8143a7e339667436eb98b52ENV
NVIDIA_TRITON_SERVER_SDK_VERSION=26.02
02/13/2026 6:43 PM UTC
0ea532dbe8fbf329742c8fe95e7fe158452320db7d3d3d85bfe89fc94d11aafeARG
NVIDIA_BUILD_ID=267832308
02/13/2026 6:43 PM UTC
1454ea7c9e7a6e2283464f286b0e5f585ca2edacfbdcfb56e4f723b59257387dARG
NVIDIA_TRITON_SERVER_SDK_VERSION=26.02
02/13/2026 6:43 PM UTC
b0a0ef9d6e2f67f8c8d0270217dda61d1f026ca7361e1d6675022d240a6f2e8eRUN
DCGM_VERSION=4.5.2-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r26.02 TARGETPLATFORM=linux/arm64 TRITON_ENABLE_GPU=ON TRITON_MODEL_ANALYZER_REPO_TAG=r26.02 TRITON_MODEL_ANALYZER_REPO=https://github.com/triton-inference-server/model_analyzer@r26.02 sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new &&
  mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
02/13/2026 6:43 PM UTC
e04a0a6d1f9ccc6bf4a6642d05b4a8e56a3264ce16ff579ab741e72749cd53aaCOPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
02/13/2026 6:43 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.