ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
dbe32a984a8db94dfba3dcb1008606a5d9f21851044d5764335739dc684f17ebCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /opt/tritonserver
04/24/2026 1:13 AM UTC
b937645e8e55ff3d59c11363eb3df7d26e105d7ac444dab8fb18dd591fc579b9LABEL
com.amazonaws.sagemaker.capabilities.accept-bind-to-port=true
04/24/2026 1:13 AM UTC
0dc41ebaa79cdb307f9ddda13e44054e3b2b3f3d7987e1aa475944c17cfc9c93RUN
TRITON_VERSION=2.68.0 TRITON_CONTAINER_VERSION=26.04 chown triton-server:triton-server /opt/tritonserver/caches
04/24/2026 1:13 AM UTC
3b76120bdc81c0daf323dfe0392c64509f4f3f0e9e0c668b69da15434ba45ae1COPY
--chown=1000:1000 /opt/tritonserver/caches/local /opt/tritonserver/caches/local
04/24/2026 1:13 AM UTC
666f6a3461dc791f66c77d5eb656a713420f932dbe8b394b5c09bcfc6d911151RUN
TRITON_VERSION=2.68.0 TRITON_CONTAINER_VERSION=26.04 chown triton-server:triton-server /opt/tritonserver/repoagents
04/24/2026 1:13 AM UTC
deb4ca577f73e190675f380c49d341eb90104df40370e089ad60bbc41e823d3eCOPY
--chown=1000:1000 /opt/tritonserver/repoagents/checksum /opt/tritonserver/repoagents/checksum
04/24/2026 1:13 AM UTC
86f22a5c05608b539b1913426006ec68cb6b4e82ef173f6a645f04b7f0b23939RUN
TRITON_VERSION=2.68.0 TRITON_CONTAINER_VERSION=26.04 chown triton-server:triton-server /opt/tritonserver/backends
04/24/2026 1:13 AM UTC
859e1b52242881408179e3abb671347f5044012805074b9d5321ee9440b76131COPY
--chown=1000:1000 /opt/tritonserver/backends/python /opt/tritonserver/backends/python
04/24/2026 1:13 AM UTC
640ffec29456190e97e2f297b5e474c99a8771f94b9e55cf83e525b5598ebaa5COPY
--chown=1000:1000 /opt/tritonserver/backends/identity /opt/tritonserver/backends/identity
04/24/2026 1:13 AM UTC
2621778d576fa4cc585bfe457a369cc6f584cf450ef4ed30f911df1839e3e9d6COPY
--chown=1000:1000 /opt/tritonserver/backends/pytorch /opt/tritonserver/backends/pytorch
04/24/2026 1:13 AM UTC
...