ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    NVIDIA
    Triton Inference Server
    Container
    NVIDIA
    NVIDIA
    Triton Inference Server

    Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    TCMALLOC_RELEASE_RATE=200
    		08/22/2025 1:18 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
    		08/22/2025 1:18 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
    		08/22/2025 1:18 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
    		08/22/2025 1:18 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_BUILD_ID=202022692
    		08/22/2025 1:18 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_TRITON_SERVER_SDK_VERSION=25.08
    		08/22/2025 1:18 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NVIDIA_BUILD_ID=202022692
    		08/22/2025 1:18 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NVIDIA_TRITON_SERVER_SDK_VERSION=25.08
    		08/22/2025 1:18 AM UTC
    sha256:16951e1381aef029c10d23ddeacd425a1b88715fb2a7dbe4037732718340baf7RUN
    DCGM_VERSION=4.4.0-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r25.08 TARGETPLATFORM=linux/arm64 TRITON_ENABLE_GPU=ON sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new &&
  mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
    		08/22/2025 1:18 AM UTC
    sha256:318e1ef33b8c13a9f583ad8fdbe9e36991ca6e62f7ac2a5e6c4f409c2782341aCOPY
    docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
    		08/22/2025 1:18 AM UTC
    ...