ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    Triton Inference Server
    Container
    NVIDIA
    Triton Inference Server

    Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

  • LayerLabelCreated
    sha256:89206e0418aa5135a441e670d888f1443cef451fa16e1dd8a017868b6735b0d7COPY
    docker/sagemaker/serve /usr/bin/.
    		08/26/2026 6:59 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.amazonaws.sagemaker.capabilities.multi-models=true
    		08/26/2026 6:59 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.amazonaws.sagemaker.capabilities.accept-bind-to-port=true
    		08/26/2026 6:59 PM UTC
    sha256:9f0f4893fa0d6aa3e40e35ef1ac9920050dcb359b2bce954e5420e03adc5322fRUN
    TRITON_VERSION=2.72.0 TRITON_CONTAINER_VERSION=26.08 /bin/bash -c pip3 install -r python/openai/requirements.txt
    		08/26/2026 6:59 PM UTC
    sha256:483a9d40512a412f84cbdb57bfd7e4d8b5aa9a34290d29e90de9d404a0794227RUN
    TRITON_VERSION=2.72.0 TRITON_CONTAINER_VERSION=26.08 /bin/bash -c set -e; for pkg in tritonserver tritonfrontend; do wheels=$(find /opt/tritonserver/python -maxdepth 1 -type f -name "${pkg}-*.whl"); if [ -z "$wheels" ]; then echo "ERROR: ${pkg}-*.whl missing from /opt/tritonserver/python -- build did not stage the wheel into the image" >&2; exit 1; fi; printf '%s\n' "$wheels" | xargs -I {} pip install --upgrade "{}[all]"; done
    		08/26/2026 6:59 PM UTC
    sha256:d8745e9242adf9ff67f8d573d58629ee0f3dc9db89e0e630b6bb01f43ab4341dCOPY
    NVIDIA_Deep_Learning_Container_License.pdf .
    		08/26/2026 6:59 PM UTC
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1WORKDIR
    /opt/tritonserver
    		08/26/2026 6:59 PM UTC
    sha256:e7fc2b290c5cc8047c2a822550d4f3a87e9a14474a68bdf86b06229cae2a3a95COPY
    build/install tritonserver
    		08/26/2026 6:59 PM UTC
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1WORKDIR
    /opt
    		08/26/2026 6:59 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.ref=359b27005779277f7bc7781d5785f5669fe322cc
    		08/26/2026 6:59 PM UTC
    ...

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.