ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    TensorRT LLM Develop
    Container
    NVIDIA
    TensorRT LLM Develop

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

  • LayerLabelCreated
    sha256:579363b0efe0d7ca71d78ff514bacad02cf538f3c650d85edb7f41887bc95b60RUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install.sh --opencv &&
  bash ./install.sh --protobuf &&
  rm install.sh
    		09/15/2025 2:48 PM UTC
    sha256:cb455ff39b29f23ced7b94152f80871c2a46506f877baaab90e81036a5228e89RUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c TORCH_INSTALL_TYPE=${TORCH_INSTALL_TYPE} bash ./install.sh --pytorch &&
  rm install_pytorch.sh
    		09/15/2025 2:48 PM UTC
    sha256:6c9524e2725705901453ae1aed4ca033b4cd1e7964ca326edaa876b1f35ededbCOPY
    docker/common/install_pytorch.sh install_pytorch.sh
    		09/15/2025 2:48 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    TORCH_INSTALL_TYPE=skip
    		09/15/2025 2:48 PM UTC
    sha256:8f57066cd63fafcb1082b840531c691b21e113535cf09f4d3cf84e5e99aef827RUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c GITHUB_MIRROR=${GITHUB_MIRROR} bash ./install.sh --mpi4py &&
  rm install_mpi4py.sh
    		09/15/2025 2:48 PM UTC
    sha256:ae41c3292ede6dc5a05d283610f0c1c7e20db9057bff887aac4f5093fe257c94COPY
    docker/common/install_mpi4py.sh install_mpi4py.sh
    		09/15/2025 2:44 PM UTC
    sha256:13b2a1bae18493af78140e47952e69f673fe8fd979f312b797ca46be539507e4RUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install.sh --polygraphy &&
  rm install_polygraphy.sh
    		09/15/2025 2:44 PM UTC
    sha256:a99a692f0eb706817ce9365890b0f309c5e02690c986018b8c1cf9a471c70b77COPY
    docker/common/install_polygraphy.sh install_polygraphy.sh
    		09/15/2025 2:41 PM UTC
    sha256:ba743be550c9a43c6b415227a3a3ca63fca8ab7b03a609321145a38c95c79810RUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c TRT_VER=${TRT_VER} CUDA_VER=${CUDA_VER} CUDNN_VER=${CUDNN_VER} NCCL_VER=${NCCL_VER} CUBLAS_VER=${CUBLAS_VER} bash ./install.sh --tensorrt &&
  rm install_tensorrt.sh
    		09/15/2025 2:41 PM UTC
    sha256:1d0ab77d8339f664bf668bda49727b5e28186b14276b93ab6ee50e8ecf0c348dCOPY
    docker/common/install_tensorrt.sh install_tensorrt.sh
    		09/15/2025 2:38 PM UTC
    ...