ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT LLM Develop
Container
NVIDIA
NVIDIA
TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
sha256:0f60869c650d2adc0180abc40ebc94fd7629edd6cef15b3c5e2145dd2ef7d3f9RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "h11>=0.16" "tornado>=6.5.0" "setuptools>=78.1.1,<80"
06/18/2025 6:56 PM UTC
sha256:bd39439bda26f48f55fbf562dd3beafa5f15aca1bc70cce2580ff47166515c23RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir
06/18/2025 6:55 PM UTC
sha256:7e6d94bfd58f7ebc47450dfbde48ccda974d5d7c18043dd93fefbeb98c9a358bRUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv &&
  rm -rf /usr/local/lib/python3*/dist-packages/cv2/
06/18/2025 6:55 PM UTC
sha256:46233abbc92d07feecb0666b4e89705996eec8e696708b70bea944fc8db51e27RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE &&
  rm install_pytorch.sh
06/18/2025 6:55 PM UTC
sha256:e0c289b80c8d5bb466e8c605e7a36f63ebf128674621ef4b7f09d0fde4f3f993COPY
docker/common/install_pytorch.sh install_pytorch.sh
06/18/2025 6:55 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TORCH_INSTALL_TYPE=skip
06/18/2025 6:55 PM UTC
sha256:ab70535489fdc5ff109859372b0da5fbad35fbd9ec3536d9834a88b02330470fRUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_mpi4py.sh &&
  rm install_mpi4py.sh
06/18/2025 6:55 PM UTC
sha256:429bd4caf5c0f3867554b74223dc354ec529fc6029a505401f628a20650264b3COPY
docker/common/install_mpi4py.sh install_mpi4py.sh
06/18/2025 6:54 PM UTC
sha256:415b20c0c9460d378da397127e33ded0866ff40a7e21c6250c86c3d3ece58742RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_polygraphy.sh &&
  rm install_polygraphy.sh
06/18/2025 6:54 PM UTC
sha256:16e0701ff4d930de3ce52f4bc0132c2b134bf5b30bade472467048bc823a81c4COPY
docker/common/install_polygraphy.sh install_polygraphy.sh
06/18/2025 6:52 PM UTC
...