ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT LLM Develop
Container
NVIDIA
NVIDIA
TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
sha256:283f42b6fc4bb259f2cc5cd0360620c5abefaca94352856c5caac164c5c680cdRUN
GITHUB_MIRROR= PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "h11>=0.16" "tornado>=6.5.0" "setuptools>=78.1.1,<80"
05/21/2025 2:52 PM UTC
sha256:3a089bc4a2d2a156f88c43b7ca2b55a8966ca603f3c0e018c63e932154d309fcRUN
GITHUB_MIRROR= PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir
05/21/2025 2:45 PM UTC
sha256:d94b8bfdf40e2a897e0c71e2afa0c68117b72a5ffccea0dadb03bf63af099d43RUN
GITHUB_MIRROR= PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv &&
  rm -rf /usr/local/lib/python3*/dist-packages/cv2/
05/21/2025 2:43 PM UTC
sha256:af555eea7ab7077b437863e5e274c2ff5574b2b0f004803600eceacecaa428a7RUN
GITHUB_MIRROR= PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE &&
  rm install_pytorch.sh
05/21/2025 2:42 PM UTC
sha256:50805268a4b3de37f38fd0f8edd2e7f56e03c98b1407029823b95323039307c2COPY
docker/common/install_pytorch.sh install_pytorch.sh
05/21/2025 2:42 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TORCH_INSTALL_TYPE=skip
05/21/2025 2:42 PM UTC
sha256:785d8fb1fd00980c945f46ac8aa5f2432791509f562063f8ca1d7747556aa271RUN
GITHUB_MIRROR= PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_mpi4py.sh &&
  rm install_mpi4py.sh
05/21/2025 2:42 PM UTC
sha256:e98fba563d8c5e9bf2f89521b5c7ddb934febff72836e03fb3e1e25b1b33699cCOPY
docker/common/install_mpi4py.sh install_mpi4py.sh
05/21/2025 2:09 PM UTC
sha256:9724c5e7ba8a9fa74d9b170ada76736b425775404edbf124a17075d326a2c83fRUN
GITHUB_MIRROR= PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_polygraphy.sh &&
  rm install_polygraphy.sh
05/21/2025 2:09 PM UTC
sha256:fa66086de7fdf1328d5924f20dbf3ceef8f8d11d48712cbec176ae57bc807142COPY
docker/common/install_polygraphy.sh install_polygraphy.sh
05/21/2025 2:06 PM UTC
...