TensorRT LLM Develop

NVIDIA

Container

NVIDIA

TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

Layer	Label		Created
sha256:283f42b6fc4bb259f2cc5cd0360620c5abefaca94352856c5caac164c5c680cd	RUN	`GITHUB_MIRROR= PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "h11>=0.16" "tornado>=6.5.0" "setuptools>=78.1.1,<80"`	05/21/2025 2:52 PM UTC
sha256:3a089bc4a2d2a156f88c43b7ca2b55a8966ca603f3c0e018c63e932154d309fc	RUN	`GITHUB_MIRROR= PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir`	05/21/2025 2:45 PM UTC
sha256:d94b8bfdf40e2a897e0c71e2afa0c68117b72a5ffccea0dadb03bf63af099d43	RUN	`GITHUB_MIRROR= PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv && rm -rf /usr/local/lib/python3*/dist-packages/cv2/`	05/21/2025 2:43 PM UTC
sha256:af555eea7ab7077b437863e5e274c2ff5574b2b0f004803600eceacecaa428a7	RUN	`GITHUB_MIRROR= PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE && rm install_pytorch.sh`	05/21/2025 2:42 PM UTC
sha256:50805268a4b3de37f38fd0f8edd2e7f56e03c98b1407029823b95323039307c2	COPY	`docker/common/install_pytorch.sh install_pytorch.sh`	05/21/2025 2:42 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`TORCH_INSTALL_TYPE=skip`	05/21/2025 2:42 PM UTC
sha256:785d8fb1fd00980c945f46ac8aa5f2432791509f562063f8ca1d7747556aa271	RUN	`GITHUB_MIRROR= PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_mpi4py.sh && rm install_mpi4py.sh`	05/21/2025 2:42 PM UTC
sha256:e98fba563d8c5e9bf2f89521b5c7ddb934febff72836e03fb3e1e25b1b33699c	COPY	`docker/common/install_mpi4py.sh install_mpi4py.sh`	05/21/2025 2:09 PM UTC
sha256:9724c5e7ba8a9fa74d9b170ada76736b425775404edbf124a17075d326a2c83f	RUN	`GITHUB_MIRROR= PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_polygraphy.sh && rm install_polygraphy.sh`	05/21/2025 2:09 PM UTC
sha256:fa66086de7fdf1328d5924f20dbf3ceef8f8d11d48712cbec176ae57bc807142	COPY	`docker/common/install_polygraphy.sh install_polygraphy.sh`	05/21/2025 2:06 PM UTC