TensorRT LLM Develop

NVIDIA

Container

NVIDIA

TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

Layer	Label		Created
sha256:52b4a8961e8a37012a800c09dbc5fec3ee4a050f2982fc43cee5d7854946386b	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "h11>=0.16" "tornado>=6.5.0" "setuptools>=78.1.1,<80"`	07/06/2025 9:43 PM UTC
sha256:9faa1efa9f1265e1070582d91d9bafe93e7bf6ba7b9d486748ac9f118b2ee405	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_deep_ep.sh && rm install_deep_ep.sh`	07/06/2025 9:43 PM UTC
sha256:4bccd66f98eb3be510ee5ac5c0afca7eb7df9dcd48a1d53e751763eac1ce069a	COPY	`docker/common/install_deep_ep.sh install_deep_ep.sh`	07/06/2025 9:38 PM UTC
sha256:e15e6173860146ce10d56058f6da4009aded170dbcd61bc51c017ed7746dd458	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir`	07/06/2025 9:38 PM UTC
sha256:851f4d63353849aa25d019c1374e3d56ebe4dec59c0103defcba132b12a2f860	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv && rm -rf /usr/local/lib/python3*/dist-packages/cv2/`	07/06/2025 9:38 PM UTC
sha256:dfe5fe791bddf7d1e0fe07bea23ad0f488f8867f94f9659e0d5336a591ad2195	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE && rm install_pytorch.sh`	07/06/2025 9:38 PM UTC
sha256:5443e6c460a62b4c95b9862346114a2f53d3f6dbf8303b68372ca0edbf697c8d	COPY	`docker/common/install_pytorch.sh install_pytorch.sh`	07/06/2025 9:38 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`TORCH_INSTALL_TYPE=skip`	07/06/2025 9:38 PM UTC
sha256:38af75851d5920f75868a49d0833aaa3adb95ada2aac2bec156aa29647fe024d	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_mpi4py.sh && rm install_mpi4py.sh`	07/06/2025 9:38 PM UTC
sha256:a99e2e937a0ff8213e0f1dbb1e804d7edb72546bb5041878e57727768170d85f	COPY	`docker/common/install_mpi4py.sh install_mpi4py.sh`	07/06/2025 9:38 PM UTC