TensorRT LLM Develop

NVIDIA

Container

NVIDIA

TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

Layer	Label		Created
sha256:4faf6320d488c0c012776fa8bf13ea02122a84276d65389ff977c72fead2392b	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "protobuf>=4.25.8"`	08/29/2025 3:02 PM UTC
sha256:fa9745a0df2b42a611fc00cfdbbd1d7c96c94587009e198a7e124d97c74fdd22	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv && rm -rf /usr/local/lib/python3*/dist-packages/cv2/ && pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir`	08/29/2025 3:00 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`PYTORCH_CUDA_ALLOC_CONF=garbage_collection_threshold:0.99999`	08/29/2025 2:55 PM UTC
sha256:a8fd31e1e3f9aa4c09f568a24a01ad4c76211b8dd8b59964af492683cd24e361	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE && rm install_pytorch.sh`	08/29/2025 2:55 PM UTC
sha256:c7127a724c9e8472d578ffbc0d56ff01f88c7dd6149b9935902f492ee033db83	COPY	`docker/common/install_pytorch.sh install_pytorch.sh`	08/29/2025 2:55 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`TORCH_INSTALL_TYPE=skip`	08/29/2025 2:55 PM UTC
sha256:06c45ada25ddc1950040b616ac5e93f4688144e51427061c56a8acce3f1cca1c	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c GITHUB_MIRROR=$GITHUB_MIRROR bash ./install_mpi4py.sh && rm install_mpi4py.sh`	08/29/2025 2:55 PM UTC
sha256:062f672dcea158490db849ba8898fafc561fe75a5ab3a7e1d3dc62a10d38de15	COPY	`docker/common/install_mpi4py.sh install_mpi4py.sh`	08/29/2025 2:51 PM UTC
sha256:5f0b9930eac61c19090f654ed50e53e6906f97b7e8d5efa040e072709b1b3531	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_polygraphy.sh && rm install_polygraphy.sh`	08/29/2025 2:51 PM UTC
sha256:e0db63daed96cfa90fb4a38f055dd6d59b2361e5a44b42b42ea33a4fcf3c803b	COPY	`docker/common/install_polygraphy.sh install_polygraphy.sh`	08/29/2025 2:49 PM UTC