TensorRT LLM Develop

NVIDIA

Container

NVIDIA

TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

Layer	Label		Created
sha256:210aa847550a2c6816a42c8ba7226ef902fa6d10f3016fa237561a87ecf1258d	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "protobuf>=4.25.8"`	09/23/2025 4:10 PM UTC
sha256:573279a08faac33d8885fc1c0b40027b62bcf1c63f84c1c23748131935a24230	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir`	09/23/2025 4:06 PM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv && rm -rf /usr/local/lib/python3*/dist-packages/cv2/`	09/23/2025 4:05 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`PYTORCH_CUDA_ALLOC_CONF=garbage_collection_threshold:0.99999`	09/23/2025 4:05 PM UTC
sha256:2f4aa1e61d4b791dfc7436c5343db42217d7521869d0d9c5052d1cf5eecd9e8b	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE && rm install_pytorch.sh`	09/23/2025 4:05 PM UTC
sha256:cf3320c285c8ce2d4b49d853ce64d576d13bd67c89a2db99d22fa68d3a28c60f	COPY	`docker/common/install_pytorch.sh install_pytorch.sh`	09/23/2025 4:05 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`TORCH_INSTALL_TYPE=skip`	09/23/2025 4:05 PM UTC
sha256:d23e09f744cfbdb1809446020829b3c3d516ad1f61b5f4ac60f1df22acbe0d98	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c GITHUB_MIRROR=$GITHUB_MIRROR bash ./install_mpi4py.sh && rm install_mpi4py.sh`	09/23/2025 4:05 PM UTC
sha256:a4258561e16bdb0744e8c1e3d48ae189ae198951b917346af48c5a0b29bd06b5	COPY	`docker/common/install_mpi4py.sh install_mpi4py.sh`	09/23/2025 3:52 PM UTC
sha256:b0175caac9a212744ca97648b94d63d1245f1a27d26071af72cdbafa3703820c	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_polygraphy.sh && rm install_polygraphy.sh`	09/23/2025 3:52 PM UTC