TensorRT LLM Develop

NVIDIA

Container

NVIDIA

TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

Layer	Label		Created
sha256:f747e919bbf0bd2cf661fc8323abf9e5cfbe710c0b4929dbf8218c0d9c5ff49f	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "protobuf>=4.25.8"`	09/09/2025 8:16 AM UTC
sha256:5268be119a6a64b9dc7a1ae8723ed7df8b3542e748f09ba1374632161acb3b2d	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv && rm -rf /usr/local/lib/python3*/dist-packages/cv2/ && pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir`	09/09/2025 8:13 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`PYTORCH_CUDA_ALLOC_CONF=garbage_collection_threshold:0.99999`	09/09/2025 8:09 AM UTC
sha256:706af8d5c61cf7832263732cee24e266208e16bbd88a457484a472ef431a1eaf	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE && rm install_pytorch.sh`	09/09/2025 8:09 AM UTC
sha256:2fb2de8105114a8d08d320d677b156c23b4ada3d69a8d1e2f5af7eb028930f2f	COPY	`docker/common/install_pytorch.sh install_pytorch.sh`	09/09/2025 8:09 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`TORCH_INSTALL_TYPE=skip`	09/09/2025 8:09 AM UTC
sha256:476c6840fad35928011227779ba3eda53d3997c376586ebd3a48659d156e0f47	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c GITHUB_MIRROR=$GITHUB_MIRROR bash ./install_mpi4py.sh && rm install_mpi4py.sh`	09/09/2025 8:09 AM UTC
sha256:9dc16522b2218220c4778be57edd768406e7fc24d69624cbe97dde887909a893	COPY	`docker/common/install_mpi4py.sh install_mpi4py.sh`	09/09/2025 8:09 AM UTC
sha256:cf08993281d449fdb3fa15d4802b093700fb342dc0e8e84eb6289f679a342747	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_polygraphy.sh && rm install_polygraphy.sh`	09/09/2025 8:09 AM UTC
sha256:bc43014f3bb4b42e1686e7750615ef7a4b88496411496373fa7d2c62a63d3630	COPY	`docker/common/install_polygraphy.sh install_polygraphy.sh`	09/09/2025 8:07 AM UTC