TensorRT LLM Develop

NVIDIA

Container

NVIDIA

TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

Layer	Label		Created
sha256:0a9c183820e7371b214406c02db1309b2c3d8521c9d6f11d4e5e90954456c4f2	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --no-cache-dir -r /tmp/constraints.txt && rm /tmp/constraints.txt`	12/19/2025 2:33 AM UTC
sha256:bcefe12b1d566e6507a2fd7e0ed95ceddba7ab0e2009a723afa0f7f799118dab	COPY	`constraints.txt /tmp/constraints.txt`	12/19/2025 2:31 AM UTC
sha256:6df4131d2483f279b9059246c0aa9f8f02e8c9c85dd0cb22ff30c0bf8b3dd32c	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install.sh --opencv && rm install.sh`	12/19/2025 2:31 AM UTC
sha256:55ab854ec9ce98f234367d30ef5dfb88458a76a4c333f463dafa7824f435a51e	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c TORCH_INSTALL_TYPE=${TORCH_INSTALL_TYPE} bash ./install.sh --pytorch && rm install_pytorch.sh`	12/19/2025 2:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`TORCH_INSTALL_TYPE=skip`	12/19/2025 2:29 AM UTC
sha256:83a3aae1fd95f2fe423f1ab05639162c59198fe0e3646b66d228ad633f66727e	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c GITHUB_MIRROR=${GITHUB_MIRROR} bash ./install.sh --mpi4py && rm install_mpi4py.sh`	12/19/2025 2:29 AM UTC
sha256:6cb6adbb36d1b03f281c7976facb070eb0a65386093c63437fb39c043f0af37b	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install.sh --polygraphy && rm install_polygraphy.sh`	12/19/2025 2:24 AM UTC
sha256:36b27e42e210aba705d63f39275cf9fa8962e46b74a53978a3f92a4e98cf5cff	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c TRT_VER=${TRT_VER} CUDA_VER=${CUDA_VER} CUDNN_VER=${CUDNN_VER} NCCL_VER=${NCCL_VER} CUBLAS_VER=${CUBLAS_VER} bash ./install.sh --tensorrt && rm install_tensorrt.sh`	12/19/2025 2:24 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`CUBLAS_VER`	12/19/2025 2:21 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NCCL_VER`	12/19/2025 2:21 AM UTC