TensorRT LLM Develop

NVIDIA

Container

NVIDIA

TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

Layer	Label		Created
sha256:cbb3c3279957312ceabc1d16009b26ad98ef749861b9f3cca4ed0a7ab5c8fdb4	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "h11>=0.16" "tornado>=6.5.0" "setuptools>=78.1.1,<80"`	06/29/2025 12:20 PM UTC
sha256:5482ad3155aeebee9b79286c446d668bb29064014a12f666be58cd8733407c64	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_deep_ep.sh && rm install_deep_ep.sh`	06/29/2025 12:20 PM UTC
sha256:341a8877ac0eacd7df4ead697547c0a236d79805cf0fe9f7e787368b2ab67e00	COPY	`docker/common/install_deep_ep.sh install_deep_ep.sh`	06/29/2025 12:16 PM UTC
sha256:24b835534e6bd6cc3e56b75a356c4f323c937c8345728580c06d53c32adfdcd1	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir`	06/29/2025 12:16 PM UTC
sha256:3839d963d7dfcf897de480cc5cdf6f19562c7120d4eadf3ac6ca7c3df7755348	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv && rm -rf /usr/local/lib/python3*/dist-packages/cv2/`	06/29/2025 12:16 PM UTC
sha256:5019a1b968629abc8bcf0caa79ee80e6043ef2a2e523934040e6c463a1edc741	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE && rm install_pytorch.sh`	06/29/2025 12:16 PM UTC
sha256:fbbb46cbbd261b6d1347b0dd1302416789acc9066b77f9d20900ecdd84281a78	COPY	`docker/common/install_pytorch.sh install_pytorch.sh`	06/29/2025 12:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`TORCH_INSTALL_TYPE=skip`	06/29/2025 12:16 PM UTC
sha256:6f3f79f8c238c0e1c6dd354df7f31a5cfcbf8f4b1000c47108af4a6abc48e3ae	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_mpi4py.sh && rm install_mpi4py.sh`	06/29/2025 12:16 PM UTC
sha256:fba8e0b0a6f5bfc17e7045903e0db63c10507b49f395a5eb188d4c2a214bf4a4	COPY	`docker/common/install_mpi4py.sh install_mpi4py.sh`	06/29/2025 12:15 PM UTC