TensorRT LLM Develop

NVIDIA

Container

NVIDIA

TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

Layer	Label		Created
sha256:ce5d5d7d278a32124d62305edbf9ab545a78e7c267fc7acc172f5e8f5eafa0a5	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "protobuf>=4.25.8"`	08/15/2025 8:39 AM UTC
sha256:28e3b47bd9ee74e114e556abf99cef2d9ace30a022bd6ab90e5bbd8d93d22f72	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir`	08/15/2025 8:39 AM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv && rm -rf /usr/local/lib/python3*/dist-packages/cv2/`	08/15/2025 8:39 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`PYTORCH_CUDA_ALLOC_CONF=garbage_collection_threshold:0.99999`	08/15/2025 8:39 AM UTC
sha256:89889961be9c7eea52f1932c13885d5c5b7c2255c520d2193a6c90578ddca9e0	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE && rm install_pytorch.sh`	08/15/2025 8:39 AM UTC
sha256:13ee63dba7833c60939169f12b1c1ff4ca834b9399a30ac4e8a8873f55026ba1	COPY	`docker/common/install_pytorch.sh install_pytorch.sh`	08/15/2025 8:39 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`TORCH_INSTALL_TYPE=skip`	08/15/2025 8:39 AM UTC
sha256:778e9690edd7a0d6a178c0c485ec882739409ee4a9510d91365a3389f132cfef	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c GITHUB_MIRROR=$GITHUB_MIRROR bash ./install_mpi4py.sh && rm install_mpi4py.sh`	08/15/2025 8:39 AM UTC
sha256:8939c7eef79d2a7845d41d72c9e22fe131fb59666214b5f0222950b4197e3461	COPY	`docker/common/install_mpi4py.sh install_mpi4py.sh`	08/15/2025 8:37 AM UTC
sha256:ad699a70e87ab87ae4c619cf2bdf06e81277f80279ef52932f40b479fe155fc5	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_polygraphy.sh && rm install_polygraphy.sh`	08/15/2025 8:37 AM UTC