TensorRT LLM Develop

NVIDIA

Container

NVIDIA

TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

Layer	Label		Created
sha256:74aec53a5302fa5f2b53c24a8ec99145b34bfdc46bad976b8f3d60b854766df9	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "protobuf>=4.25.8"`	08/06/2025 5:45 PM UTC
sha256:131698990fd28c0730bc547452ae6947157be51d34a390772ac39816b31e2fdc	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir`	08/06/2025 5:45 PM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv && rm -rf /usr/local/lib/python3*/dist-packages/cv2/`	08/06/2025 5:41 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`PYTORCH_CUDA_ALLOC_CONF=garbage_collection_threshold:0.99999`	08/06/2025 5:41 PM UTC
sha256:ca0e3d7c8643fa70a7b97b8d60de5adc901652f450fdc2a55a00ceb01f6a9e46	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE && rm install_pytorch.sh`	08/06/2025 5:41 PM UTC
sha256:c75325dcc7b2ac59b728b98d9e9fe3b4c0ee6f882d1476b48aa9ced32c540d56	COPY	`docker/common/install_pytorch.sh install_pytorch.sh`	08/06/2025 5:41 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`TORCH_INSTALL_TYPE=skip`	08/06/2025 5:41 PM UTC
sha256:75badf0a83df480e1ecb233fb0ceca02d4c4212779278683fdaa242464c393a5	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c GITHUB_MIRROR=$GITHUB_MIRROR bash ./install_mpi4py.sh && rm install_mpi4py.sh`	08/06/2025 5:41 PM UTC
sha256:da91866a75de4f0afb312175c498be394658d5d96ef93392036ea2f21bb5d275	COPY	`docker/common/install_mpi4py.sh install_mpi4py.sh`	08/06/2025 5:39 PM UTC
sha256:063735ed41738705f4a59032be96027a9f7b2748db2b978d272543ca3de98842	RUN	`GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_polygraphy.sh && rm install_polygraphy.sh`	08/06/2025 5:39 PM UTC