TensorRT LLM Release

NVIDIA

Container

NVIDIA

TensorRT LLM Release

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

Layer	Label		Created
sha256:130cc4dc1a98df12bf4054a9f92d45d82c18b09107e336a8cf321457478aa4fc	RUN	`SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build GIT_COMMIT=f42a6cbae01fe6e5cddd0fa50f2f69f591f62079 TRT_LLM_VER=1.3.0rc2 TARGETARCH=amd64 /bin/bash -c bash /tmp/generate_container_oss_attribution.sh "release" "${TRT_LLM_VER}" "${TARGETARCH}" && rm /tmp/generate_container_oss_attribution.sh`	01/30/2026 8:13 PM UTC
sha256:b91551080f56971d0656f3a3618dbea54a3f420ab15d76556fd8a67a6fa3f938	COPY	`scripts/generate_container_oss_attribution.sh /tmp/generate_container_oss_attribution.sh`	01/30/2026 8:13 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`TRT_LLM_GIT_COMMIT=f42a6cbae01fe6e5cddd0fa50f2f69f591f62079 TRT_LLM_VERSION=1.3.0rc2`	01/30/2026 8:13 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`TARGETARCH=amd64`	01/30/2026 8:13 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`TRT_LLM_VER=1.3.0rc2`	01/30/2026 8:13 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`GIT_COMMIT=f42a6cbae01fe6e5cddd0fa50f2f69f591f62079`	01/30/2026 8:13 PM UTC
sha256:09a16fa27e8f80af4dc6bc2807072b1d366cf24483d5487054a2b75b48f704ef	RUN	`SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build /bin/bash -c chmod -R a+w examples && rm -v benchmarks/cpp/bertBenchmark.cpp benchmarks/cpp/gptManagerBenchmark.cpp benchmarks/cpp/disaggServerBenchmark.cpp benchmarks/cpp/CMakeLists.txt && rm -rf /root/.cache/pip`	01/30/2026 8:13 PM UTC
sha256:7b2568cb0488b9bac2548dcf763cab6e8c0d97535dc51070e9f31642875d705d	COPY	`examples examples`	01/30/2026 8:13 PM UTC
sha256:e93a83954121cd9cb0b902bb18081e644bad1058e7e1c8892d532d5cfbcd9146	COPY	`/src/tensorrt_llm/cpp/build/benchmarks/bertBenchmark /src/tensorrt_llm/cpp/build/benchmarks/gptManagerBenchmark /src/tensorrt_llm/cpp/build/benchmarks/disaggServerBenchmark benchmarks/cpp/`	01/30/2026 8:13 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build`	01/30/2026 8:13 PM UTC