TensorRT LLM Release

NVIDIA

Container

NVIDIA

TensorRT LLM Release

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

Layer	Label		Created
sha256:0c0fa404a3a6ced6bf9abd15acd8670ac45f2b86e6d1dd15d3512e62cd501171	RUN	`SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build GIT_COMMIT=e4a6c9995dacf66bab4410475a6774152f95a0a6 TRT_LLM_VER=1.2.0rc6.post1 TARGETARCH=amd64 /bin/bash -c bash /tmp/generate_container_oss_attribution.sh "release" "${TRT_LLM_VER}" "${TARGETARCH}" && rm /tmp/generate_container_oss_attribution.sh`	01/07/2026 10:22 AM UTC
sha256:2d95f666ea238638a75a6d5bac89e4c35f70c04a056d0985bf17ee3317a7b327	COPY	`scripts/generate_container_oss_attribution.sh /tmp/generate_container_oss_attribution.sh`	01/07/2026 10:22 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`TRT_LLM_GIT_COMMIT=e4a6c9995dacf66bab4410475a6774152f95a0a6 TRT_LLM_VERSION=1.2.0rc6.post1`	01/07/2026 10:22 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`TARGETARCH=amd64`	01/07/2026 10:22 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`TRT_LLM_VER=1.2.0rc6.post1`	01/07/2026 10:22 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`GIT_COMMIT=e4a6c9995dacf66bab4410475a6774152f95a0a6`	01/07/2026 10:22 AM UTC
sha256:8a0edb770b4cb077d64c8c7f8a65621da57f0fb1fc6f187a7a229f853b8289c7	RUN	`SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build /bin/bash -c chmod -R a+w examples && rm -v benchmarks/cpp/bertBenchmark.cpp benchmarks/cpp/gptManagerBenchmark.cpp benchmarks/cpp/disaggServerBenchmark.cpp benchmarks/cpp/CMakeLists.txt && rm -rf /root/.cache/pip`	01/07/2026 10:22 AM UTC
sha256:93275311973dc7a01bb1f588af0286e2be67993f28e5dcd40b86e0e8c4b0f7e8	COPY	`examples examples`	01/07/2026 10:22 AM UTC
sha256:496a3df427132ee691fb2180445a78b8633ae31d4c6f3593c34521cc7b64bebd	COPY	`/src/tensorrt_llm/cpp/build/benchmarks/bertBenchmark /src/tensorrt_llm/cpp/build/benchmarks/gptManagerBenchmark /src/tensorrt_llm/cpp/build/benchmarks/disaggServerBenchmark benchmarks/cpp/`	01/07/2026 10:22 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build`	01/07/2026 10:22 AM UTC