NVIDIA
NVIDIA
TensorRT LLM Release
Container
NVIDIA
NVIDIA
TensorRT LLM Release

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
sha256:0e521d2e282715e2ed7e82cfa1f10ea0128862ff186a79a800c1b6b0b30400ccRUN
SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build GIT_COMMIT=0af1a0e4789eed690f91d2efde77f09ad35d1805 TRT_LLM_VER=1.3.0rc0 TARGETARCH=amd64 /bin/bash -c bash /tmp/generate_container_oss_attribution.sh "release" "${TRT_LLM_VER}" "${TARGETARCH}" &&
  rm /tmp/generate_container_oss_attribution.sh
01/18/2026 7:57 AM UTC
sha256:e81bbc555a76cf559dfc5d2f657c9edc84bce6319e547b7c2adce26372ee9c8cCOPY
scripts/generate_container_oss_attribution.sh /tmp/generate_container_oss_attribution.sh
01/18/2026 7:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
TRT_LLM_GIT_COMMIT=0af1a0e4789eed690f91d2efde77f09ad35d1805 TRT_LLM_VERSION=1.3.0rc0
01/18/2026 7:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TARGETARCH=amd64
01/18/2026 7:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TRT_LLM_VER=1.3.0rc0
01/18/2026 7:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
GIT_COMMIT=0af1a0e4789eed690f91d2efde77f09ad35d1805
01/18/2026 7:57 AM UTC
sha256:42f31d96ac50a7433594d839b6d56ed8a614d0dc3fa705d7711e5c17e385b45cRUN
SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build /bin/bash -c chmod -R a+w examples &&
  rm -v benchmarks/cpp/bertBenchmark.cpp benchmarks/cpp/gptManagerBenchmark.cpp benchmarks/cpp/disaggServerBenchmark.cpp benchmarks/cpp/CMakeLists.txt &&
  rm -rf /root/.cache/pip
01/18/2026 7:57 AM UTC
sha256:d2a2cf421fb041849a0c62cb28880d3b47299d3215f70e174dfc6df18ffc9806COPY
examples examples
01/18/2026 7:57 AM UTC
sha256:2ad95e8054b8f416392afc5d5e0d2ce118eb0889c8ec6f24a0fa0ad18bd14fd7COPY
/src/tensorrt_llm/cpp/build/benchmarks/bertBenchmark /src/tensorrt_llm/cpp/build/benchmarks/gptManagerBenchmark /src/tensorrt_llm/cpp/build/benchmarks/disaggServerBenchmark benchmarks/cpp/
01/18/2026 7:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build
01/18/2026 7:57 AM UTC
...