NVIDIA
NVIDIA
TensorRT LLM Release
Container
NVIDIA
NVIDIA
TensorRT LLM Release

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
sha256:74dd1499a469e6240d11db103fd741e5468630e14ee925862ec41d918b6dc6f7RUN
SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build GIT_COMMIT=80649a8b78b2fbe9ac4fa9b004fcceb251ba7c2e TRT_LLM_VER=1.2.0rc8 TARGETARCH=amd64 /bin/bash -c bash /tmp/generate_container_oss_attribution.sh "release" "${TRT_LLM_VER}" "${TARGETARCH}" &&
  rm /tmp/generate_container_oss_attribution.sh
01/11/2026 2:46 PM UTC
sha256:12758d0e180f274c20c5a035d1c3068c78bf82382b1dce4d8504522dd77f51a1COPY
scripts/generate_container_oss_attribution.sh /tmp/generate_container_oss_attribution.sh
01/11/2026 2:46 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
TRT_LLM_GIT_COMMIT=80649a8b78b2fbe9ac4fa9b004fcceb251ba7c2e TRT_LLM_VERSION=1.2.0rc8
01/11/2026 2:46 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TARGETARCH=amd64
01/11/2026 2:46 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TRT_LLM_VER=1.2.0rc8
01/11/2026 2:46 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
GIT_COMMIT=80649a8b78b2fbe9ac4fa9b004fcceb251ba7c2e
01/11/2026 2:46 PM UTC
sha256:a59ac3ebb042f81b0bea66a6e2b738382b631b0aad7150089086923001cb3e8dRUN
SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build /bin/bash -c chmod -R a+w examples &&
  rm -v benchmarks/cpp/bertBenchmark.cpp benchmarks/cpp/gptManagerBenchmark.cpp benchmarks/cpp/disaggServerBenchmark.cpp benchmarks/cpp/CMakeLists.txt &&
  rm -rf /root/.cache/pip
01/11/2026 2:46 PM UTC
sha256:95add0d0c74785bb17fd126bab898b2a90dd14dcb6decbfb0c95047149495d3cCOPY
examples examples
01/11/2026 2:46 PM UTC
sha256:bafd688af3350544d503bb6cfd1b6fc61cf4428a7c6edb19e4c17193f2c34095COPY
/src/tensorrt_llm/cpp/build/benchmarks/bertBenchmark /src/tensorrt_llm/cpp/build/benchmarks/gptManagerBenchmark /src/tensorrt_llm/cpp/build/benchmarks/disaggServerBenchmark benchmarks/cpp/
01/11/2026 2:46 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build
01/11/2026 2:46 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.