TensorRT LLM Release

NVIDIA

Container

NVIDIA

TensorRT LLM Release

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

Layer	Label		Created
df32b0b3ae6deb05613e0e327b0b23df46f163ece6fa9f6d427bb43b987a8576	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /app/tensorrt_llm; ExposedPorts 6006/tcp, 8888/tcp`	01/22/2026 6:10 AM UTC
ee7c985ec028d0eb9f2470469b92003e36b6b00e070d5eb5e5a2a6879f2ccb9c	COPY	`scripts/generate_container_oss_attribution.sh /tmp/generate_container_oss_attribution.sh`	01/22/2026 6:10 AM UTC
59b60532c308f53513bdfdcccc49ad0ef52f057435f141d0b41cbe79e3e6808e	ENV	`TRT_LLM_GIT_COMMIT=50379d028c2689ffb5cefe7797c5afb199e9df93 TRT_LLM_VERSION=1.2.0rc6.post2`	01/22/2026 6:10 AM UTC
be88b4688b7f725fc040aa4b24e0c5f877801217291bf7d8661a40fb940492b1	ARG	`TARGETARCH=amd64`	01/22/2026 6:10 AM UTC
fa942775309db61110a6991fdd9ad787fbe674191371307d84d644b135a957d6	ARG	`TRT_LLM_VER=1.2.0rc6.post2`	01/22/2026 6:10 AM UTC
62dfb3d1a0b744d66dde10073fa7eee1275a61888345bb900edebe61470a7559	ARG	`GIT_COMMIT=50379d028c2689ffb5cefe7797c5afb199e9df93`	01/22/2026 6:10 AM UTC
20e000057fd6cdddfafc30d0a17cc18a099daa4c7453b5e9f870ba34081095a3	RUN	`SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build /bin/bash -c chmod -R a+w examples && rm -v benchmarks/cpp/bertBenchmark.cpp benchmarks/cpp/gptManagerBenchmark.cpp benchmarks/cpp/disaggServerBenchmark.cpp benchmarks/cpp/CMakeLists.txt && rm -rf /root/.cache/pip`	01/22/2026 6:10 AM UTC
6a2ff5b45bbfa61093e11845898bdde2b22783dd467c2dafdf9eb3961a1d5c2d	COPY	`examples examples`	01/22/2026 6:10 AM UTC
47b167d4a04056c92ccf45c5c14105b8b09acf36af6f30fba74380f05fc0b2c2	COPY	`/src/tensorrt_llm/cpp/build/benchmarks/bertBenchmark /src/tensorrt_llm/cpp/build/benchmarks/gptManagerBenchmark /src/tensorrt_llm/cpp/build/benchmarks/disaggServerBenchmark benchmarks/cpp/`	01/22/2026 6:10 AM UTC
e2374744bb963f49ba9d15c91c704ddeed767e92041fe2da938c16347f357434	ARG	`CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build`	01/22/2026 6:10 AM UTC