TensorRT LLM Release

NVIDIA

Container

NVIDIA

TensorRT LLM Release

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

Layer	Label		Created
3cf043757b7eaada0115a6e129b785f8c461536eba916578f2b6094fc2d865fe	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /app/tensorrt_llm; ExposedPorts 6006/tcp, 8888/tcp`	01/30/2026 8:13 PM UTC
8c1997e77d09c9aeafab238823ef37ac15efd5255b4ea46c6ec5d7b2e7bf77ec	COPY	`scripts/generate_container_oss_attribution.sh /tmp/generate_container_oss_attribution.sh`	01/30/2026 8:13 PM UTC
09341882deb37ae906a658df173f500973a35fc1e456853936a8fe939f611356	ENV	`TRT_LLM_GIT_COMMIT=f42a6cbae01fe6e5cddd0fa50f2f69f591f62079 TRT_LLM_VERSION=1.3.0rc2`	01/30/2026 8:13 PM UTC
4a4491afb8f6e09a2ba5cf1e1b80b153e2b43c3dcfd0fb678d9826c5c73e292f	ARG	`TARGETARCH=amd64`	01/30/2026 8:13 PM UTC
240ae81743c1f6966a5f4e3b487156f30ac0ad7c343baf26a153b4d8ca929040	ARG	`TRT_LLM_VER=1.3.0rc2`	01/30/2026 8:13 PM UTC
09f9d2dc4c4b398665b4dc8b1d6e662ddc661f243403d99d54a58ab00b1a79c8	ARG	`GIT_COMMIT=f42a6cbae01fe6e5cddd0fa50f2f69f591f62079`	01/30/2026 8:13 PM UTC
82cea9054d3e0df1d400d1c2190060f4680b3f0821dbdc2e3fa0c6bf7e5d6414	RUN	`SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build /bin/bash -c chmod -R a+w examples && rm -v benchmarks/cpp/bertBenchmark.cpp benchmarks/cpp/gptManagerBenchmark.cpp benchmarks/cpp/disaggServerBenchmark.cpp benchmarks/cpp/CMakeLists.txt && rm -rf /root/.cache/pip`	01/30/2026 8:13 PM UTC
9964b1f6353726c6f30d8af7e146ea52f72238e554f9391a4491e492c4217e7f	COPY	`examples examples`	01/30/2026 8:13 PM UTC
168fc82b1872f99fe5afa058fd92de7fbe821fd5ba1c949da7cb947b0d8e7773	COPY	`/src/tensorrt_llm/cpp/build/benchmarks/bertBenchmark /src/tensorrt_llm/cpp/build/benchmarks/gptManagerBenchmark /src/tensorrt_llm/cpp/build/benchmarks/disaggServerBenchmark benchmarks/cpp/`	01/30/2026 8:13 PM UTC
a0991ed85c478455672a9d00dbf92836a8029c27e95054d0583de5789b05783b	ARG	`CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build`	01/30/2026 8:13 PM UTC