TensorRT LLM Release

NVIDIA

Container

NVIDIA

TensorRT LLM Release

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

Layer	Label		Created
d6422f6196a3ac95eaefd11b1706fed0978e01af670c356a788d71c9141a19b2	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /app/tensorrt_llm; ExposedPorts 6006/tcp, 8888/tcp`	01/04/2026 6:30 PM UTC
6fa212fefdfcbdd8afa9a34ccd6da0b3f30d9720159082ee42815c5560ca7d38	COPY	`scripts/generate_container_oss_attribution.sh /tmp/generate_container_oss_attribution.sh`	01/04/2026 6:30 PM UTC
7b8d5f3f90d53f924a0e42ea099988f64e88bde41f6a13bf7adaede6b716aa8e	ENV	`TRT_LLM_GIT_COMMIT=a65b0d4efa23e6802f391c21de90750169ecf1ea TRT_LLM_VERSION=1.2.0rc7`	01/04/2026 6:30 PM UTC
1135340411aa0f45fade3f2afc57e87445f40be725f05a3c5847400840c3fb97	ARG	`TARGETARCH=amd64`	01/04/2026 6:30 PM UTC
0281f5003c91a0ffb9dadfc732812ae961dd660e9014483278de808b5c7785b4	ARG	`TRT_LLM_VER=1.2.0rc7`	01/04/2026 6:30 PM UTC
6c0fba378918af0733dbbf8b0049a84cbc301e3e5c86ac5253f0ebb7dec52f9f	ARG	`GIT_COMMIT=a65b0d4efa23e6802f391c21de90750169ecf1ea`	01/04/2026 6:30 PM UTC
a6fbacf2ffea71ed21ef45efed2fb0ed722b6c9e8da2026a03b14374c544a005	RUN	`SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build /bin/bash -c chmod -R a+w examples && rm -v benchmarks/cpp/bertBenchmark.cpp benchmarks/cpp/gptManagerBenchmark.cpp benchmarks/cpp/disaggServerBenchmark.cpp benchmarks/cpp/CMakeLists.txt && rm -rf /root/.cache/pip`	01/04/2026 6:30 PM UTC
ecf6fda8f28dd6b82ab7b6e52dd0364320518bf9f1249fe7e048716d3fcda51f	COPY	`examples examples`	01/04/2026 6:30 PM UTC
6aeaa416c15bf5bd99e7fc8af15f2ebd572ec2845ed8451a6f1196d846f1d2e5	COPY	`/src/tensorrt_llm/cpp/build/benchmarks/bertBenchmark /src/tensorrt_llm/cpp/build/benchmarks/gptManagerBenchmark /src/tensorrt_llm/cpp/build/benchmarks/disaggServerBenchmark benchmarks/cpp/`	01/04/2026 6:30 PM UTC
4885efe4fe0e56c739ec108a0c45d95baed430256d28aa76327c9e195cc27669	ARG	`CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build`	01/04/2026 6:30 PM UTC