ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT LLM Release
Container
NVIDIA
NVIDIA
TensorRT LLM Release

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
sha256:61eff5d015080380e205850178d4f7b7018f1a0df56d2b51a307b370a7b375fbRUN
SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build GIT_COMMIT=e4c707845ff58fcc0b1d87afb4dd0e64885c780a TRT_LLM_VER=1.2.0rc5 TARGETARCH=amd64 /bin/bash -c bash /tmp/generate_container_oss_attribution.sh "release" "${TRT_LLM_VER}" "${TARGETARCH}" &&
  rm /tmp/generate_container_oss_attribution.sh
12/08/2025 3:14 AM UTC
sha256:23fb35146fda8252720a80333c5ca9ea9cb27036b57cbd5b2e11a53b6314e7d1COPY
scripts/generate_container_oss_attribution.sh /tmp/generate_container_oss_attribution.sh
12/08/2025 3:14 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
TRT_LLM_GIT_COMMIT=e4c707845ff58fcc0b1d87afb4dd0e64885c780a TRT_LLM_VERSION=1.2.0rc5
12/08/2025 3:14 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TARGETARCH=amd64
12/08/2025 3:14 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TRT_LLM_VER=1.2.0rc5
12/08/2025 3:14 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
GIT_COMMIT=e4c707845ff58fcc0b1d87afb4dd0e64885c780a
12/08/2025 3:14 AM UTC
sha256:0d2baf504f4cc28486dae32c7e1c38fe0cacbc8bcf4ec03d4a9b8530c0b62d60RUN
SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build /bin/bash -c chmod -R a+w examples &&
  rm -v benchmarks/cpp/bertBenchmark.cpp benchmarks/cpp/gptManagerBenchmark.cpp benchmarks/cpp/disaggServerBenchmark.cpp benchmarks/cpp/CMakeLists.txt &&
  rm -rf /root/.cache/pip
12/08/2025 3:14 AM UTC
sha256:712cc3ad49f8215f74b393371507de83bcde67123ae2e81d1d266a9c47cbc071COPY
examples examples
12/08/2025 3:14 AM UTC
sha256:9269963cf1705c7c9bc67de5e963ee50c1865ba4ae8b77eba239a9198b02f27fCOPY
/src/tensorrt_llm/cpp/build/benchmarks/bertBenchmark /src/tensorrt_llm/cpp/build/benchmarks/gptManagerBenchmark /src/tensorrt_llm/cpp/build/benchmarks/disaggServerBenchmark benchmarks/cpp/
12/08/2025 3:14 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build
12/08/2025 3:14 AM UTC
...