ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT LLM Release
Container
NVIDIA
NVIDIA
TensorRT LLM Release

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
sha256:3056e07e9685ad675da0c944d87846326ecec6deaf0aa2f70a558c2207b85851RUN
SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build GIT_COMMIT=b464c750567e0b1b35712084fda1e575d85fb97c TRT_LLM_VER=1.3.0rc3 TARGETARCH=amd64 /bin/bash -c bash /tmp/generate_container_oss_attribution.sh "release" "${TRT_LLM_VER}" "${TARGETARCH}" &&
  rm /tmp/generate_container_oss_attribution.sh
02/08/2026 3:53 PM UTC
sha256:0b5e4442745ecb9a51ae03aea677dbbba791a6b57238948add9dc80217ab4628COPY
scripts/generate_container_oss_attribution.sh /tmp/generate_container_oss_attribution.sh
02/08/2026 3:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
TRT_LLM_GIT_COMMIT=b464c750567e0b1b35712084fda1e575d85fb97c TRT_LLM_VERSION=1.3.0rc3
02/08/2026 3:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TARGETARCH=amd64
02/08/2026 3:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TRT_LLM_VER=1.3.0rc3
02/08/2026 3:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
GIT_COMMIT=b464c750567e0b1b35712084fda1e575d85fb97c
02/08/2026 3:53 PM UTC
sha256:a38690cb49813c6dacd1e0c2c7b6c96b18a45cd0e69c5a2dfe25e826f087067fRUN
SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build /bin/bash -c chmod -R a+w examples &&
  rm -v benchmarks/cpp/bertBenchmark.cpp benchmarks/cpp/gptManagerBenchmark.cpp benchmarks/cpp/disaggServerBenchmark.cpp benchmarks/cpp/CMakeLists.txt &&
  rm -rf /root/.cache/pip &&
  rm -rf /root/.cache/uv/archive-v0 &&
  rm -rf /usr/local/lib/python3.12/dist-packages/setuptools/_vendor/jaraco.context-5.3.0.dist-info &&
  rm -rf /usr/local/lib/python3.12/dist-packages/setuptools/_vendor/wheel-0.45.1.dist-info
02/08/2026 3:53 PM UTC
sha256:2e98a299f7695632d2630f7fb00acfcdf258b5a53188b02b822de9996054aa61COPY
examples examples
02/08/2026 3:53 PM UTC
sha256:2a7c2aec3d2d1bf72e16dfa835efad4b49ae2f4b7cf4492815b02fe26be75c87COPY
/src/tensorrt_llm/cpp/build/benchmarks/bertBenchmark /src/tensorrt_llm/cpp/build/benchmarks/gptManagerBenchmark /src/tensorrt_llm/cpp/build/benchmarks/disaggServerBenchmark benchmarks/cpp/
02/08/2026 3:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build
02/08/2026 3:53 PM UTC
...