ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT LLM Release
Container
NVIDIA
NVIDIA
TensorRT LLM Release

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
ddb6af1a3471c3cd251b1770962d826c2680fc0d3424f086b21b1933fb925f4fCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /app/tensorrt_llm; ExposedPorts 6006/tcp, 8888/tcp
02/27/2026 1:02 AM UTC
3baa225ac723671663dc799a71682b97e04c767dbbdad856b1bab7ff6faf0fbeCOPY
scripts/generate_container_oss_attribution.sh /tmp/generate_container_oss_attribution.sh
02/27/2026 1:02 AM UTC
c94ccf823f6a0a4b00b65873706c5afa6abac9510abc9149aaff8f479583da4bENV
TRT_LLM_GIT_COMMIT=617440d385f091007daafe8bb7206e9a748bb84b TRT_LLM_VERSION=1.3.0rc6
02/27/2026 1:02 AM UTC
0e95989f0bd3ade656a09732cd34ada3378fa531bd66bb190b8befb85a48b756ARG
TARGETARCH=amd64
02/27/2026 1:02 AM UTC
b9443a94d673aea07e68074c984de6a601682d03b9a5f8a02628a046f870f8f0ARG
TRT_LLM_VER=1.3.0rc6
02/27/2026 1:02 AM UTC
328598335ece5131a18daa7fcbe0a7b51c3a755b5f7e5a64cc59be32822d7d7fARG
GIT_COMMIT=617440d385f091007daafe8bb7206e9a748bb84b
02/27/2026 1:02 AM UTC
0ca1f434a9e27a185aa28c97d224e2d27aefc0efaf30a0fb55450b701a45accfRUN
SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build /bin/bash -c chmod -R a+w examples &&
  rm -v benchmarks/cpp/bertBenchmark.cpp benchmarks/cpp/gptManagerBenchmark.cpp benchmarks/cpp/disaggServerBenchmark.cpp benchmarks/cpp/CMakeLists.txt &&
  rm -rf /root/.cache/pip &&
  rm -rf /root/.cache/uv/archive-v0 &&
  rm -rf /usr/local/lib/python3.12/dist-packages/setuptools/_vendor/jaraco.context-5.3.0.dist-info &&
  rm -rf /usr/local/lib/python3.12/dist-packages/setuptools/_vendor/wheel-0.45.1.dist-info
02/27/2026 1:02 AM UTC
f1e53b83933d13a95bbe7645e194d2560f0d5f08d065df9430eba9e56a5770cbCOPY
examples examples
02/27/2026 1:02 AM UTC
bb90fed36f70f6445ac7c34439a1fa24998d97001262de87bb6aa72fb81207faCOPY
/src/tensorrt_llm/cpp/build/benchmarks/bertBenchmark /src/tensorrt_llm/cpp/build/benchmarks/gptManagerBenchmark /src/tensorrt_llm/cpp/build/benchmarks/disaggServerBenchmark benchmarks/cpp/
02/27/2026 1:02 AM UTC
db411e2eaa622c9a15997dc63c3a5bb19b7a4b8bc6770d0c459c0506e69cd49eARG
CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build
02/27/2026 1:02 AM UTC
...