Skip to main content
ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    TensorRT LLM Release
    Container
    NVIDIA
    TensorRT LLM Release

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

  • LayerLabelCreated
    sha256:677b4725308e03187a42501a18ef79c1fc81863bcc3dc737d6d74c53ac689aa4RUN
    SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build GIT_COMMIT=7c6df0e19f92c7eba91fe58d67d64e968aa909e5 TRT_LLM_VER=1.2.0rc6.post3 TARGETARCH=amd64 /bin/bash -c bash /tmp/generate_container_oss_attribution.sh "release" "${TRT_LLM_VER}" "${TARGETARCH}" &&
  rm /tmp/generate_container_oss_attribution.sh
    		02/04/2026 5:32 AM UTC
    sha256:eebdc02d926efca00567808ba8146a27135d3590b2a26b91a1594b785f428bc1COPY
    scripts/generate_container_oss_attribution.sh /tmp/generate_container_oss_attribution.sh
    		02/04/2026 5:32 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    TRT_LLM_GIT_COMMIT=7c6df0e19f92c7eba91fe58d67d64e968aa909e5 TRT_LLM_VERSION=1.2.0rc6.post3
    		02/04/2026 5:32 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    TARGETARCH=amd64
    		02/04/2026 5:32 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    TRT_LLM_VER=1.2.0rc6.post3
    		02/04/2026 5:32 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    GIT_COMMIT=7c6df0e19f92c7eba91fe58d67d64e968aa909e5
    		02/04/2026 5:32 AM UTC
    sha256:b6677cc786e630725b6379f8f45ca032b1a24ddea068c43a699765a487ab9139RUN
    SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build /bin/bash -c chmod -R a+w examples &&
  rm -v benchmarks/cpp/bertBenchmark.cpp benchmarks/cpp/gptManagerBenchmark.cpp benchmarks/cpp/disaggServerBenchmark.cpp benchmarks/cpp/CMakeLists.txt &&
  rm -rf /root/.cache/pip
    		02/04/2026 5:32 AM UTC
    sha256:53ed2ff5bd68741ba80111372b22d417c5be3f35b30149d1e7df9cdd32a8334fCOPY
    examples examples
    		02/04/2026 5:32 AM UTC
    sha256:2a1648ceb8c98a3173a30412b32b2fe6dbcbe0f40dd06293f4de113b104910b9COPY
    /src/tensorrt_llm/cpp/build/benchmarks/bertBenchmark /src/tensorrt_llm/cpp/build/benchmarks/gptManagerBenchmark /src/tensorrt_llm/cpp/build/benchmarks/disaggServerBenchmark benchmarks/cpp/
    		02/04/2026 5:32 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build
    		02/04/2026 5:32 AM UTC
    ...