NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:cf3c3f02d396179b207fea482a7359ad307706d7e34e97138fef54ac1f6fa20fCOPY
    --chown=dynamo:0 --chmod=664 attributions-hiddentrails/tensorrtllm/amd64/ATTRIBUTIONS-Rust.txt /workspace/ATTRIBUTIONS-Rust.md
    06/12/2026 8:27 AM UTC
    sha256:b4bc62d293aaa4d789595ce85c739bab647dbe4317557d611f77e304dbfac835COPY
    --chown=dynamo:0 --chmod=664 attributions-hiddentrails/tensorrtllm/amd64/ATTRIBUTIONS-Python.txt /workspace/ATTRIBUTIONS-Python.md
    06/12/2026 8:27 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    TARGETARCH=amd64
    06/12/2026 8:27 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    FRAMEWORK=tensorrtllm
    06/12/2026 8:27 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /bin/bash
    06/12/2026 4:57 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    06/12/2026 4:57 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    dynamo
    06/12/2026 4:57 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    DYNAMO_COMMIT_SHA=12ace523cf79253ace638254384d039a771bf785
    06/12/2026 4:57 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    DYNAMO_COMMIT_SHA=12ace523cf79253ace638254384d039a771bf785
    06/12/2026 4:57 AM UTC
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1WORKDIR
    /workspace
    06/12/2026 4:57 AM UTC
    ...