NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    dynamo
    06/12/2026 7:19 AM UTC
    sha256:fa521aaf90964972ba17c0a5bfcb3d0f50ccc50a9731b7c9d4c02f8bc3660efcRUN
    python3 -m pip install --force-reinstall --no-deps nvidia-cutlass-dsl-libs-cu13==4.5.2 &&
      python3 -m pip show nvidia-cutlass-dsl-libs-cu13
    06/12/2026 7:19 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    root
    06/12/2026 7:19 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    PIP_DISABLE_PIP_VERSION_CHECK=1 PIP_NO_CACHE_DIR=1
    06/12/2026 7:19 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4COPY
    --chown=dynamo:0 --chmod=664 attributions-hiddentrails/vllm/amd64/ATTRIBUTIONS-Rust.txt /workspace/ATTRIBUTIONS-Rust.md
    06/12/2026 7:05 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4COPY
    --chown=dynamo:0 --chmod=664 attributions-hiddentrails/vllm/amd64/ATTRIBUTIONS-Python.txt /workspace/ATTRIBUTIONS-Python.md
    06/12/2026 7:05 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    TARGETARCH=amd64
    06/12/2026 7:05 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    FRAMEWORK=vllm
    06/12/2026 7:05 AM UTC
    sha256:a93fa94818f4224a619df1e4c6a33c8e5d074809f38bb4b58fe898b4ca8cbad5COPY
    --chown=dynamo:0 --chmod=664 attributions-hiddentrails/vllm/amd64/ATTRIBUTIONS-Rust.txt /workspace/ATTRIBUTIONS-Rust.md
    06/12/2026 7:05 AM UTC
    sha256:05e7133b48d76a7a23b7cbea85280d3e5c43c58dbee185cc8418bd5b4183e54fCOPY
    --chown=dynamo:0 --chmod=664 attributions-hiddentrails/vllm/amd64/ATTRIBUTIONS-Python.txt /workspace/ATTRIBUTIONS-Python.md
    06/12/2026 7:05 AM UTC
    ...