NVIDIA
vllm-runtime-nightly
Container
NVIDIA
vllm-runtime-nightly

The Dynamo vLLM runtime nightly image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework published at a nightly cadence.

  • LayerLabelCreated
    sha256:1863661e7e98228a2c22c8c611fd04fe1ea300b05b9716748fd6b19d8953dd9aCOPY
    /legal /legal
    07/26/2026 9:04 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    07/26/2026 9:04 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    DYNAMO_COMMIT_SHA=769ee0771b77f5c6127cf0a965db209e6f2e056c
    07/26/2026 9:04 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    DYNAMO_COMMIT_SHA=769ee0771b77f5c6127cf0a965db209e6f2e056c
    07/26/2026 9:04 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    dynamo
    07/26/2026 9:04 AM UTC
    sha256:ccaf0cc376f652c8c9c0d7a79abe69280f2ec1e9f58b9cb58c06adccb4fd6f11RUN
    PYTHON_VERSION=3.12 ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE=true VLLM_OMNI_REF=v0.25.0rc1 NIXL_REF=v1.1.0 CUDA_MAJOR=13 MODELEXPRESS_VERSION=0.4.0 SITE_PACKAGES=/usr/local/lib/python3.12/dist-packages sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen &&
      chmod 755 /opt/dynamo/.launch_screen &&
      echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
    07/26/2026 9:04 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    root
    07/26/2026 9:04 AM UTC
    sha256:d5dc08e28de8ac82ec595286ea13f7a9df6ea71244a8c4b22a9509c5e2e90542COPY
    --chown=dynamo:0 lib /workspace/lib
    07/26/2026 9:04 AM UTC
    sha256:c4b950d0cd88018e1afba27a5d446b059588110f50ffea4e7a9138502faeb594COPY
    --chown=dynamo:0 --chmod=775 components/src/dynamo/vllm /workspace/components/src/dynamo/vllm
    07/26/2026 9:04 AM UTC
    sha256:ac15f23c4e9d7d50909df095563187a986cc9029291aca219f39bcf16197cdf2COPY
    --chown=dynamo:0 --chmod=775 components/src/dynamo/frontend /workspace/components/src/dynamo/frontend
    07/26/2026 9:04 AM UTC
    ...