NVIDIA
vllm-runtime-nightly
Container
NVIDIA
vllm-runtime-nightly

The Dynamo vLLM runtime nightly image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework published at a nightly cadence.

  • LayerLabelCreated
    sha256:1ff697d480c53f2c60fe732a2b416eaf315f669a821373a28077edfffdd103c9COPY
    /legal /legal
    08/16/2026 8:17 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    08/16/2026 8:17 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    DYNAMO_COMMIT_SHA=c13fdcec64c351edb729692c26ab84d30da33e88
    08/16/2026 8:17 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    DYNAMO_COMMIT_SHA=c13fdcec64c351edb729692c26ab84d30da33e88
    08/16/2026 8:17 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    dynamo
    08/16/2026 8:17 AM UTC
    sha256:0522b2d58cb2f1dddc5b8eab42bc41d241d5252441d2f92fbec713a789e7a5beRUN
    PYTHON_VERSION=3.12 ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE=true VLLM_OMNI_REF=v0.26.0rc1 NIXL_REF=v1.3.2 CUDA_MAJOR=13 MODELEXPRESS_VERSION=0.5.0 SITE_PACKAGES=/usr/local/lib/python3.12/dist-packages sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen &&
      chmod 755 /opt/dynamo/.launch_screen &&
      echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
    08/16/2026 8:17 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    root
    08/16/2026 8:17 AM UTC
    sha256:c08acb8735a2e8d58634d90b31991d7755ced64bc84e850eef6f42d79a078e71COPY
    --chown=dynamo:0 lib /workspace/lib
    08/16/2026 8:17 AM UTC
    sha256:7d5a6e46daf2a6d45ba0fa1f922d9a65b684c2bce0f7b09d24ed87fa21098e81COPY
    --chown=dynamo:0 --chmod=775 components/src/dynamo/vllm /workspace/components/src/dynamo/vllm
    08/16/2026 8:17 AM UTC
    sha256:604e8637dfd640b3c3175894108dd995a321b867cfd1e15706fdb57e05a382f8COPY
    --chown=dynamo:0 --chmod=775 components/src/dynamo/frontend /workspace/components/src/dynamo/frontend
    08/16/2026 8:17 AM UTC
    ...