NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
9543f53b4543fbb0ef54e4edea249c90079e8f3937ef05d4ac2718a21d0f3c28CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
01/15/2026 2:05 PM UTC
62b3eea63448499be22ada891fc57ca073c4dcc7869f7782d676533511e2de72ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
01/15/2026 2:05 PM UTC
7a65db432b60d65c3822aebf7f6ddfa98c0fe2b1a7d433e8fb261c954250302eENV
DYNAMO_COMMIT_SHA=115531a0c0bf58ff12df7ef7e69082d50fd4d707
01/15/2026 2:05 PM UTC
f1f0cdcfd5b683ab871d58c5fa2f7446ae7814378f294a007e778e15f8e03e46ARG
DYNAMO_COMMIT_SHA=115531a0c0bf58ff12df7ef7e69082d50fd4d707
01/15/2026 2:05 PM UTC
e1b0e9aa9b3ce27227d6b8ff53c9d85b5236a5019f6d53fb41fa64138f0a5090USER
dynamo
01/15/2026 2:05 PM UTC
0295e97d2e4309564445224fe65153cb885cb80e4f7af5d74a35ef482c00d2e1RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c chmod g+w /workspace /workspace/* /opt/dynamo /opt/dynamo/* ${VIRTUAL_ENV} &&
  chmod 755 /opt/dynamo/.launch_screen &&
  echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
01/15/2026 2:05 PM UTC
df945a270182268cc61b9ffd919321b67e89772dac24f18b3337769c0278134aUSER
root
01/15/2026 2:05 PM UTC
0367b53d5107cb36bcf96f3633e7638bd5dd05cd8d2cd25bd4279ddd00d35de4RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
01/15/2026 2:05 PM UTC
922548de1811b6dcb0ab832c3a12a4e0d3b577a8946130c3809f345f908dd4c5COPY
--chown=dynamo:0 --chmod=775 lib/ /workspace/lib/
01/15/2026 2:05 PM UTC
e8f6aef89f5d851f5f77fdd302f6b52e617830cf25c28ac358c68740c40f7b62COPY
--chown=dynamo:0 --chmod=775 components/ /workspace/components/
01/15/2026 2:05 PM UTC
...