Dynamo vLLM Runtime | NVIDIA NGC

NVIDIA

Dynamo vLLM Runtime

Container

NVIDIA

Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

Layer	Label		Created
9543f53b4543fbb0ef54e4edea249c90079e8f3937ef05d4ac2718a21d0f3c28	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	01/15/2026 2:05 PM UTC
62b3eea63448499be22ada891fc57ca073c4dcc7869f7782d676533511e2de72	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	01/15/2026 2:05 PM UTC
7a65db432b60d65c3822aebf7f6ddfa98c0fe2b1a7d433e8fb261c954250302e	ENV	`DYNAMO_COMMIT_SHA=115531a0c0bf58ff12df7ef7e69082d50fd4d707`	01/15/2026 2:05 PM UTC
f1f0cdcfd5b683ab871d58c5fa2f7446ae7814378f294a007e778e15f8e03e46	ARG	`DYNAMO_COMMIT_SHA=115531a0c0bf58ff12df7ef7e69082d50fd4d707`	01/15/2026 2:05 PM UTC
e1b0e9aa9b3ce27227d6b8ff53c9d85b5236a5019f6d53fb41fa64138f0a5090	USER	`dynamo`	01/15/2026 2:05 PM UTC
0295e97d2e4309564445224fe65153cb885cb80e4f7af5d74a35ef482c00d2e1	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c chmod g+w /workspace /workspace/* /opt/dynamo /opt/dynamo/* ${VIRTUAL_ENV} && chmod 755 /opt/dynamo/.launch_screen && echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc`	01/15/2026 2:05 PM UTC
df945a270182268cc61b9ffd919321b67e89772dac24f18b3337769c0278134a	USER	`root`	01/15/2026 2:05 PM UTC
0367b53d5107cb36bcf96f3633e7638bd5dd05cd8d2cd25bd4279ddd00d35de4	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen`	01/15/2026 2:05 PM UTC
922548de1811b6dcb0ab832c3a12a4e0d3b577a8946130c3809f345f908dd4c5	COPY	`--chown=dynamo:0 --chmod=775 lib/ /workspace/lib/`	01/15/2026 2:05 PM UTC
e8f6aef89f5d851f5f77fdd302f6b52e617830cf25c28ac358c68740c40f7b62	COPY	`--chown=dynamo:0 --chmod=775 components/ /workspace/components/`	01/15/2026 2:05 PM UTC