Dynamo vLLM Runtime | NVIDIA NGC

NVIDIA

Dynamo vLLM Runtime

Container

NVIDIA

Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

Layer	Label		Created
cb20b268df300717f21995e864a2a3b138a662301dd914fef6af1c6bac8f665d	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	01/22/2026 8:22 PM UTC
40cb2fe43e147a1f48ea39b076d2586dc79a2315d1067519dd1ea81c4c99c234	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	01/22/2026 8:22 PM UTC
3906fc30b4ce62b788165da6bc71b67e446641e23ac37b2aa55b6e9bd1d1dac6	ENV	`DYNAMO_COMMIT_SHA=5ea7ff0979feb0bb44c1191ee968959b871ae2bc`	01/22/2026 8:22 PM UTC
3ef455c89488773301c5616ecbbee7bf309be735e3072c533d48d69ed38d680c	ARG	`DYNAMO_COMMIT_SHA=5ea7ff0979feb0bb44c1191ee968959b871ae2bc`	01/22/2026 8:22 PM UTC
aceddcdb06a3db4897ca1ebe31f1fa534f9a56f5a8d259c0bb7c0f2c46cadcd5	USER	`dynamo`	01/22/2026 8:22 PM UTC
926fd62a0a9d096b8c912c8440ff3985554da22fce56bd2eb5b013548ea7ceb4	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c chmod g+w /workspace /workspace/* /opt/dynamo /opt/dynamo/* ${VIRTUAL_ENV} && chmod 755 /opt/dynamo/.launch_screen && echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc`	01/22/2026 8:22 PM UTC
5f72268422aa157791582139685f5c055a212d003093982764f963b89a7607ea	USER	`root`	01/22/2026 8:22 PM UTC
837b343719a156060a075e60c9d60332aea871ca1acadd58c960c1514d090455	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen`	01/22/2026 8:22 PM UTC
3e65ee7372b9b264e3dce7e9bff248d6a936feb376881136cb71042e5d9aeb48	COPY	`--chown=dynamo:0 --chmod=775 lib/ /workspace/lib/`	01/22/2026 8:22 PM UTC
557a66d45041a04444a359d67ff72cbd7cb8c3277c118a07299923a07ee96b00	COPY	`--chown=dynamo:0 --chmod=775 components/ /workspace/components/`	01/22/2026 8:22 PM UTC