Dynamo vLLM Runtime | NVIDIA NGC

NVIDIA

Dynamo vLLM Runtime

Container

NVIDIA

Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

Layer	Label		Created
eead3a976fe7c6e3d1cf6cc8f3df9abd42e60b831590f42dbce93b7ee6859e7a	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	01/22/2026 8:23 PM UTC
91f249abaf1ae9b969320c855b0b942a43f7ecbdb14cc9d43daeb709b2eea614	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	01/22/2026 8:23 PM UTC
f107c0431a832d6b11eed662466d91ead267ce3ba38f90ae968c4a5a150e4723	ENV	`DYNAMO_COMMIT_SHA=5ea7ff0979feb0bb44c1191ee968959b871ae2bc`	01/22/2026 8:23 PM UTC
1a55694720b54eadfb3175d1b2219f9913c8d3eb18e0a86c10095e5b85b28ccf	ARG	`DYNAMO_COMMIT_SHA=5ea7ff0979feb0bb44c1191ee968959b871ae2bc`	01/22/2026 8:23 PM UTC
770d0896da1bcb6d126882f128b6673c505aaa3dec9a51372f7130e1771d33fc	USER	`dynamo`	01/22/2026 8:23 PM UTC
53d20ce3a101e33686784cc5d9848a05e5c0e625142126cc6670c5133a140fda	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c chmod g+w /workspace /workspace/* /opt/dynamo /opt/dynamo/* ${VIRTUAL_ENV} && chmod 755 /opt/dynamo/.launch_screen && echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc`	01/22/2026 8:23 PM UTC
2eb51d3ccb6a254e6e802dff7172c8a4de31310f84119f3d8cfcb8f163fb6194	USER	`root`	01/22/2026 8:23 PM UTC
3173fe18f09bc6e7abef43f4abbd0ccc2c8279a70cd23200f81fede006fb5fc7	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen`	01/22/2026 8:23 PM UTC
f5f0b7ad8dd5b11e49d184970f6d96e1ee7a2e110c6fccea8b892b47c0b5d5b1	COPY	`--chown=dynamo:0 --chmod=775 lib/ /workspace/lib/`	01/22/2026 8:23 PM UTC
53612961226c6143ee232710d43b0245fce379491afc3f7b7c6b13fe06075784	COPY	`--chown=dynamo:0 --chmod=775 components/ /workspace/components/`	01/22/2026 8:23 PM UTC