Dynamo vLLM Runtime | NVIDIA NGC

NVIDIA

Dynamo vLLM Runtime

Container

NVIDIA

Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

Layer	Label		Created
797eb7c827e1a72fba8cf7c03acfade072fab60c59f234d3ac5a9660cbc5d95d	CONFIG	`WorkingDir /workspace`	06/03/2026 12:33 AM UTC
9a222dbb9b97fdfada2dfdfb3924e1c3bd09d35a90b82bce8e2f6904d00207e3	ENV	`DYNAMO_COMMIT_SHA=bb319783d078e321eeb442de380e8add480be6e0`	06/03/2026 12:33 AM UTC
76bf0e39c1228d8b86b26b45d2ca055bc3bcc508d27c6ae0d77471e508273378	ARG	`DYNAMO_COMMIT_SHA=bb319783d078e321eeb442de380e8add480be6e0`	06/03/2026 12:33 AM UTC
068c0d9eebc4c238b3ee53938d106857b8b30dc31399a13c89f585b0796dcfaf	USER	`dynamo`	06/03/2026 12:33 AM UTC
209d929620ce06b400241a3cbd947023dabcf7d110cf694088ff1cd5b4cf3e45	RUN	`PYTHON_VERSION=3.12 ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE=true VLLM_OMNI_REF=v0.21.0rc1 sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen && chmod 755 /opt/dynamo/.launch_screen && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc`	06/03/2026 12:33 AM UTC
74b27f3727219afdb4cd28d6ec1c4d39bb8b9c8e0e0b9c523a5dfae15b9fed6f	USER	`root`	06/03/2026 12:33 AM UTC
b40f039f617b17ab646ea96336385f8fd7ff3a93952cd7bf1caa3979f7b768da	COPY	`--chown=dynamo:0 lib /workspace/lib`	06/03/2026 12:33 AM UTC
4d537d833e2c85902b5abcbf29706ad925c171a782e85ad0d927f7ec9dec2e98	COPY	`--chown=dynamo:0 --chmod=775 components/src/dynamo/vllm /workspace/components/src/dynamo/vllm`	06/03/2026 12:33 AM UTC
9638c5c6e6c042aa05fa17616ea44ebae7f825669d4c1edd1346a8f6bab26aa3	COPY	`--chown=dynamo:0 --chmod=775 components/src/dynamo/frontend /workspace/components/src/dynamo/frontend`	06/03/2026 12:33 AM UTC
555e1a3e02c49f94bc56b41eacfb911c53bb5185544f3c4f04d5b9bf69054055	COPY	`--chown=dynamo:0 --chmod=775 components/src/dynamo/common /workspace/components/src/dynamo/common`	06/03/2026 12:33 AM UTC