Dynamo vLLM Runtime | NVIDIA NGC

NVIDIA

Dynamo vLLM Runtime

Container

NVIDIA

Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

Layer	Label		Created
15bdbce420c35a38b69d17019ff8a2b5be9ee7ff9aa6a7ba566439dc189229f7	CONFIG	`WorkingDir /workspace`	06/11/2026 10:43 PM UTC
310519d0fe51164b2b403ea9f18dfc16b3f19f12d5b5fe64896702f8973cbec7	ENV	`DYNAMO_COMMIT_SHA=dd735a0c084842078ae2ba0eecde956be5ec495d`	06/11/2026 10:43 PM UTC
dcb0719e2506daaca36e2d178c6f34de8d4de89bf825b53c17e58b6f8ca3c139	ARG	`DYNAMO_COMMIT_SHA=dd735a0c084842078ae2ba0eecde956be5ec495d`	06/11/2026 10:43 PM UTC
10fd64fbb727c7465cef7ff2c7abe5f654c8dafd71b0000f077d8dab22f37c87	USER	`dynamo`	06/11/2026 10:43 PM UTC
6b3dc2d458052e37d9bba533fa8a9d78a098de64d1ea38d1332dc6c6927f1018	RUN	`PYTHON_VERSION=3.12 ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE=true VLLM_OMNI_REF=v0.21.0rc1 sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen && chmod 755 /opt/dynamo/.launch_screen && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc`	06/11/2026 10:43 PM UTC
fbada910fa43ac1d2f261fbfc50563c2ed607dc4147a0e291e4599b7f185fc6c	USER	`root`	06/11/2026 10:43 PM UTC
13f9a2e2e4ef754ad0fa3242fd9fde3bf327e6e5ddb31e4e0eec032e59074608	COPY	`--chown=dynamo:0 lib /workspace/lib`	06/11/2026 10:43 PM UTC
272f3a0e49148a430c9c9293a1d8a383b7890884bd9b92085382798d73636911	COPY	`--chown=dynamo:0 --chmod=775 components/src/dynamo/vllm /workspace/components/src/dynamo/vllm`	06/11/2026 10:43 PM UTC
7647e7d140b1a14f876d426bc2793fa30e75cab908802d8984b41a4ef59db239	COPY	`--chown=dynamo:0 --chmod=775 components/src/dynamo/frontend /workspace/components/src/dynamo/frontend`	06/11/2026 10:43 PM UTC
f79c11f5a3171e052f98d20b1adfed2059c436432baa4c747bdc26ca39b8ff16	COPY	`--chown=dynamo:0 --chmod=775 components/src/dynamo/common /workspace/components/src/dynamo/common`	06/11/2026 10:43 PM UTC