NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
15bdbce420c35a38b69d17019ff8a2b5be9ee7ff9aa6a7ba566439dc189229f7CONFIG
WorkingDir /workspace
06/11/2026 10:43 PM UTC
310519d0fe51164b2b403ea9f18dfc16b3f19f12d5b5fe64896702f8973cbec7ENV
DYNAMO_COMMIT_SHA=dd735a0c084842078ae2ba0eecde956be5ec495d
06/11/2026 10:43 PM UTC
dcb0719e2506daaca36e2d178c6f34de8d4de89bf825b53c17e58b6f8ca3c139ARG
DYNAMO_COMMIT_SHA=dd735a0c084842078ae2ba0eecde956be5ec495d
06/11/2026 10:43 PM UTC
10fd64fbb727c7465cef7ff2c7abe5f654c8dafd71b0000f077d8dab22f37c87USER
dynamo
06/11/2026 10:43 PM UTC
6b3dc2d458052e37d9bba533fa8a9d78a098de64d1ea38d1332dc6c6927f1018RUN
PYTHON_VERSION=3.12 ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE=true VLLM_OMNI_REF=v0.21.0rc1 sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen &&
  chmod 755 /opt/dynamo/.launch_screen &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
06/11/2026 10:43 PM UTC
fbada910fa43ac1d2f261fbfc50563c2ed607dc4147a0e291e4599b7f185fc6cUSER
root
06/11/2026 10:43 PM UTC
13f9a2e2e4ef754ad0fa3242fd9fde3bf327e6e5ddb31e4e0eec032e59074608COPY
--chown=dynamo:0 lib /workspace/lib
06/11/2026 10:43 PM UTC
272f3a0e49148a430c9c9293a1d8a383b7890884bd9b92085382798d73636911COPY
--chown=dynamo:0 --chmod=775 components/src/dynamo/vllm /workspace/components/src/dynamo/vllm
06/11/2026 10:43 PM UTC
7647e7d140b1a14f876d426bc2793fa30e75cab908802d8984b41a4ef59db239COPY
--chown=dynamo:0 --chmod=775 components/src/dynamo/frontend /workspace/components/src/dynamo/frontend
06/11/2026 10:43 PM UTC
f79c11f5a3171e052f98d20b1adfed2059c436432baa4c747bdc26ca39b8ff16COPY
--chown=dynamo:0 --chmod=775 components/src/dynamo/common /workspace/components/src/dynamo/common
06/11/2026 10:43 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.