NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
12/11/2025 10:33 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
12/11/2025 10:33 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
dynamo
12/11/2025 10:33 PM UTC
sha256:a8901c2b08cfce4f76392dc5d74e30e4eafe2647b2f87efb9626c45177211702RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac chmod 755 /opt/dynamo/.launch_screen &&
  echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
12/11/2025 10:33 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
root
12/11/2025 10:33 PM UTC
sha256:2b0d7309f29bfd2b21b1d0d458c852d8332df6927825d8eb0f3cdc1bbbbc168eRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
12/11/2025 10:33 PM UTC
sha256:7c3b148d53dcf5de80acf2a2f46a55026ce77e5c938db7627b32ba82cf0644b3COPY
--chown=dynamo: ATTRIBUTION* LICENSE /workspace/
12/11/2025 10:33 PM UTC
sha256:8259b2a9889fb90ce38804edfba3532af699e02b0c40038193c78fd88e5cc1eeCOPY
--chown=dynamo: . /workspace/
12/11/2025 10:33 PM UTC
sha256:6d57f434e46019fb910f6b706c3893c0ceb3a609340cff8078e034d0556939fdRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac UV_GIT_LFS=1 uv pip install --no-cache --requirement /tmp/requirements.txt --requirement /tmp/requirements.test.txt
12/11/2025 10:33 PM UTC
sha256:dd37f799cc1121bc94f43b847b7740ad6ac6e6611a56784e8e84c7e451f214feRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac uv pip install /opt/dynamo/wheelhouse/ai_dynamo_runtime*.whl /opt/dynamo/wheelhouse/ai_dynamo*any.whl /opt/dynamo/wheelhouse/nixl/nixl*.whl &&
  if [ "${ENABLE_KVBM}" = "true" ]; then uv pip install /opt/dynamo/wheelhouse/kvbm*.whl; fi &&
  cd /opt/dynamo/benchmarks &&
  UV_GIT_LFS=1 uv pip install --no-cache . &&
  cd - &&
  rm -rf /opt/dynamo/benchmarks
12/11/2025 10:33 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.