NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
1e1f09c9e6c6aa3f362b531f6966c88032d99cc886628649742283ab564045b6CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
12/11/2025 10:33 PM UTC
a471da84f4ca2415c165caf91393f513eac01831a9374aa7a6f54bc027b17098ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
12/11/2025 10:33 PM UTC
9c3135de4bde23d07f72a61d6ab6ee14b52f26f86e1cef2c88e8d8aed4e1a949USER
dynamo
12/11/2025 10:33 PM UTC
18fcce31b266e74ec2d11ba9ba6b17db934988b06c3a8f1a40827238e65315b6RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac chmod 755 /opt/dynamo/.launch_screen &&
  echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
12/11/2025 10:33 PM UTC
6d0ba0735d03c7427fcfc13456b34b2dd1c6a2e6eecf1c69f8087c0edfd9080cUSER
root
12/11/2025 10:33 PM UTC
f354685f82defd8b9325221ef34038d7ecacf5e2798f28d0f9604c04880cf3ffRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
12/11/2025 10:33 PM UTC
cceee3e8e42fb6409f614e4d94ea9f5b21ed9234f8d1e738a71058933af64fa3COPY
--chown=dynamo: ATTRIBUTION* LICENSE /workspace/
12/11/2025 10:33 PM UTC
842ccc0dd2bb32f20c060c7435eed7498779fd76368db798ec5ad3dafe5bcb87COPY
--chown=dynamo: . /workspace/
12/11/2025 10:33 PM UTC
34fe9c5a03030beb04b66fea1404a51f54238a0233e0f17b7dc4ef4947985b93RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac UV_GIT_LFS=1 uv pip install --no-cache --requirement /tmp/requirements.txt --requirement /tmp/requirements.test.txt
12/11/2025 10:33 PM UTC
79bc5c6209958eee3dab463762162fd2b29b919726aa360ecb73e7857bded204RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac uv pip install /opt/dynamo/wheelhouse/ai_dynamo_runtime*.whl /opt/dynamo/wheelhouse/ai_dynamo*any.whl /opt/dynamo/wheelhouse/nixl/nixl*.whl &&
  if [ "${ENABLE_KVBM}" = "true" ]; then uv pip install /opt/dynamo/wheelhouse/kvbm*.whl; fi &&
  cd /opt/dynamo/benchmarks &&
  UV_GIT_LFS=1 uv pip install --no-cache . &&
  cd - &&
  rm -rf /opt/dynamo/benchmarks
12/11/2025 10:33 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.