Dynamo vLLM Runtime | NVIDIA NGC

NVIDIA

Dynamo vLLM Runtime

Container

NVIDIA

Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`—`	08/08/2025 11:45 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	08/08/2025 11:45 PM UTC
sha256:f7abbece7cd80403f76a53984f649693cabb49d229cfc7e83da794bb47d61695	RUN	`ARCH_ALT=x86_64 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && echo "cat ~/.launch_screen" >> ~/.bashrc && echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc`	08/08/2025 11:45 PM UTC
sha256:a524e49dbd6e665687d4e539478d20f727c7aeae467a997788bf4d2bd99b2444	COPY	`/workspace/ /workspace/`	08/08/2025 11:45 PM UTC
sha256:eba507c23436a3e9d50af7c21b116ca906ddb6e051fa2b0df01d52b7bfac41be	COPY	`/opt/dynamo/venv /opt/dynamo/venv`	08/08/2025 11:45 PM UTC
sha256:9b5b9f647672db82904ad76d58b52d902108bb45894f6b02af535775f9fb1c97	COPY	`/workspace/target/release/metrics /usr/local/bin/metrics`	08/08/2025 11:45 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`LD_LIBRARY_PATH=/opt/vllm/tools/ep_kernels/ep_kernels_workspace/nvshmem_install/lib:/opt/nvidia/nvda_nixl/lib/x86_64-linux-gnu:/opt/nvidia/nvda_nixl/lib/x86_64-linux-gnu/plugins:/usr/local/ucx/lib:/usr/local/ucx/lib/ucx:/usr/local/cuda/lib64`	08/08/2025 11:45 PM UTC
sha256:290ad30f152e1167236e6ddc39aaac533a80e8d77dc0933f1fa70c5f5b939227	COPY	`/opt/vllm /opt/vllm`	08/08/2025 11:45 PM UTC
sha256:a30b827ce02516eb32790c8fd7e051613b5e55465436aa6aab900d6d9d3e797b	COPY	`/workspace/dist/*.whl wheelhouse/`	08/08/2025 11:45 PM UTC
sha256:7343b6e9d098e350a73148ce53d8a9ea944ff41bfbf19d82c0606880562fe048	COPY	`/opt/nvidia/nvda_nixl /opt/nvidia/nvda_nixl`	08/08/2025 11:45 PM UTC