Dynamo vLLM Runtime | NVIDIA NGC

NVIDIA

Dynamo vLLM Runtime

Container

NVIDIA

Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

Layer	Label		Created
2a24f9a9824bdc6a5a526edba33df8bb1c01dd262694d5baab3e4445b1847a79	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	12/13/2025 12:07 AM UTC
175f757c9397600fb737656516d0420d299c1660412929f15926d3f130740c44	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	12/13/2025 12:07 AM UTC
bbf1b4d08fe14aab83bc9b03bf1be85c4221d731ba581ef5bd1361c7a6627d06	USER	`dynamo`	12/13/2025 12:07 AM UTC
a8e52ebfade272d168e5861ceb066e17c065dc7f13e9e823ea7398b787e2f85b	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=4e4b487ba2baa3f8887dfa49cf6cb35c7bb62022 chmod 755 /opt/dynamo/.launch_screen && echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc`	12/13/2025 12:07 AM UTC
1e72f40501376089cd98a0264cf20d526378d773a3b39a6e04b6e69915cb9e41	USER	`root`	12/13/2025 12:07 AM UTC
a542978048d30d1e19e655488a20ebd658d4bdc10016e2d53269eb7749f36cf1	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=4e4b487ba2baa3f8887dfa49cf6cb35c7bb62022 sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen`	12/13/2025 12:07 AM UTC
36757fccff36716113e76387ce9a2bfb95709653f0548810e2c0a295a374dd10	COPY	`--chown=dynamo: ATTRIBUTION* LICENSE /workspace/`	12/13/2025 12:07 AM UTC
eb93e69ce24f35203f4a5ba45ca58dcf8b6dbc1d1ce217cd3a2a0ffbad7427d2	COPY	`--chown=dynamo: lib/ /workspace/lib/`	12/13/2025 12:07 AM UTC
ae028ef46da014eace3605aaa4b99c2b3de59c3bdcf56d5a028d2d0e271ac529	COPY	`--chown=dynamo: components/ /workspace/components/`	12/13/2025 12:07 AM UTC
65b7f30eee572b1a5641b78c0beab0ad61b37c432f58b60dbc700dedf957e526	COPY	`--chown=dynamo: recipes/ /workspace/recipes/`	12/13/2025 12:07 AM UTC