ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
—
12/11/2025 10:33 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
12/11/2025 10:33 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
dynamo
12/11/2025 10:33 PM UTC
sha256:a8901c2b08cfce4f76392dc5d74e30e4eafe2647b2f87efb9626c45177211702RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac chmod 755 /opt/dynamo/.launch_screen &&
  echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
12/11/2025 10:33 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
root
12/11/2025 10:33 PM UTC
sha256:2b0d7309f29bfd2b21b1d0d458c852d8332df6927825d8eb0f3cdc1bbbbc168eRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
12/11/2025 10:33 PM UTC
sha256:7c3b148d53dcf5de80acf2a2f46a55026ce77e5c938db7627b32ba82cf0644b3COPY
--chown=dynamo: ATTRIBUTION* LICENSE /workspace/
12/11/2025 10:33 PM UTC
sha256:8259b2a9889fb90ce38804edfba3532af699e02b0c40038193c78fd88e5cc1eeCOPY
--chown=dynamo: . /workspace/
12/11/2025 10:33 PM UTC
sha256:6d57f434e46019fb910f6b706c3893c0ceb3a609340cff8078e034d0556939fdRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac UV_GIT_LFS=1 uv pip install --no-cache --requirement /tmp/requirements.txt --requirement /tmp/requirements.test.txt
12/11/2025 10:33 PM UTC
sha256:dd37f799cc1121bc94f43b847b7740ad6ac6e6611a56784e8e84c7e451f214feRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac uv pip install /opt/dynamo/wheelhouse/ai_dynamo_runtime*.whl /opt/dynamo/wheelhouse/ai_dynamo*any.whl /opt/dynamo/wheelhouse/nixl/nixl*.whl &&
  if [ "${ENABLE_KVBM}" = "true" ]; then uv pip install /opt/dynamo/wheelhouse/kvbm*.whl; fi &&
  cd /opt/dynamo/benchmarks &&
  UV_GIT_LFS=1 uv pip install --no-cache . &&
  cd - &&
  rm -rf /opt/dynamo/benchmarks
12/11/2025 10:33 PM UTC
...