ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
9035efffbc7f980aa8a23e6d8d3e4eef99ea5319e5f86d8194885740326193f2CONFIG
WorkingDir /workspace
06/08/2026 9:57 AM UTC
7fc91a6d8aca4bbd193b34169c78abd344b4e6afcde513b16dcb41a8d9d672adENV
DYNAMO_COMMIT_SHA=30f92beeb75eaf6f208c94eea42b15be150e1d85
06/08/2026 9:57 AM UTC
b67cfe428c7ba4d84e790e44e9e717d48711389f7ebc572e1700f633ad0cf50fARG
DYNAMO_COMMIT_SHA=30f92beeb75eaf6f208c94eea42b15be150e1d85
06/08/2026 9:57 AM UTC
208a90730e43b0ffff32df104c5772fd063936fd9146a215a78aebbb589a6e18USER
dynamo
06/08/2026 9:57 AM UTC
831994faa360cad00343232107a514fffd4036e5a066f4dae9ad73f241c7f193RUN
PYTHON_VERSION=3.12 ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE=true VLLM_OMNI_REF=v0.21.0rc1 NIXL_REF=v1.1.0 CUDA_MAJOR=12 SITE_PACKAGES=/usr/local/lib/python3.12/dist-packages sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen &&
  chmod 755 /opt/dynamo/.launch_screen &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
06/08/2026 9:57 AM UTC
8f73fd63df68c6810a7f8af613d626a6459b8f9ff357057426a80b9277d893a1USER
root
06/08/2026 9:57 AM UTC
e9bd1ae14d3467a7ac326d56f5ac778d34c12bc018ce0564c74b919fe49abeacCOPY
--chown=dynamo:0 lib /workspace/lib
06/08/2026 9:57 AM UTC
e53f49a9a2c8153c050eabcc45736e41f003bc0543b12976a6f264d295b5749cCOPY
--chown=dynamo:0 --chmod=775 components/src/dynamo/vllm /workspace/components/src/dynamo/vllm
06/08/2026 9:57 AM UTC
b1de995e23b663beb4290b522a5707e8168eba3eda9a9b7456f45d74dffa404dCOPY
--chown=dynamo:0 --chmod=775 components/src/dynamo/frontend /workspace/components/src/dynamo/frontend
06/08/2026 9:57 AM UTC
4a5d4718d16bb425f9cc49a9271538e88169c1d8604898d9aebb3c1ba2cb901bCOPY
--chown=dynamo:0 --chmod=775 components/src/dynamo/common /workspace/components/src/dynamo/common
06/08/2026 9:57 AM UTC
...