ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
e31f9a4da3f49db71416c376fc4c27599accea0fa5d9018181e9e1b571317df7CONFIG
WorkingDir /workspace
06/08/2026 9:57 AM UTC
f4727272930f25cdacb951a6874be08d82d3bbdcf4e0860a3fd32458ccb799aaENV
DYNAMO_COMMIT_SHA=30f92beeb75eaf6f208c94eea42b15be150e1d85
06/08/2026 9:57 AM UTC
add91c59f144cac7e0a796f64a8e7f2a3248fb8ec10120570b6e705aaa88f7eaARG
DYNAMO_COMMIT_SHA=30f92beeb75eaf6f208c94eea42b15be150e1d85
06/08/2026 9:57 AM UTC
fee9bf2f40bfa913fc2fdf47e95371231e75a9725d4cdaa446bbcc69836e53c9USER
dynamo
06/08/2026 9:57 AM UTC
13bf9a444b9815a6fc5bd5507d3d34f9e7b67ebdcdd5428695b27d80822f1a9eRUN
PYTHON_VERSION=3.12 ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE=true VLLM_OMNI_REF=v0.21.0rc1 NIXL_REF=v1.1.0 CUDA_MAJOR=13 SITE_PACKAGES=/usr/local/lib/python3.12/dist-packages sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen &&
  chmod 755 /opt/dynamo/.launch_screen &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
06/08/2026 9:57 AM UTC
4193110d1f2101cbc2dfeb035606fbefad98d8474c5e3ad25a33e5c63f9e3013USER
root
06/08/2026 9:57 AM UTC
978e51a5b2e8caf7efdc2f749211078053890555878d5ffe21b12a0dadc958ffCOPY
--chown=dynamo:0 lib /workspace/lib
06/08/2026 9:57 AM UTC
960ca1e0ba530f6e845d08ebbcd92d744f3cca2167c61d5f6ad992487975591fCOPY
--chown=dynamo:0 --chmod=775 components/src/dynamo/vllm /workspace/components/src/dynamo/vllm
06/08/2026 9:57 AM UTC
e2177bc9cc76d83d3be6889ce2ba5c81994f399d0d3aebd6a4b2cc33bddaa6c5COPY
--chown=dynamo:0 --chmod=775 components/src/dynamo/frontend /workspace/components/src/dynamo/frontend
06/08/2026 9:57 AM UTC
24f769fafdfdffd17c7081724cf1245248aa32eb59d4df2f1d97ecee02d5e907COPY
--chown=dynamo:0 --chmod=775 components/src/dynamo/common /workspace/components/src/dynamo/common
06/08/2026 9:57 AM UTC
...