ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
d8a50df0806ce1c94210ae561f5c7177072b499196c5f8980e6a76695d38422aCONFIG
WorkingDir /workspace
06/01/2026 4:38 AM UTC
a5bcfb8c063f1ef3d4aed0c761a12f313b219257da30ae9e340d33b8f28224c6ENV
DYNAMO_COMMIT_SHA=3953873a66652cf46a8f3d7b6803512b6d6a2b07
06/01/2026 4:38 AM UTC
b303e0eb0e05aeaf1e4720c2f8bcc453e1778c88401018f5a35e98233500c6a4ARG
DYNAMO_COMMIT_SHA=3953873a66652cf46a8f3d7b6803512b6d6a2b07
06/01/2026 4:38 AM UTC
092b71585875bdaf83485709088e3e90862506ce43668a03061c2654b17b47f9USER
dynamo
06/01/2026 4:38 AM UTC
41662bfc940bd4a9194e584357e2cb655deedd4cddaa8e9bd1cd7906691d980dRUN
PYTHON_VERSION=3.12 ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE=true VLLM_OMNI_REF=65b83d87ad786aa786b248f0242e2ed1b4a8161f VLLM_OMNI_GIT_URL=https://github.com/vllm-project/vllm-omni.git NIXL_REF=v1.1.0 CUDA_MAJOR=13 SITE_PACKAGES=/usr/local/lib/python3.12/dist-packages sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen &&
  chmod 755 /opt/dynamo/.launch_screen &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
06/01/2026 4:38 AM UTC
eb9925726ed5f9b3cfa4c526fec9896512c0ca81248cf2d4a3ff4dfcbca793e4USER
root
06/01/2026 4:38 AM UTC
5d05edd4ef0bb044cc2867a1514c7e18932d012fad2db53c71333a9d2a77c247COPY
--chown=dynamo:0 lib /workspace/lib
06/01/2026 4:38 AM UTC
eb22e82d9008e4c2ee338925882a4059288e4464186536d9f3ce703f9532f39dCOPY
--chown=dynamo:0 --chmod=775 components/src/dynamo/vllm /workspace/components/src/dynamo/vllm
06/01/2026 4:38 AM UTC
08e750b592a67f6d29cf1b0c3060720a63d5cf3cc248bcb1a69931b114d088a2COPY
--chown=dynamo:0 --chmod=775 components/src/dynamo/frontend /workspace/components/src/dynamo/frontend
06/01/2026 4:38 AM UTC
396f891454cf6c4f6f8e814f9b24065c35ace00515a609859a8b4fcd146b4c16COPY
--chown=dynamo:0 --chmod=775 components/src/dynamo/common /workspace/components/src/dynamo/common
06/01/2026 4:38 AM UTC
...