ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
75d093035ce83414abe57a0df72836053e878c01bb342cfc005c02f2c15156c9CONFIG
WorkingDir /workspace
06/03/2026 12:27 AM UTC
57ba99744ef097879e747de3ca10d92c56f82fa377803a047d774aee37ea6c02ENV
DYNAMO_COMMIT_SHA=1a74d254bfcebc50b837d25dcb4f5ee7c6c2f7d3
06/03/2026 12:27 AM UTC
49b280b153a818ea27fa8374f01d14ebc42b496fa2432a71090428fca3949f77ARG
DYNAMO_COMMIT_SHA=1a74d254bfcebc50b837d25dcb4f5ee7c6c2f7d3
06/03/2026 12:27 AM UTC
49736746d453c6f2a52887eb5364ad3ec3999a9b1a6071313773341e99a60550USER
dynamo
06/03/2026 12:27 AM UTC
0cd1827e7319329104e7965a08deea7d87c55456cfc364c8af45aeeec953b0d9RUN
PYTHON_VERSION=3.12 ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE=true VLLM_OMNI_REF=v0.21.0rc1 NIXL_REF=v1.1.0 CUDA_MAJOR=13 SITE_PACKAGES=/usr/local/lib/python3.12/dist-packages sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen &&
  chmod 755 /opt/dynamo/.launch_screen &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
06/03/2026 12:27 AM UTC
e198b50be9d7a1a808dc2996b8fcb84274f33a78ccb751aaee6bf9073da62a66USER
root
06/03/2026 12:27 AM UTC
5b3362f3bd3c5895f2ee72e4ead2e537c04a0d459e5f2df099b29dcb99bfcdf8COPY
--chown=dynamo:0 lib /workspace/lib
06/03/2026 12:27 AM UTC
6736d049aa1ed0d268df74cc14587b9ae349e3087ec32f0210884b48f3d61663COPY
--chown=dynamo:0 --chmod=775 components/src/dynamo/vllm /workspace/components/src/dynamo/vllm
06/03/2026 12:27 AM UTC
bd5b76bb35471f1801b990f14b850b1f4c520385981d743833095fd55ea81bf2COPY
--chown=dynamo:0 --chmod=775 components/src/dynamo/frontend /workspace/components/src/dynamo/frontend
06/03/2026 12:27 AM UTC
6886162d63667ec3e8f0ca5a08502c32120a077657c87675ab19c4784cf2f276COPY
--chown=dynamo:0 --chmod=775 components/src/dynamo/common /workspace/components/src/dynamo/common
06/03/2026 12:27 AM UTC
...