ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
a1801fe7125b867aef2712a301987979d726a3a0def67e3820817e9155592b5eCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
08/27/2025 3:33 AM UTC
09b4b4561684abdbfa9f8de9793c506a5fe3e53f2526616107e24be65b6c06e7ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
08/27/2025 3:33 AM UTC
958ee9d0851ee0b84aef95023762f3f5e319e66175055b9f43f748be6357bb15RUN
ARCH_ALT=x86_64 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
08/27/2025 3:33 AM UTC
2f38052a22d980fb3384a04dee6ba0a8d7281a439466ce35469026b3b70bda2eCOPY
/workspace/ /workspace/
08/27/2025 3:33 AM UTC
ec1ab6d8683c41625845a8abf04499dbe8186e6f17293a8e9c71b1308f641cfeCOPY
/opt/dynamo/venv /opt/dynamo/venv
08/27/2025 3:33 AM UTC
f89f4d75139da7072d884f15c70796535691617b7281236004b7b0e971fafd27COPY
/workspace/target/release/metrics /usr/local/bin/metrics
08/27/2025 3:33 AM UTC
04877711a5292072c28910c45df9bb09c9c0d039fcb4522fab3947eec6603844ENV
LD_LIBRARY_PATH=/opt/vllm/tools/ep_kernels/ep_kernels_workspace/nvshmem_install/lib:/opt/nvidia/nvda_nixl/lib/x86_64-linux-gnu:/opt/nvidia/nvda_nixl/lib/x86_64-linux-gnu/plugins:/usr/local/ucx/lib:/usr/local/ucx/lib/ucx:/usr/local/cuda/lib64
08/27/2025 3:33 AM UTC
88a6de29b1682ee2b72ca1aaf5d094c39bf94fd1d283cb981f72f3ea23b9e165COPY
/opt/vllm /opt/vllm
08/27/2025 3:33 AM UTC
19ee7b1ccfcfe2ed3dc624978d9faaf4823cc355392ed4f771e7f0e77d5f3310COPY
/workspace/dist/*.whl wheelhouse/
08/27/2025 3:32 AM UTC
dba2a64ceece289c6aaa70f6a28eb6442adfcb0ed6418ebd79241ff06f6ee2acCOPY
/opt/nvidia/nvda_nixl /opt/nvidia/nvda_nixl
08/27/2025 3:32 AM UTC