ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
—
08/08/2025 11:45 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
08/08/2025 11:45 PM UTC
sha256:f7abbece7cd80403f76a53984f649693cabb49d229cfc7e83da794bb47d61695RUN
ARCH_ALT=x86_64 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
08/08/2025 11:45 PM UTC
sha256:a524e49dbd6e665687d4e539478d20f727c7aeae467a997788bf4d2bd99b2444COPY
/workspace/ /workspace/
08/08/2025 11:45 PM UTC
sha256:eba507c23436a3e9d50af7c21b116ca906ddb6e051fa2b0df01d52b7bfac41beCOPY
/opt/dynamo/venv /opt/dynamo/venv
08/08/2025 11:45 PM UTC
sha256:9b5b9f647672db82904ad76d58b52d902108bb45894f6b02af535775f9fb1c97COPY
/workspace/target/release/metrics /usr/local/bin/metrics
08/08/2025 11:45 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
LD_LIBRARY_PATH=/opt/vllm/tools/ep_kernels/ep_kernels_workspace/nvshmem_install/lib:/opt/nvidia/nvda_nixl/lib/x86_64-linux-gnu:/opt/nvidia/nvda_nixl/lib/x86_64-linux-gnu/plugins:/usr/local/ucx/lib:/usr/local/ucx/lib/ucx:/usr/local/cuda/lib64
08/08/2025 11:45 PM UTC
sha256:290ad30f152e1167236e6ddc39aaac533a80e8d77dc0933f1fa70c5f5b939227COPY
/opt/vllm /opt/vllm
08/08/2025 11:45 PM UTC
sha256:a30b827ce02516eb32790c8fd7e051613b5e55465436aa6aab900d6d9d3e797bCOPY
/workspace/dist/*.whl wheelhouse/
08/08/2025 11:45 PM UTC
sha256:7343b6e9d098e350a73148ce53d8a9ea944ff41bfbf19d82c0606880562fe048COPY
/opt/nvidia/nvda_nixl /opt/nvidia/nvda_nixl
08/08/2025 11:45 PM UTC