Skip to main content
ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    Dynamo vLLM Runtime
    Container
    NVIDIA
    Dynamo vLLM Runtime

    The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    —
    		08/08/2025 11:45 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    		08/08/2025 11:45 PM UTC
    sha256:f7abbece7cd80403f76a53984f649693cabb49d229cfc7e83da794bb47d61695RUN
    ARCH_ALT=x86_64 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
    		08/08/2025 11:45 PM UTC
    sha256:a524e49dbd6e665687d4e539478d20f727c7aeae467a997788bf4d2bd99b2444COPY
    /workspace/ /workspace/
    		08/08/2025 11:45 PM UTC
    sha256:eba507c23436a3e9d50af7c21b116ca906ddb6e051fa2b0df01d52b7bfac41beCOPY
    /opt/dynamo/venv /opt/dynamo/venv
    		08/08/2025 11:45 PM UTC
    sha256:9b5b9f647672db82904ad76d58b52d902108bb45894f6b02af535775f9fb1c97COPY
    /workspace/target/release/metrics /usr/local/bin/metrics
    		08/08/2025 11:45 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    LD_LIBRARY_PATH=/opt/vllm/tools/ep_kernels/ep_kernels_workspace/nvshmem_install/lib:/opt/nvidia/nvda_nixl/lib/x86_64-linux-gnu:/opt/nvidia/nvda_nixl/lib/x86_64-linux-gnu/plugins:/usr/local/ucx/lib:/usr/local/ucx/lib/ucx:/usr/local/cuda/lib64
    		08/08/2025 11:45 PM UTC
    sha256:290ad30f152e1167236e6ddc39aaac533a80e8d77dc0933f1fa70c5f5b939227COPY
    /opt/vllm /opt/vllm
    		08/08/2025 11:45 PM UTC
    sha256:a30b827ce02516eb32790c8fd7e051613b5e55465436aa6aab900d6d9d3e797bCOPY
    /workspace/dist/*.whl wheelhouse/
    		08/08/2025 11:45 PM UTC
    sha256:7343b6e9d098e350a73148ce53d8a9ea944ff41bfbf19d82c0606880562fe048COPY
    /opt/nvidia/nvda_nixl /opt/nvidia/nvda_nixl
    		08/08/2025 11:45 PM UTC