Skip to main content
ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    Dynamo vLLM Runtime
    Container
    NVIDIA
    Dynamo vLLM Runtime

    The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    —
    		11/07/2025 1:18 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    		11/07/2025 1:18 AM UTC
    sha256:4e53143cd31e0eafd018b665a452a3939ceb64f9e89d90f7541569cf0b7f5896RUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
    		11/07/2025 1:18 AM UTC
    sha256:ddc0b0ff8fbe6669fa9e02d6d8f448750da8b8c3765665ed715d835800e66a47COPY
    ATTRIBUTION* LICENSE /workspace/
    		11/07/2025 1:18 AM UTC
    sha256:4a92d2d56e4feaf3292fe33338bfd51c0090fde52eda349c0488661808812803COPY
    . /workspace/
    		11/07/2025 1:18 AM UTC
    sha256:ee12c17172084d2586188822bede163c4ffc76031da8b95a62e0f94ea34315b1RUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 UV_GIT_LFS=1 uv pip install --no-cache --requirement /tmp/requirements.txt --requirement /tmp/requirements.test.txt
    		11/07/2025 1:18 AM UTC
    sha256:4b8ab9c169dba3207f71f0eb532787e78e5f08b5846e5e816940b2da851953fcRUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 uv pip install /opt/dynamo/wheelhouse/ai_dynamo_runtime*.whl /opt/dynamo/wheelhouse/ai_dynamo*any.whl /opt/dynamo/wheelhouse/nixl/nixl*.whl &&
  cd /opt/dynamo/benchmarks &&
  UV_GIT_LFS=1 uv pip install --no-cache . &&
  cd - &&
  rm -rf /opt/dynamo/benchmarks
    		11/07/2025 1:18 AM UTC
    sha256:94d532a455a1ad209c605b8dd965fa3bdccc02240568f81461edfa906aa41432COPY
    /opt/dynamo/wheelhouse/ /opt/dynamo/wheelhouse/
    		11/07/2025 1:18 AM UTC
    sha256:d718a5b440a9740424fd9af751e13f264f023eabfe3d2ef440b0fb1f119a4692COPY
    benchmarks/ /opt/dynamo/benchmarks/
    		11/07/2025 1:18 AM UTC
    sha256:bd40c5eb0f5bbbf60b8255284b264b56f6ff8d929eaed4d3fadee8612292a4e0COPY
    /opt/dynamo/venv /opt/dynamo/venv
    		11/07/2025 1:18 AM UTC
    ...