Skip to main content
ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    Dynamo vLLM Runtime
    Container
    NVIDIA
    Dynamo vLLM Runtime

    The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    —
    		11/26/2025 5:31 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    		11/26/2025 5:31 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    dynamo
    		11/26/2025 5:31 PM UTC
    sha256:92445eea40160284d8da0a57110019667c018d7f2f3b515dfdbe2c3910ddd101RUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=f49d6873e417ef82090ed492ef00b6939bd5a8d0 chmod 755 /opt/dynamo/.launch_screen &&
  echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
    		11/26/2025 5:31 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    root
    		11/26/2025 5:31 PM UTC
    sha256:62ca530023c909d49c8094d4072802065c79a9eac4d750b288f5cca4331e8366RUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=f49d6873e417ef82090ed492ef00b6939bd5a8d0 sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
    		11/26/2025 5:31 PM UTC
    sha256:11cd593b60e5ab7e4b57b54df177ed46f2517d6ac996a6285f67f7602ef865a8COPY
    --chown=dynamo: ATTRIBUTION* LICENSE /workspace/
    		11/26/2025 5:31 PM UTC
    sha256:e71810b3942debb9165e016e2c67c485c12bb362e60bb86900d14ac3bca1a3fdCOPY
    --chown=dynamo: . /workspace/
    		11/26/2025 5:31 PM UTC
    sha256:3c117cc449e8b068d968ff4c95e3d95aeac56029378f19fe20ffa3d71a052e98RUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=f49d6873e417ef82090ed492ef00b6939bd5a8d0 UV_GIT_LFS=1 uv pip install --no-cache --requirement /tmp/requirements.txt --requirement /tmp/requirements.test.txt
    		11/26/2025 5:31 PM UTC
    sha256:0bea8f297979069b674732566e50e9c16dbcae0e588ee76b2fafd2bd1e6514b8RUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true DYNAMO_COMMIT_SHA=f49d6873e417ef82090ed492ef00b6939bd5a8d0 uv pip install /opt/dynamo/wheelhouse/ai_dynamo_runtime*.whl /opt/dynamo/wheelhouse/ai_dynamo*any.whl /opt/dynamo/wheelhouse/nixl/nixl*.whl &&
  if [ "${ENABLE_KVBM}" = "true" ]; then uv pip install /opt/dynamo/wheelhouse/kvbm*.whl; fi &&
  cd /opt/dynamo/benchmarks &&
  UV_GIT_LFS=1 uv pip install --no-cache . &&
  cd - &&
  rm -rf /opt/dynamo/benchmarks
    		11/26/2025 5:31 PM UTC
    ...