Skip to main content
ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    Dynamo vLLM Runtime
    Container
    NVIDIA
    Dynamo vLLM Runtime

    The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    —
    		11/06/2025 12:23 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    		11/06/2025 12:23 AM UTC
    sha256:7a3d5e0a6c0ed8861729d8d9144ece07598e53323668e9ba85bcce0ed5ad5152RUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
    		11/06/2025 12:23 AM UTC
    sha256:4fa23071adac492cb842166a121d66155afa564890e3ddd4a63496a6ce0369c4COPY
    ATTRIBUTION* LICENSE /workspace/
    		11/06/2025 12:23 AM UTC
    sha256:97a4403b6c7b104a92d03ec3d22b69f0bca055c20a62da0e2826fb867a4a1c31COPY
    . /workspace/
    		11/06/2025 12:23 AM UTC
    sha256:e118f8b0c205eb740971241a4fb6b79462470383c42da9e7524c15230ae860c2RUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 UV_GIT_LFS=1 uv pip install --no-cache --requirement /tmp/requirements.txt --requirement /tmp/requirements.test.txt
    		11/06/2025 12:23 AM UTC
    sha256:da37709343b60cae667d2000f6240e60937ac92c712eba3f2a8297a19c0f7703RUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 uv pip install /opt/dynamo/wheelhouse/ai_dynamo_runtime*.whl /opt/dynamo/wheelhouse/ai_dynamo*any.whl /opt/dynamo/wheelhouse/nixl/nixl*.whl &&
  cd /opt/dynamo/benchmarks &&
  UV_GIT_LFS=1 uv pip install --no-cache . &&
  cd - &&
  rm -rf /opt/dynamo/benchmarks
    		11/06/2025 12:23 AM UTC
    sha256:d73126183965678d12eb987c4ca7e1d82c0441a0506954c34625c9eb99fd949dCOPY
    /opt/dynamo/wheelhouse/ /opt/dynamo/wheelhouse/
    		11/06/2025 12:22 AM UTC
    sha256:963074e1fd74f37d83c8cb00904a9531a860b9a89016d3a47af5b05b731a0b4aCOPY
    benchmarks/ /opt/dynamo/benchmarks/
    		11/06/2025 12:22 AM UTC
    sha256:e72f811555beeef02eae534fdc846f706b1cd66495253ff3133a0dbb01c50774COPY
    /opt/dynamo/venv /opt/dynamo/venv
    		11/06/2025 12:22 AM UTC
    ...