ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
957b86055f14b8bf0c3a10353fed1417a3cac6dcb3e1f42d4722906a1b640d0cCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
10/10/2025 8:58 PM UTC
10a468f0be977ac5916372f47c5390ab660e3ab6524fc599ab77b4a90f43edefENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
10/10/2025 8:58 PM UTC
379b37351b9ded60eb1544530a054bdd1dcdd39c53ba1be40cd0fec7900f3f88RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 PROM_VERSION=3.4.1 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
10/10/2025 8:58 PM UTC
06cb697ed36f8670d08571c97f538ad302a29325b515aaf2f1855e107f673eeeCOPY
ATTRIBUTION* LICENSE /workspace/
10/10/2025 8:58 PM UTC
6e5cecbafbcc49f7de6f02eb85bffa49b344453ee8f3b135a6d79d8cef413fdcCOPY
. /workspace/
10/10/2025 8:58 PM UTC
7107cdd3c64c358a8f4436f8c9c91bcdab85a684625aa85b047abf1a06de3ff5RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 PROM_VERSION=3.4.1 uv pip install --requirement /tmp/requirements.txt --requirement /tmp/requirements.test.txt
10/10/2025 8:58 PM UTC
556e536da749861a821270672f35509cb0c268d80c02d6b68556b0aa834a169bRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 PROM_VERSION=3.4.1 uv pip install /opt/dynamo/wheelhouse/ai_dynamo_runtime*cp312*.whl /opt/dynamo/wheelhouse/ai_dynamo*any.whl /opt/dynamo/wheelhouse/nixl/nixl*.whl &&
  cd /opt/dynamo/benchmarks &&
  uv pip install . &&
  cd - &&
  rm -rf /opt/dynamo/benchmarks
10/10/2025 8:58 PM UTC
0263b819782f73a97cbb010412e03b45eeac5f7039fbef905fe82c8b8061eab6COPY
/opt/dynamo/wheelhouse/ /opt/dynamo/wheelhouse/
10/10/2025 8:57 PM UTC
4b92c264409907931ac91f18a56a529d5a5049fedb345ff6a84447fadd8f2518COPY
benchmarks/ /opt/dynamo/benchmarks/
10/10/2025 8:57 PM UTC
81fbbc068bfa1b7b04431d0f5a2e639f47004c7bb9d075886dd5d0ba575d82c5COPY
/opt/dynamo/venv /opt/dynamo/venv
10/10/2025 8:57 PM UTC
...