ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
ecf30fcd5a89088a60834e306c997fb94879ea5e1b3c47ec15dfb0c92eaa8ebcCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
11/06/2025 12:23 AM UTC
8dea15a7d37036b58dea716b1c327135b8ca1b2e90e7a019186cc46b4aa420e7ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
11/06/2025 12:23 AM UTC
8dd5b245617cd638e8c81c6b1dcaf48836e0b21ada09a50c0d06966892da704fRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
11/06/2025 12:23 AM UTC
05fead37a9dec4d99aa592f8a8a424d6d0a17f8b3612720a009483fc32059339COPY
ATTRIBUTION* LICENSE /workspace/
11/06/2025 12:23 AM UTC
81e5b5ca5feab1b6a08a93c79e8a600be5ec0e8f3d5db4b48b48dcca67c95448COPY
. /workspace/
11/06/2025 12:23 AM UTC
5ec5a8a6d811a559cca26942a300ea2ee2efd1ad84e3cb39aa91db73f2423453RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 UV_GIT_LFS=1 uv pip install --no-cache --requirement /tmp/requirements.txt --requirement /tmp/requirements.test.txt
11/06/2025 12:23 AM UTC
6d0976fc8c7becc60ed00df095e771ea39b9c8cd9ae4719d7a5bce9e11a3c24cRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 uv pip install /opt/dynamo/wheelhouse/ai_dynamo_runtime*.whl /opt/dynamo/wheelhouse/ai_dynamo*any.whl /opt/dynamo/wheelhouse/nixl/nixl*.whl &&
  cd /opt/dynamo/benchmarks &&
  UV_GIT_LFS=1 uv pip install --no-cache . &&
  cd - &&
  rm -rf /opt/dynamo/benchmarks
11/06/2025 12:23 AM UTC
7b7fb9ad8efdef46caad171d33e99e6df51c38a79e27109bab4d33aab6b557ddCOPY
/opt/dynamo/wheelhouse/ /opt/dynamo/wheelhouse/
11/06/2025 12:22 AM UTC
3d53799281da8b8a6e432c0af06712a8b7a3c364a79a36cb9d97fb9fb4892373COPY
benchmarks/ /opt/dynamo/benchmarks/
11/06/2025 12:22 AM UTC
38c6deefc5b30af449526af3ceaa4a71504dd5458b108d2e011a72725ff1df2aCOPY
/opt/dynamo/venv /opt/dynamo/venv
11/06/2025 12:22 AM UTC
...