ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
51217873364560cc5e65e983ccf8138f247acea9492506593eb84403e4cfacd4CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
09/17/2025 8:54 PM UTC
a83675eb750cf6aafc7ab6e22cbd43c456db036727d252c36d0d73be4a837235ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
09/17/2025 8:54 PM UTC
e8c3b94085fd1dc8a51d5653e17c02f9923f716ef2a45ea64cfc17bba1ca412fRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 PROM_VERSION=3.4.1 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
09/17/2025 8:54 PM UTC
53bb889b8819c12628d4e007489f7cfd7a3cdf9855fdcdf8e3933f6b338aee23COPY
ATTRIBUTION* LICENSE /workspace/
09/17/2025 8:54 PM UTC
0810e6ab6f008b2b8116ef0061bef75fc607fc2e372f439415ad29acfc50b175COPY
. /workspace/
09/17/2025 8:54 PM UTC
1b362fb50eab976e1b2b7c7949a46ca0f95101782898dc79191762af7c6d1dffRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 PROM_VERSION=3.4.1 uv pip install --requirement /tmp/requirements.txt --requirement /tmp/requirements.test.txt
09/17/2025 8:54 PM UTC
ea4e30da5dd0ba043afa0fa712a403c1c4a78f0ce8ace97177088d336295db2eRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 PROM_VERSION=3.4.1 uv pip install /opt/dynamo/wheelhouse/ai_dynamo_runtime*cp312*.whl /opt/dynamo/wheelhouse/ai_dynamo*any.whl /opt/dynamo/wheelhouse/nixl/nixl*.whl /opt/dynamo/benchmarks &&
  rm -rf /opt/dynamo/benchmarks
09/17/2025 8:54 PM UTC
93d8d193532438e60ba46257e254f784dc04aa0ee761440fcf98f833d988b240COPY
/opt/dynamo/wheelhouse/ /opt/dynamo/wheelhouse/
09/17/2025 8:54 PM UTC
e5201c0a97876f1f57c139d09ee72772d80ee9385d914c5632f44c27c1bcedb1COPY
benchmarks/ /opt/dynamo/benchmarks/
09/17/2025 8:54 PM UTC
2e69eaf072d66bb7ff657c658bfdf867862ccfca3b434082dd9b494b5165119bCOPY
/opt/dynamo/venv /opt/dynamo/venv
09/17/2025 8:54 PM UTC
...