ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
b9f4d788afded3175f75e03c54d0d8fa90104ba6a049d53c753fee0de5617adaCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
11/07/2025 1:18 AM UTC
73f951aaed313d23cfd1f6f7d4df6fb1540da427247727d516a3e114af54b96cENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
11/07/2025 1:18 AM UTC
c50d0df039a5a63f8bfa4fbefc3a0209391b70b9204dd5295380804d0e5da6faRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
11/07/2025 1:18 AM UTC
45724ba12f2b73040d4c25c1560bfe14b85fddf455c0223dd5b3292df1594c3fCOPY
ATTRIBUTION* LICENSE /workspace/
11/07/2025 1:18 AM UTC
11b8538f6b50c4f9dcee7335bc7e670cc9a39d90ca7dcb86700b8d7e9705cda5COPY
. /workspace/
11/07/2025 1:18 AM UTC
dc9f01bc5d803411df13ee93f345c72f872142a2b9b2f4598c04edd4d5508cf8RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 UV_GIT_LFS=1 uv pip install --no-cache --requirement /tmp/requirements.txt --requirement /tmp/requirements.test.txt
11/07/2025 1:18 AM UTC
00b1d15f8df29e04015a64c29dc15044aa0f17cf849cdbb16f0f989c877a3b56RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 uv pip install /opt/dynamo/wheelhouse/ai_dynamo_runtime*.whl /opt/dynamo/wheelhouse/ai_dynamo*any.whl /opt/dynamo/wheelhouse/nixl/nixl*.whl &&
  cd /opt/dynamo/benchmarks &&
  UV_GIT_LFS=1 uv pip install --no-cache . &&
  cd - &&
  rm -rf /opt/dynamo/benchmarks
11/07/2025 1:18 AM UTC
21e06a31c12d3197d018613b4c1330485b97510e886660707ee39bf33ff2d53cCOPY
/opt/dynamo/wheelhouse/ /opt/dynamo/wheelhouse/
11/07/2025 1:18 AM UTC
3f389990fbc25ee9923c6875360213cf7e84993d3464a7aaced623a41670ddb4COPY
benchmarks/ /opt/dynamo/benchmarks/
11/07/2025 1:18 AM UTC
c705021df9e59f0c77f0beaa1a90a674883462f799eb418aa3bc4c91493df2a5COPY
/opt/dynamo/venv /opt/dynamo/venv
11/07/2025 1:18 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.