ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
0bb1a549740d0a6b08a1fa527c2a2c49132413235ed2b48f639bef0c36896e1bCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
10/27/2025 5:12 PM UTC
8b9284f7942d97e2dfd31a579067477fadbe9fdeeae9734cf77dc558df0d8012ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
10/27/2025 5:12 PM UTC
38963df1e783b2c123eb9f5d98a0fb1b661a8c2915cc2a880c8115b552a48ce3RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
10/27/2025 5:12 PM UTC
bb1071f04df7bb2f13dac0ed2f968ab2d3a6001dd8ac7727b2f56506c9e7dd8dCOPY
ATTRIBUTION* LICENSE /workspace/
10/27/2025 5:12 PM UTC
0ba35904330499a74e2ead4d2352c486048ef45fd2a67f9158982e23fcbea397COPY
. /workspace/
10/27/2025 5:12 PM UTC
dc5ae8f3d3ba440c6b652ce83bc704e5218ff8b2ed59a28fc7ae0b4e41d344f7RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 UV_GIT_LFS=1 uv pip install --no-cache --requirement /tmp/requirements.txt --requirement /tmp/requirements.test.txt
10/27/2025 5:12 PM UTC
a5fdd8e3a37c1db32a56a76382e4c45a84f983383ff13f73f61b1222b30bd51eRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 uv pip install /opt/dynamo/wheelhouse/ai_dynamo_runtime*cp312*.whl /opt/dynamo/wheelhouse/ai_dynamo*any.whl /opt/dynamo/wheelhouse/nixl/nixl*.whl &&
  cd /opt/dynamo/benchmarks &&
  UV_GIT_LFS=1 uv pip install --no-cache . &&
  cd - &&
  rm -rf /opt/dynamo/benchmarks
10/27/2025 5:12 PM UTC
356dc7ad76b230e2a45804757f4e576d444c5af49f10e12247b83fe5f65d716aCOPY
/opt/dynamo/wheelhouse/ /opt/dynamo/wheelhouse/
10/27/2025 5:12 PM UTC
b61a18678096866bf7a1db45e7d137fbfc35c91018dac757d82a7d643bdd800bCOPY
benchmarks/ /opt/dynamo/benchmarks/
10/27/2025 5:12 PM UTC
5e24a7c46ae5283830cc4fdbfdbce38e0c6904a02696aacbba39cea52b76b0ddCOPY
/opt/dynamo/venv /opt/dynamo/venv
10/27/2025 5:12 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.