ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
6cbf36f442bafe9a3ccb08cf50ccd93d9a8f41e727449b9df92e5306d0111343CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
08/08/2025 11:45 PM UTC
4ddd5d955ba8a4697302d3a3e747b2562a5dd6acb47a870e74f3bfe31a87cf29ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
08/08/2025 11:45 PM UTC
f6e7f8c4ed88d43b8fe0b783367c64f21f3d03ed2497cf59279834c663b04767RUN
ARCH_ALT=x86_64 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
08/08/2025 11:45 PM UTC
6e3b6cb99a96d627f23d4fbd74a13e222d19a46ef957e60ee152781405968ae6COPY
/workspace/ /workspace/
08/08/2025 11:45 PM UTC
4f3061ca5f3e2a726de1fce0cd139f225eaba10c60a15ca67e4cebd2d0af66d1COPY
/opt/dynamo/venv /opt/dynamo/venv
08/08/2025 11:45 PM UTC
d30543c22cd55db6d7069bc1fd5af822b6d7bbdf31fa75a99b33933907dcf309COPY
/workspace/target/release/metrics /usr/local/bin/metrics
08/08/2025 11:45 PM UTC
59d261086b456322fab1c176c6e145147cf4aef8fce3ce7215b1ba9ae96f058eENV
LD_LIBRARY_PATH=/opt/vllm/tools/ep_kernels/ep_kernels_workspace/nvshmem_install/lib:/opt/nvidia/nvda_nixl/lib/x86_64-linux-gnu:/opt/nvidia/nvda_nixl/lib/x86_64-linux-gnu/plugins:/usr/local/ucx/lib:/usr/local/ucx/lib/ucx:/usr/local/cuda/lib64
08/08/2025 11:45 PM UTC
b09e09969c9f51ef94f17094eb85cf586de5e5f26a82acc2eb5c7b3734c15cd7COPY
/opt/vllm /opt/vllm
08/08/2025 11:45 PM UTC
a366249e60b7ac45a1e90796d167240d16edf47422f2cd95fea2a85b7ea7a94cCOPY
/workspace/dist/*.whl wheelhouse/
08/08/2025 11:45 PM UTC
d5e2663bd5e96406be75dd9029cfb86d671ce2a85c2fb54bb9595cca8c23565aCOPY
/opt/nvidia/nvda_nixl /opt/nvidia/nvda_nixl
08/08/2025 11:45 PM UTC

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.