NVIDIA
NVIDIA
Dynamo vLLM Runtime
Container
NVIDIA
NVIDIA
Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

LayerLabelCreated
d9697fb10b81363e4fe019bdadfb9c387e6b987306c64611b6a617611df103b4CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
02/12/2026 1:07 AM UTC
b89a0f3c4a7f2615c811807966c9dcab0453744bb667279115bb572ff52deaf5ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
02/12/2026 1:07 AM UTC
f404cc9f98ee7ae127b0477ddbb431d34d13bdc10d9eb7c5afd2775aedbbc811ENV
DYNAMO_COMMIT_SHA=76c1889aeb078219eb4fbd2b0c0fc21df75d8d0b
02/12/2026 1:07 AM UTC
e491e95dd6d73428bfe07a4c5eeed61166804f1172d9f66542b999ecc7b942e0ARG
DYNAMO_COMMIT_SHA=76c1889aeb078219eb4fbd2b0c0fc21df75d8d0b
02/12/2026 1:07 AM UTC
5175c62ba55bf0c9f02cc7724485f046a268ca0fa672302754782e671157c09dUSER
dynamo
02/12/2026 1:07 AM UTC
4118d803d7f3657a01b0f09e6ef1b04bc77fa28ad73456b8f30c50d10222c8e6RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 SITE_PACKAGES=/opt/dynamo/venv/lib/python3.12/site-packages ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE=true /bin/bash -l -o pipefail -c cd /usr/local/lib &&
  if [ -f libaws-c-common.so.1.0.0 ] &&
  [ ! -L libaws-c-common.so.1 ]; then rm -f libaws-c-common.so.1 libaws-c-common.so &&
  ln -s libaws-c-common.so.1.0.0 libaws-c-common.so.1 &&
  ln -s libaws-c-common.so.1 libaws-c-common.so; fi &&
  if [ -f libaws-c-s3.so.1.0.0 ] &&
  [ ! -L libaws-c-s3.so.0unstable ]; then rm -f libaws-c-s3.so.0unstable libaws-c-s3.so &&
  ln -s libaws-c-s3.so.1.0.0 libaws-c-s3.so.0unstable &&
  ln -s libaws-c-s3.so.0unstable libaws-c-s3.so; fi &&
  if [ -f libs2n.so.1.0.0 ] &&
  [ ! -L libs2n.so.1 ]; then rm -f libs2n.so.1 libs2n.so &&
  ln -s libs2n.so.1.0.0 libs2n.so.1 &&
  ln -s libs2n.so.1 libs2n.so; fi &&
  for lib in libcrypto libssl; do versioned=$(ls -1 ${lib}.so.1.1.* 2>/dev/null | head -1); if [ -n "$versioned" ] &&
  [ ! -L "${lib}.so.1.1" ]; then rm -f "${lib}.so.1.1" &&
  ln -s "$(basename "$versioned")" "${lib}.so.1.1"; fi; done &&
  ldconfig
02/12/2026 1:07 AM UTC
3c4b8daa994ab08e263da9ecd6cf606a0414cbbbd87236f0a5da749af9be2ad2RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 SITE_PACKAGES=/opt/dynamo/venv/lib/python3.12/site-packages ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE=true /bin/bash -l -o pipefail -c chmod g+w /workspace /workspace/* /opt/dynamo /opt/dynamo/* ${VIRTUAL_ENV} &&
  chmod 755 /opt/dynamo/.launch_screen &&
  echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
02/12/2026 1:07 AM UTC
f24d207e22bc1650587ddb003b9b297b9d312726ef0e2b35478480ed05a341d9USER
root
02/12/2026 1:07 AM UTC
1dd29efb1154d9a14338590c2d8a35e85da7dba166400f055a8f13e99a225cfcRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 SITE_PACKAGES=/opt/dynamo/venv/lib/python3.12/site-packages ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE=true /bin/bash -l -o pipefail -c sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
02/12/2026 1:07 AM UTC
adec19c21a294c2878ec252c3b9d5e349ca816497e0213b0da627c090787b6e4COPY
--chown=dynamo:0 --chmod=775 lib/ /workspace/lib/
02/12/2026 1:07 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.