NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
05d5fae57168f7f1bc73141cab04fd6f8f40f89efd71d0d2dc447309b9018cf5CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
01/15/2026 2:06 PM UTC
444d372ee5d88c6ba835b72e3932c9d943d8a649808bf27b285225079a5de5f6ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
01/15/2026 2:06 PM UTC
c0a2806cc8b076f299bd03465b52885d3b521948e4e8b3341ddfb18871e4649dENV
DYNAMO_COMMIT_SHA=115531a0c0bf58ff12df7ef7e69082d50fd4d707
01/15/2026 2:06 PM UTC
a75e4a7017c5bc8bea1d2cc415d07ed18e0d10c6dd8fc7f71e22ceda83948428ARG
DYNAMO_COMMIT_SHA=115531a0c0bf58ff12df7ef7e69082d50fd4d707
01/15/2026 2:06 PM UTC
0508d4cd72ba293603386a694f869f535bec9c451a0c986335fc7938b73e2955USER
dynamo
01/15/2026 2:06 PM UTC
ad3d41830ce0712024c0707ff8bda867fa43b9f00a0ad909f5f105b8ff38ae3dRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c chmod g+w ${VIRTUAL_ENV} /workspace /workspace/* /opt/dynamo /opt/dynamo/* &&
  chown dynamo:0 ${VIRTUAL_ENV} /workspace /opt/dynamo/ &&
  chmod 755 /opt/dynamo/.launch_screen &&
  echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
01/15/2026 2:06 PM UTC
71e236f49bf4315a773cc47d6b3115bba4df543ca62b7b6444833dcd44a84aadUSER
root
01/15/2026 2:06 PM UTC
c6375ef04c1331ac0488640ea29e3fb0acd102eddbcbc25e757d1b6d6b63bdaeRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
01/15/2026 2:06 PM UTC
1413fd01d50d00f659da3ea95d2e3c81f2ee33b809c9f814561b1a22e41b773eCOPY
--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
01/15/2026 2:06 PM UTC
5ee8075c73cd2afc23357336b3116a68522624bb53f812d893561b6e58101cb3COPY
--chown=dynamo:0 --chmod=775 components/ /workspace/components/
01/15/2026 2:06 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.