Dynamo Tensorrt-LLM Runtime

NVIDIA

Container

NVIDIA

Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

Layer	Label		Created
05d5fae57168f7f1bc73141cab04fd6f8f40f89efd71d0d2dc447309b9018cf5	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	01/15/2026 2:06 PM UTC
444d372ee5d88c6ba835b72e3932c9d943d8a649808bf27b285225079a5de5f6	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	01/15/2026 2:06 PM UTC
c0a2806cc8b076f299bd03465b52885d3b521948e4e8b3341ddfb18871e4649d	ENV	`DYNAMO_COMMIT_SHA=115531a0c0bf58ff12df7ef7e69082d50fd4d707`	01/15/2026 2:06 PM UTC
a75e4a7017c5bc8bea1d2cc415d07ed18e0d10c6dd8fc7f71e22ceda83948428	ARG	`DYNAMO_COMMIT_SHA=115531a0c0bf58ff12df7ef7e69082d50fd4d707`	01/15/2026 2:06 PM UTC
0508d4cd72ba293603386a694f869f535bec9c451a0c986335fc7938b73e2955	USER	`dynamo`	01/15/2026 2:06 PM UTC
ad3d41830ce0712024c0707ff8bda867fa43b9f00a0ad909f5f105b8ff38ae3d	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c chmod g+w ${VIRTUAL_ENV} /workspace /workspace/* /opt/dynamo /opt/dynamo/* && chown dynamo:0 ${VIRTUAL_ENV} /workspace /opt/dynamo/ && chmod 755 /opt/dynamo/.launch_screen && echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc`	01/15/2026 2:06 PM UTC
71e236f49bf4315a773cc47d6b3115bba4df543ca62b7b6444833dcd44a84aad	USER	`root`	01/15/2026 2:06 PM UTC
c6375ef04c1331ac0488640ea29e3fb0acd102eddbcbc25e757d1b6d6b63bdae	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen`	01/15/2026 2:06 PM UTC
1413fd01d50d00f659da3ea95d2e3c81f2ee33b809c9f814561b1a22e41b773e	COPY	`--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/`	01/15/2026 2:06 PM UTC
5ee8075c73cd2afc23357336b3116a68522624bb53f812d893561b6e58101cb3	COPY	`--chown=dynamo:0 --chmod=775 components/ /workspace/components/`	01/15/2026 2:06 PM UTC