Dynamo Tensorrt-LLM Runtime

NVIDIA

Container

NVIDIA

Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

Layer	Label		Created
33682f6e528f13b7a49a074193ceff5c23d98e799f08872809bf19b8cdc96726	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	01/27/2026 11:07 PM UTC
800fdbe8c693df403610175ef03acaab9c2710ebed048504d593a9e04780391f	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	01/27/2026 11:07 PM UTC
ac4b7dfde74c1cd3bdbbdd121b99adf6fb89830ce033d9c2ef368075b5d1ccb6	ENV	`DYNAMO_COMMIT_SHA=0cb760ffbc058c684c7ae7ff0edb15f2334d90ca`	01/27/2026 11:07 PM UTC
03178e0bc808b06b25c3ea744af1ba824495093b716b5e79eeacaea0b3efd962	ARG	`DYNAMO_COMMIT_SHA=0cb760ffbc058c684c7ae7ff0edb15f2334d90ca`	01/27/2026 11:07 PM UTC
e65d77c985d802b8dae164f87d8c198486b3b92eaefcc6aaedf405132b43eca6	USER	`dynamo`	01/27/2026 11:07 PM UTC
428bca8f0332d159b3fdbd645a737e5a58557296aeb72e328212f1d02153282a	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c chmod g+w ${VIRTUAL_ENV} /workspace /workspace/* /opt/dynamo /opt/dynamo/* && chown dynamo:0 ${VIRTUAL_ENV} /workspace /opt/dynamo/ && chmod 755 /opt/dynamo/.launch_screen && echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc`	01/27/2026 11:07 PM UTC
2687cc18df2c546dc1226c4074a5194aa4b84c188b217173478b1c475ce4af9f	USER	`root`	01/27/2026 11:07 PM UTC
a18176b8cb80d8c55b7fc61eeaaf9a9cf86ca31e4339952b15b5f353eb2c668c	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen`	01/27/2026 11:07 PM UTC
9924c2f185b50eacdd0fe383d5faa153d0f3e9c5f63c145b2e8a947b8dd634c2	COPY	`--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/`	01/27/2026 11:07 PM UTC
aabf560164d1013b688fa0f0d84a99ef194a0b3bed23fed75775efd76ffb1620	COPY	`--chown=dynamo:0 --chmod=775 components/ /workspace/components/`	01/27/2026 11:07 PM UTC