Dynamo Tensorrt-LLM Runtime

NVIDIA

Container

NVIDIA

Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

Layer	Label		Created
a8ab7131ed568d4b80647e375901e015cfc45938064aec2725a4b6b49c3be1f2	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	01/23/2026 11:05 PM UTC
90ee592b82560fd5dac24c75acaac01144e0faa5ecd1cd82dc473f7006ba385b	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	01/23/2026 11:05 PM UTC
18ac899cde02f3736ba1d56359eb820356e31bb4bf9a3aa3bfd5a301ca2cab64	ENV	`DYNAMO_COMMIT_SHA=24adcb3e4636b4d7087bceb0ab463e6a3a2e2bd2`	01/23/2026 11:05 PM UTC
dac76104978b71962f6fbabb87452659b9156105a25989f0e3ae7e10f6d0f208	ARG	`DYNAMO_COMMIT_SHA=24adcb3e4636b4d7087bceb0ab463e6a3a2e2bd2`	01/23/2026 11:05 PM UTC
77b55f8e56d9759a6e8e86293fbf9c4bf89363004174be6d2f4420d7814ffb59	USER	`dynamo`	01/23/2026 11:05 PM UTC
69ffcdcbc0a8052c975f2ae5d3b9787d50f25f9836c74f9e6898d83127afe61a	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c chmod g+w ${VIRTUAL_ENV} /workspace /workspace/* /opt/dynamo /opt/dynamo/* && chown dynamo:0 ${VIRTUAL_ENV} /workspace /opt/dynamo/ && chmod 755 /opt/dynamo/.launch_screen && echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc`	01/23/2026 11:05 PM UTC
79d5aaccde04cae99424ac06fddc1d33ead38f5b4ab5493399623a3707f239ff	USER	`root`	01/23/2026 11:05 PM UTC
f3040840b74dbc15d17e70272ba40849605fafcc8fb2087c8eac66e5504a7bdf	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen`	01/23/2026 11:05 PM UTC
9eb68dc53fd398f4b4c8148724e4d2c94632f8e5caf7a104a96e3a39c8c2eb65	COPY	`--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/`	01/23/2026 11:05 PM UTC
dc208c8048d767bca9f90b2533c765b34b5e53468eb68ca4741226db1e2e0afa	COPY	`--chown=dynamo:0 --chmod=775 components/ /workspace/components/`	01/23/2026 11:05 PM UTC