Dynamo Tensorrt-LLM Runtime

NVIDIA

Container

NVIDIA

Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

Layer	Label		Created
5a654940d50abdd9168be34ee5af3249eeb42a26f8f2996a1fd3af75fccb8a30	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	12/05/2025 8:01 PM UTC
49bdeb3d996292c6eec834739a3d42a1effa68763017c3f2834f82899ab19533	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	12/05/2025 8:01 PM UTC
a19b5f7eec8b52fd840bce78a1b0ff16e70e1ac9a0282abb1355bc528ae61a5e	USER	`dynamo`	12/05/2025 8:01 PM UTC
739b483a29a94c7730b168cdc50d48b875a03f394040ff9c25c288afcb7145fb	RUN	`ARCH_ALT=x86_64 ENABLE_KVBM=true PYTHON_VERSION=3.12 DYNAMO_COMMIT_SHA=41a72ab36698ce3eba0fba9af1dfad124d9e71ea chmod 755 /opt/dynamo/.launch_screen && echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc`	12/05/2025 8:01 PM UTC
929ba528267327e65c1b6897c90daf5dccebc9107ebecf6891e59ff8ba569e0b	USER	`root`	12/05/2025 8:01 PM UTC
b4e82120f3e1515f7c6436d3c78a1b44f1307ca340ea8f0f4cb53ee5f8d9d49a	RUN	`ARCH_ALT=x86_64 ENABLE_KVBM=true PYTHON_VERSION=3.12 DYNAMO_COMMIT_SHA=41a72ab36698ce3eba0fba9af1dfad124d9e71ea sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen`	12/05/2025 8:01 PM UTC
c93329406e886b9ea0774db609ffde71a828c29bf9551b0a235a2d68c811c449	COPY	`ATTRIBUTION* LICENSE /workspace/`	12/05/2025 8:01 PM UTC
d08975e74c320be5641901cf7453df447de21cf3a5da1488ac584a0cd71ba94c	COPY	`recipes/ /workspace/recipes/`	12/05/2025 8:01 PM UTC
b195eae10076dbdbd7ae529337ee5c08872723fce5ccc2118ea4bcc0c91781a1	COPY	`components/ /workspace/components/`	12/05/2025 8:01 PM UTC
9738c6b76e783f454189be41982730c1a21107b70f1f5015a10a8a1a49e91e2a	COPY	`deploy /workspace/deploy`	12/05/2025 8:01 PM UTC