Dynamo Tensorrt-LLM Runtime

NVIDIA

Container

NVIDIA

Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

Layer	Label		Created
6b7a0bdc7f4a1433667f630d80bcdbb0a60c56faa370fb0ba4358484c4ff7a81	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	12/11/2025 10:32 PM UTC
94929420fedfd1b8750b61decd67cbe381e4661200c7ed69f5666ba875ad98a9	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	12/11/2025 10:32 PM UTC
e4db93de7b0acf795c57c9285a42dcaab30582934241baf09d8077dc261e0a95	USER	`dynamo`	12/11/2025 10:32 PM UTC
fa432993fc27e99c5603a43a6b3cfcbfb38e5fa0e790c298b3a9eefc886ece28	RUN	`ARCH_ALT=x86_64 ENABLE_KVBM=true PYTHON_VERSION=3.12 DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac chmod 755 /opt/dynamo/.launch_screen && echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc`	12/11/2025 10:32 PM UTC
282cc6b71df9e1b5b0941ba4c1d12c5839328ad4feae3e710fdd1f1d9175ceb5	USER	`root`	12/11/2025 10:32 PM UTC
e12516fea26699999585493a18c75e512835b4f209483f38cf044decda48d5e4	RUN	`ARCH_ALT=x86_64 ENABLE_KVBM=true PYTHON_VERSION=3.12 DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen`	12/11/2025 10:32 PM UTC
9b31bd1ad8907fc28cadff9c693dd491eaf0f5d7e1cf925e0d61caf3d43e8002	COPY	`ATTRIBUTION* LICENSE /workspace/`	12/11/2025 10:32 PM UTC
1d38490941c38fa4900397e71b9f457c892344f6bd8f6443dbf78eb3915a77cb	COPY	`recipes/ /workspace/recipes/`	12/11/2025 10:32 PM UTC
c0071493ee16a5089e74631a1c801400f898f9cead6e8985ae1b1d7d833dac14	COPY	`components/ /workspace/components/`	12/11/2025 10:32 PM UTC
16d77b6e6c01699029d6b560d991d449238464cc6406896095b5b30d8ca28ded	COPY	`deploy /workspace/deploy`	12/11/2025 10:32 PM UTC