Dynamo Tensorrt-LLM Runtime

NVIDIA

Container

NVIDIA

Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

Layer	Label		Created
cbf1699fb8038fd281a400ecbf3f12b97625bb36cfd02359acc334206ee9c892	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	12/13/2025 12:08 AM UTC
70b67cccf90939771bee6a913806df85f5d1a90fb3437d43d4013cc3e153afc4	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	12/13/2025 12:08 AM UTC
cb2ee3d8138a87aeabf5953d35cb7c08747b4dd3811c86b8625ff511870fb436	USER	`dynamo`	12/13/2025 12:08 AM UTC
a231862e3c0896565e109f03f39696e77d277d96e1386aade99f676c0fe63d09	RUN	`ARCH_ALT=x86_64 ENABLE_KVBM=true PYTHON_VERSION=3.12 DYNAMO_COMMIT_SHA=4e4b487ba2baa3f8887dfa49cf6cb35c7bb62022 chmod 755 /opt/dynamo/.launch_screen && echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc`	12/13/2025 12:08 AM UTC
65ec4022d1e07370c9ee62cb49ca5928215f8582ecb7699e2a24e6d657e89695	USER	`root`	12/13/2025 12:08 AM UTC
4080d0aa5903a2d8e9d3f62a794280826b03b01dbc696955f0de5192f5cb7275	RUN	`ARCH_ALT=x86_64 ENABLE_KVBM=true PYTHON_VERSION=3.12 DYNAMO_COMMIT_SHA=4e4b487ba2baa3f8887dfa49cf6cb35c7bb62022 sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen`	12/13/2025 12:08 AM UTC
de82ad456da82cfc364c40031a60642893d0412b77746a40aef74d00a8b6908d	COPY	`ATTRIBUTION* LICENSE /workspace/`	12/13/2025 12:08 AM UTC
f6821c76ec8eed93210f2cb307b7b4757d42c4fe2a5241613bf71a64c24af23d	COPY	`recipes/ /workspace/recipes/`	12/13/2025 12:08 AM UTC
fdab9c3450891c9761ed0a1fcfea98c7dac51f03f66a85be84d07f7e1be2f67d	COPY	`components/ /workspace/components/`	12/13/2025 12:08 AM UTC
b36f83060ffe316865307344981d00b1fdd306a3b0768692475409f833cdaab9	COPY	`deploy /workspace/deploy`	12/13/2025 12:08 AM UTC