Dynamo Tensorrt-LLM Runtime

NVIDIA

Container

NVIDIA

Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`—`	11/10/2025 9:06 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	11/10/2025 9:06 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`TRTLLM_USE_UCX_KVCACHE=1`	11/10/2025 9:06 PM UTC
sha256:66cf5057fbce38dc0123db2e7c4da171a7e66143c7c4027a2071b5dfbd51b7b4	COPY	`tests /workspace/tests`	11/10/2025 9:06 PM UTC
sha256:9976e6e659953c3370abca0ba64cd66846af3e5de8afcd3d44072fe557a084ee	COPY	`recipes /workspace/recipes`	11/10/2025 9:06 PM UTC
sha256:26d2e99bc5b874b1bfd4f5211fe7e50a219f0550e17d566a2bf70b60be9bd880	COPY	`examples /workspace/examples`	11/10/2025 9:06 PM UTC
sha256:70738caafcab69575937fb14345731377b0b2dbd3ae8b2d21046acf1ac3981c4	COPY	`deploy /workspace/deploy`	11/10/2025 9:06 PM UTC
sha256:a0bceedbf22ef90cd92035a1af93a5ec46ac664decd3bc6bd779eb109d0037cb	COPY	`components /workspace/components`	11/10/2025 9:06 PM UTC
sha256:929977c3f1ef5d689abc7b7ba735b4028df90d56cf202c804a701d483a915aae	COPY	`benchmarks /workspace/benchmarks`	11/10/2025 9:06 PM UTC
sha256:b09e0b8bf9d18b941db05edc7d72e308c6df0d7d922b4fcf3d5dc251b01f4ba2	COPY	`ATTRIBUTION* LICENSE /workspace/`	11/10/2025 9:06 PM UTC