Dynamo Tensorrt-LLM Runtime

NVIDIA

Container

NVIDIA

Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

Layer	Label		Created
6b42bac301588d72f8bf825fc70b814d08b853a48353e95ba53e93d76975f5d6	CONFIG	`WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp`	06/05/2026 4:00 AM UTC
3b5fc477094329c99ba0570d9e8ccc56e4029ce2dfe6e00e928e212d193e96d8	ENTRYPOINT	`—`	06/05/2026 4:00 AM UTC
151712964f9610d5f6efd2b83a272d450609026ef5a5a3e3d5e0a911c4db31d8	USER	`dynamo`	06/05/2026 4:00 AM UTC
172824b21188010e37b6edeca6b54691c25b810c79796e1a9a4e8dd3a949586c	ENV	`DYNAMO_COMMIT_SHA=154e76c85233c027565ed3aca220669be1577b6f`	06/05/2026 4:00 AM UTC
0a45c44dd93bb313a824e2e2983e970e291b6e156c745c49c91b06516371b71b	ARG	`DYNAMO_COMMIT_SHA=154e76c85233c027565ed3aca220669be1577b6f`	06/05/2026 4:00 AM UTC
bea511c666de44455228ee8fcbe1040227ce02059e39a981fdb0dbf8940a3e9a	WORKDIR	`/workspace`	06/05/2026 4:00 AM UTC
65781afde780bf7c17607f46527eb442b368e36dc3eb4f076dd446bd784fac93	ENV	DYNAMO_HOME=/workspace HOME=/home/dynamo VIRTUAL_ENV=/opt/dynamo/venv PATH=/opt/dynamo/venv/bin:/usr/local/bin/etcd:/usr/local/lib/python3.12/dist-packages/torch_tensorrt/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin:/opt/tensorrt/bin LD_PRELOAD=/opt/dynamo/libstdc++.so.6:/usr/local/lib/python3.12/dist-packages/tensorrt_llm/libs/nixl/libnixl.so NIXL_PLUGIN_DIR=/usr/local/lib/python3.12/dist-packages/tensorrt_llm/libs/nixl/plugins	06/05/2026 4:00 AM UTC
5f2cfd82d0bcb240397dcf2caf3733ad72f4ec7e1d174d369fd3fb552dd6cc8d	COPY	`/ /`	06/05/2026 4:00 AM UTC
8444ef7cf0850a969d6f67111007f29f0cbfddd27369a384b8faf96399419563	RUN	`/bin/bash -c rm -rf /workspace /home/ubuntu /usr/local/bin/etcd`	06/05/2026 3:41 AM UTC
54f0b2e8b51183c17b2f72dbfb9025d074cebef6c4dcecdc2d1234fbe47f569e	RUN	`SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build GIT_COMMIT=34a563ac6d8cc0ca7068c7f619e869fb8a625333 TRT_LLM_VER=1.3.0rc15.post1 TARGETARCH=amd64 /bin/bash -c bash /tmp/generate_container_oss_attribution.sh "release" "${TRT_LLM_VER}" "${TARGETARCH}" && rm /tmp/generate_container_oss_attribution.sh`	05/31/2026 5:39 PM UTC