NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
6b7a0bdc7f4a1433667f630d80bcdbb0a60c56faa370fb0ba4358484c4ff7a81CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
12/11/2025 10:32 PM UTC
94929420fedfd1b8750b61decd67cbe381e4661200c7ed69f5666ba875ad98a9ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
12/11/2025 10:32 PM UTC
e4db93de7b0acf795c57c9285a42dcaab30582934241baf09d8077dc261e0a95USER
dynamo
12/11/2025 10:32 PM UTC
fa432993fc27e99c5603a43a6b3cfcbfb38e5fa0e790c298b3a9eefc886ece28RUN
ARCH_ALT=x86_64 ENABLE_KVBM=true PYTHON_VERSION=3.12 DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac chmod 755 /opt/dynamo/.launch_screen &&
  echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
12/11/2025 10:32 PM UTC
282cc6b71df9e1b5b0941ba4c1d12c5839328ad4feae3e710fdd1f1d9175ceb5USER
root
12/11/2025 10:32 PM UTC
e12516fea26699999585493a18c75e512835b4f209483f38cf044decda48d5e4RUN
ARCH_ALT=x86_64 ENABLE_KVBM=true PYTHON_VERSION=3.12 DYNAMO_COMMIT_SHA=15f1a73b375eb318ff4db7ddc89fd3d1faef0fac sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
12/11/2025 10:32 PM UTC
9b31bd1ad8907fc28cadff9c693dd491eaf0f5d7e1cf925e0d61caf3d43e8002COPY
ATTRIBUTION* LICENSE /workspace/
12/11/2025 10:32 PM UTC
1d38490941c38fa4900397e71b9f457c892344f6bd8f6443dbf78eb3915a77cbCOPY
recipes/ /workspace/recipes/
12/11/2025 10:32 PM UTC
c0071493ee16a5089e74631a1c801400f898f9cead6e8985ae1b1d7d833dac14COPY
components/ /workspace/components/
12/11/2025 10:32 PM UTC
16d77b6e6c01699029d6b560d991d449238464cc6406896095b5b30d8ca28dedCOPY
deploy /workspace/deploy
12/11/2025 10:32 PM UTC
...