NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
cbf1699fb8038fd281a400ecbf3f12b97625bb36cfd02359acc334206ee9c892CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
12/13/2025 12:08 AM UTC
70b67cccf90939771bee6a913806df85f5d1a90fb3437d43d4013cc3e153afc4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
12/13/2025 12:08 AM UTC
cb2ee3d8138a87aeabf5953d35cb7c08747b4dd3811c86b8625ff511870fb436USER
dynamo
12/13/2025 12:08 AM UTC
a231862e3c0896565e109f03f39696e77d277d96e1386aade99f676c0fe63d09RUN
ARCH_ALT=x86_64 ENABLE_KVBM=true PYTHON_VERSION=3.12 DYNAMO_COMMIT_SHA=4e4b487ba2baa3f8887dfa49cf6cb35c7bb62022 chmod 755 /opt/dynamo/.launch_screen &&
  echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
12/13/2025 12:08 AM UTC
65ec4022d1e07370c9ee62cb49ca5928215f8582ecb7699e2a24e6d657e89695USER
root
12/13/2025 12:08 AM UTC
4080d0aa5903a2d8e9d3f62a794280826b03b01dbc696955f0de5192f5cb7275RUN
ARCH_ALT=x86_64 ENABLE_KVBM=true PYTHON_VERSION=3.12 DYNAMO_COMMIT_SHA=4e4b487ba2baa3f8887dfa49cf6cb35c7bb62022 sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
12/13/2025 12:08 AM UTC
de82ad456da82cfc364c40031a60642893d0412b77746a40aef74d00a8b6908dCOPY
ATTRIBUTION* LICENSE /workspace/
12/13/2025 12:08 AM UTC
f6821c76ec8eed93210f2cb307b7b4757d42c4fe2a5241613bf71a64c24af23dCOPY
recipes/ /workspace/recipes/
12/13/2025 12:08 AM UTC
fdab9c3450891c9761ed0a1fcfea98c7dac51f03f66a85be84d07f7e1be2f67dCOPY
components/ /workspace/components/
12/13/2025 12:08 AM UTC
b36f83060ffe316865307344981d00b1fdd306a3b0768692475409f833cdaab9COPY
deploy /workspace/deploy
12/13/2025 12:08 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.