ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
0a3da3d76ea072fb1c61b61d7d64149f90a145ecb49c0e3cf5c21a849bfef5d9CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
02/11/2026 6:33 PM UTC
9fa922364d5466acc98379367225af1bcd6b2288a0a160aa876f90bfdcc3d009ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
02/11/2026 6:33 PM UTC
832db37887ea685108caad09cd56f11329ef36b57ae9d4f689d747d74655a8ceENV
DYNAMO_COMMIT_SHA=6759dc89c24615b020155a5219ad886f226a12d9
02/11/2026 6:33 PM UTC
661234be7b030a9ea8d2c68b51a88afdd3dd5545fe87254eebf902c806eb2413ARG
DYNAMO_COMMIT_SHA=6759dc89c24615b020155a5219ad886f226a12d9
02/11/2026 6:33 PM UTC
f0a7905c0e9e2939f6b86b4d8c1ebd387dac96240de596fd66393cfca4f1515dUSER
dynamo
02/11/2026 6:33 PM UTC
8bdaacff0b5246fb3469c494bbded367925ee03457213f1d818d2e06d8c08ea8RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE= /bin/bash -l -o pipefail -c chmod g+w ${VIRTUAL_ENV} /workspace /workspace/* /opt/dynamo /opt/dynamo/* &&
  chown dynamo:0 ${VIRTUAL_ENV} /workspace /opt/dynamo/ &&
  chmod 755 /opt/dynamo/.launch_screen &&
  echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
02/11/2026 6:33 PM UTC
e1f8f3bf409084dcbf419c6654d753b69cf54921ea9f3765c3090557b1ea9e45USER
root
02/11/2026 6:33 PM UTC
ad052130d7e7c23f5890d9b59a9a9e662e0520c7ce1f2d67b8e798b6ab9d2170RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE= /bin/bash -l -o pipefail -c sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
02/11/2026 6:33 PM UTC
b6d786607c51dd04d7c03f8e4a4d5bc6c56df81fff44a3e6ab367867a206acb7COPY
--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
02/11/2026 6:33 PM UTC
c6d654623344345c634d120815974b066670c533d9d7cb6e040301bc4bc026ffCOPY
--chown=dynamo:0 --chmod=775 components/ /workspace/components/
02/11/2026 6:33 PM UTC
...