ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
2760d3aed342ef44665002bc8399d1ce2d509aecec22c6ec80d015e26743771eCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
02/05/2026 6:27 PM UTC
41f88b00f1de68116f4e0795c700eaba138d93a70137883c5a5569739bb21581ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
02/05/2026 6:27 PM UTC
f0a81faddb34b86ba6a66551e246218232239d2e2e32d4e5f3a50ed36b4b7c4aENV
DYNAMO_COMMIT_SHA=783dbda11051be4e34130686de27de72ed2ea099
02/05/2026 6:27 PM UTC
94a8422d85678a030e03a9b5776bcb5b427105a8c4c5a8f86f458d1afdc5bf37ARG
DYNAMO_COMMIT_SHA=783dbda11051be4e34130686de27de72ed2ea099
02/05/2026 6:27 PM UTC
8753b69b2c285e75754ca091034eb58ff07d6ab428cf620fb203f24da4d54436USER
dynamo
02/05/2026 6:27 PM UTC
32a4881ae2c5da1000b5570af5f72e4f68e4a087a258aac47b0f47ae61e93458RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c chmod g+w ${VIRTUAL_ENV} /workspace /workspace/* /opt/dynamo /opt/dynamo/* &&
  chown dynamo:0 ${VIRTUAL_ENV} /workspace /opt/dynamo/ &&
  chmod 755 /opt/dynamo/.launch_screen &&
  echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
02/05/2026 6:27 PM UTC
9e4dedc2adff191ed6fdd545639f6e42c97b37da10f81d6a2f799d94f67829dfUSER
root
02/05/2026 6:27 PM UTC
9782963d33019ef2c8117adc21915fa6b137a76a14497f0e1991b7401cdfe502RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true /bin/bash -l -o pipefail -c sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
02/05/2026 6:27 PM UTC
a4a39490ffee8fcc511ed0eb10f36de5e4e48fd9d06b1a51f247c85c378232b1COPY
--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
02/05/2026 6:27 PM UTC
fc416203c0c2f53e117cd6034e9eb286bc9284c2f9c6ba4df1babb1d1790d0e0COPY
--chown=dynamo:0 --chmod=775 components/ /workspace/components/
02/05/2026 6:27 PM UTC
...