ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
62a15e9e792177f657a3c2234a4933e3323984b1e3da8d726dbb27c20e989a7bCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
03/03/2026 11:53 AM UTC
1f01c83af5130211b7d09e5bd2dafb3837e7ec3d81186291b85d35674dadf530ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
03/03/2026 11:53 AM UTC
4912bb182a132e2b8ca0bd1693df3ed244aca9ee56ad9f0a14088e60eb8f869fENV
DYNAMO_COMMIT_SHA=ebcbd617aa4dea3bf608a8f0d25d98f013549085
03/03/2026 11:53 AM UTC
8727a2140bea478e00d83487fc24b83e0676fe24a0743bcac6a307bdf58ad3d8ARG
DYNAMO_COMMIT_SHA=ebcbd617aa4dea3bf608a8f0d25d98f013549085
03/03/2026 11:53 AM UTC
4ae7a94f33e97aa97cb5765125983602bdcb733f9ac61066d1ae4940f0a41f4dUSER
dynamo
03/03/2026 11:53 AM UTC
13b8a8340bc5452c00bdbc3fa294fc283841827e2a3e07030c9ef9b28946ae24RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE= /bin/bash -l -o pipefail -c chmod g+w ${VIRTUAL_ENV} /workspace /workspace/* /opt/dynamo /opt/dynamo/* &&
  chown dynamo:0 ${VIRTUAL_ENV} /workspace /opt/dynamo/ &&
  chmod 755 /opt/dynamo/.launch_screen &&
  echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
03/03/2026 11:53 AM UTC
edd1fc39e0b081ea21682d5be352e5e501c383d6d4ebf3e86f3925a0138b87b0USER
root
03/03/2026 11:53 AM UTC
3ef4643e9513a8f795ea1ece632e9ab9ae66d512b96aece641c60b35b4794e06RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 ENABLE_KVBM=true ENABLE_GPU_MEMORY_SERVICE= /bin/bash -l -o pipefail -c sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
03/03/2026 11:53 AM UTC
8d9d7540ca785229abc6e45318c84ecc8d9ce5590d1ed2605b1137958d110258COPY
--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
03/03/2026 11:53 AM UTC
41288185aad74304da6ca5323d1b72c36ad1a7f48510060bac5164d7eea99170COPY
--chown=dynamo:0 --chmod=775 components/ /workspace/components/
03/03/2026 11:53 AM UTC
...