ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
20a7e857a204a7ba690f3f957c11e77acdce521f0dc425413420070ed458e787CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
10/27/2025 6:23 PM UTC
9ff66a2a4c50c49c3c84526d6ff9280cc0e0812e3215065cf25d0ff8aa010a91ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
10/27/2025 6:23 PM UTC
0621fc0cd8bec2815900ec8784cbd111c5e006b0d67be2deab0e909960a6737fRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt-llm==1.1.0rc5 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
10/27/2025 6:23 PM UTC
19947432bffb2c1e893d190cafd1663a93c36254b6ea1229d9ff3d6d35a48932COPY
ATTRIBUTION* LICENSE /workspace/
10/27/2025 6:23 PM UTC
41f2ad4fdb35a47ade7c2ce2b237afd6136ed90ea9586d4eebd2b830a1f131e2COPY
components/ /workspace/components/
10/27/2025 6:23 PM UTC
ecc6e160bca0ae33ac95fb7122c670421403cb73826756065a022fc26a8a9ca3COPY
deploy /workspace/deploy
10/27/2025 6:23 PM UTC
10ffb02cfc59f3abf8ff6245b16f389a12fe2923bef5c640f83f361c5c975defCOPY
benchmarks /workspace/benchmarks
10/27/2025 6:23 PM UTC
5205d60f66e5cc7a2aadbc0930671543e15527641af6e0b3e03af351c895e9bdCOPY
examples /workspace/examples
10/27/2025 6:23 PM UTC
23cc7e1d15c693a925f84737165cac803f62123cff65959e7954843df3075fe2COPY
tests /workspace/tests
10/27/2025 6:23 PM UTC
adc7525fcbc5ecc783382947e8d1abe0ab25cb330b7aede155d7b1caa5bd1cf8COPY
/usr/local/cuda/lib64/libcusparseLt* /usr/local/cuda/lib64/
10/27/2025 6:23 PM UTC
...