ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
—
11/07/2025 1:22 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
11/07/2025 1:22 AM UTC
sha256:b4fcaed0c62464e87ce58869721f7c85dce58b4d45bd316c6cadec468792af45RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt-llm==1.1.0rc5 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
11/07/2025 1:22 AM UTC
sha256:de2a58df04080417d70238d6ea37486095e111d0fc28c777ebcdbe6d64a903b0COPY
ATTRIBUTION* LICENSE /workspace/
11/07/2025 1:22 AM UTC
sha256:f3a6c684f4ac3b7fab78f7a433fdecdcd25d10b3dac4efa4837ad9dac57bccc1COPY
recipes/ /workspace/recipes/
11/07/2025 1:22 AM UTC
sha256:34109b7812d8662d7b3397d8a4183356ab3b791cb4e69773e22b03385a71fe05COPY
components/ /workspace/components/
11/07/2025 1:22 AM UTC
sha256:a3b812ec7c94e42efedac0b56c5d79d171e3c98d27b9e54c6f761d6fd86b1805COPY
deploy /workspace/deploy
11/07/2025 1:22 AM UTC
sha256:175b7567fed7c154951f5fed726c15ba3aeae81278bcdb9b1efc6b47e6aece4eCOPY
benchmarks /workspace/benchmarks
11/07/2025 1:22 AM UTC
sha256:c0bd15d4f3609165e640fa6921c40063f9bad60a454369034141497a5ef0172cCOPY
examples /workspace/examples
11/07/2025 1:22 AM UTC
sha256:cefff85e32e9fa93e6cf2d2edb17db47127ad2d6780f649ac014890fb0c87199COPY
tests /workspace/tests
11/07/2025 1:22 AM UTC
...