ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
795e4274fa7ea6a0077196aeb43699b0e99a0d6fbe092a0e766a1ababc32c6bbCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
11/07/2025 1:22 AM UTC
6b04fa924235b7e8ef5833abeac6805d972e34ee45e4bc5ac973738816f87d5aENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
11/07/2025 1:22 AM UTC
777c671cdd4b8752adb150eae46a27a938d13c34075be86fcd895472f4aca42bRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt-llm==1.1.0rc5 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
11/07/2025 1:22 AM UTC
21c391ee799e18010ca1a2e2032ef951e0f3c019834e8d004c5af76eedf8815cCOPY
ATTRIBUTION* LICENSE /workspace/
11/07/2025 1:22 AM UTC
acc6dedf8eae75957d4e02a7c26087a05ca3a55f198ff6e8ab4e18fa55a712a4COPY
recipes/ /workspace/recipes/
11/07/2025 1:22 AM UTC
3c868b7a37882dbc3d0d6105e606f6f5d1c462f3be575fd41b527907067ef89cCOPY
components/ /workspace/components/
11/07/2025 1:22 AM UTC
3b5e8d0fa1697c81dd3b0c557e9e2eb65cf97238252362df119e1955c149e787COPY
deploy /workspace/deploy
11/07/2025 1:22 AM UTC
fef8ae715fce7f4281a2e1de2a0ea2951f777ec2eb45073e774598a2b3556e38COPY
benchmarks /workspace/benchmarks
11/07/2025 1:22 AM UTC
238bd3b531c2afc64aea3fa2189aaeb13548e4f45a88026f25f4cbb223981e9dCOPY
examples /workspace/examples
11/07/2025 1:22 AM UTC
8c98b6d2c3211b0bfd5932c172ba72e25072cd288552a1327e40eb8b8223c72aCOPY
tests /workspace/tests
11/07/2025 1:22 AM UTC
...