ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
5066099ff68684d0cef5b7024d2d964df4ee4118fd44dc9156c5f49e5c4e90efCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
11/06/2025 6:26 PM UTC
e077910938cd079acf6d973822ccb23bd9cfe3bd5bbdabbdf660f1b0696f6b49ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
11/06/2025 6:26 PM UTC
dcd3424638db11d5580187e1d38cf4cf0d7771204538bd72ae7cfbdc17c29e40RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt-llm==1.1.0rc5 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
11/06/2025 6:26 PM UTC
775e55da000dd803e69f9d5d5adf0b98cfddad31f76ab6b29cc3b46f94f1377dCOPY
ATTRIBUTION* LICENSE /workspace/
11/06/2025 6:26 PM UTC
721d11aa93887aff1aee8db61a4ac327f9b1f243c3a080d232c2edd8e430af88COPY
recipes/ /workspace/recipes/
11/06/2025 6:26 PM UTC
b4148653700b96bc0aeb280d174b1530f8faa4e9cab3d04c16e70955c00a9fbdCOPY
components/ /workspace/components/
11/06/2025 6:26 PM UTC
4eb2606ff1f6596b31f86430c3a828561cd4d77e09267788322869bde1f9f713COPY
deploy /workspace/deploy
11/06/2025 6:26 PM UTC
b18b5d16a3eadca3c0b852c7f48ad307951711a1ac78d83af699248f8bb17d77COPY
benchmarks /workspace/benchmarks
11/06/2025 6:26 PM UTC
e29198e7adefab35f12325a8436ae42514bf4746519f2e3e7280b3c429912890COPY
examples /workspace/examples
11/06/2025 6:26 PM UTC
e1c4dcd8248499b9f9759e69042e77a86aa57942c40c1f63d595076eb5163c68COPY
tests /workspace/tests
11/06/2025 6:26 PM UTC
...