ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
3b2f67962c005f926be707b269c05c01154a9815b9525146fdd59bb1aacd57abCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
09/17/2025 8:58 PM UTC
dfe9bfe515293a32aeb4da06fab0c0a9e59cf1f4be255e71a712cba639beae2cENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
09/17/2025 8:58 PM UTC
d1f7dcd080fb585be44a432350f7acbd338421ecc48371db984a719f0b9dd4a9RUN
ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc6 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc
09/17/2025 8:58 PM UTC
1b823429dbdbcf1bcccac8c315499a520ba56f42469048a87b5f65fd6d809c91COPY
ATTRIBUTION* LICENSE /workspace/
09/17/2025 8:58 PM UTC
d831bde6aae59c29d9606feec4ae8557aa0ddde1c06c04ce8452b3dbd3a3137dRUN
ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc6 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple python3 -m pip install --no-cache-dir --break-system-packages /workspace/benchmarks
09/17/2025 8:58 PM UTC
42ea22adac115fa832f94dc86f408fc2a78990a69b0487e7118bc3a987c075aeCOPY
components/backends/trtllm /workspace/components/backends/trtllm
09/17/2025 8:58 PM UTC
5d67ece3d1c4cc9a3746e945cb321df7d978f0852c175b970d98acba21bc2745COPY
deploy /workspace/deploy
09/17/2025 8:58 PM UTC
920361f0c5d5df9478949ad0e0522699b62a28f3c416a2539e5440e5c87a03f4COPY
benchmarks /workspace/benchmarks
09/17/2025 8:58 PM UTC
9abdd23fc94223b05a6345449b8fd3edf82f697e2818170aeea6d08546c3852fCOPY
tests /workspace/tests
09/17/2025 8:58 PM UTC
0b460ef94e1e38b50c27591ff5b1f376e05a4b84f5e7fd40a58a865877721f2eCOPY
/usr/local/lib/python3.12/dist-packages/pytorch_triton-3.3.0+git96316ce52.nvinternal.dist-info /usr/local/lib/python3.12/dist-packages/pytorch_triton-3.3.0+git96316ce52.nvinternal.dist-info
09/17/2025 8:58 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.