ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
—
07/16/2025 9:26 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
07/16/2025 9:26 PM UTC
sha256:5866168c5dd3e0bc46f079df747b0a13f9c0368ad61a462c0fdefc457c07f39bRUN
ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.5 TORCHVISION_VER=0.22.0a0 SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.4.2 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.3 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc0 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc
07/16/2025 9:26 PM UTC
sha256:d3def1bab4ecc596b05bb9b8234347fa751c5c6bcd3e779df995ecad9e5c00fdCOPY
ATTRIBUTION* LICENSE /workspace/
07/16/2025 9:26 PM UTC
sha256:f9a559fe42595729f43c32baddbcaa952e269fcb77c1564e97511cfbdf31f4f6RUN
ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.5 TORCHVISION_VER=0.22.0a0 SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.4.2 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.3 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc0 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple uv pip install /workspace/benchmarks
07/16/2025 9:26 PM UTC
sha256:18a3547389b042040a23cbc5b1aea3a78ad965c8db9aedf472b1430ddaa454edCOPY
examples /workspace/examples
07/16/2025 9:26 PM UTC
sha256:40ba214779375c1e5f0ca1ef4cd27daee5e63be04f0f30b5deb03adf2172a6ffCOPY
benchmarks /workspace/benchmarks
07/16/2025 9:26 PM UTC
sha256:38de6dc0e65a1096c15d564f10a05101b4e78e1f9b46b11ed7e1a6a75f6953adCOPY
tests /workspace/tests
07/16/2025 9:26 PM UTC
sha256:8212336acec6f760c9f4884e60180917dea99afbdf43be3ca063ae74d07c7f65RUN
ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.5 TORCHVISION_VER=0.22.0a0 SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.4.2 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.3 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc0 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple echo 'source /usr/local/bin/set_trtllm_env.sh' >> /root/.bashrc
07/16/2025 9:26 PM UTC
sha256:e9aece1760a01f6be2fd03e20471991de1dacee6f8b54e56da26158e51defcc9COPY
/usr/local/bin/set_trtllm_env.sh /usr/local/bin/set_trtllm_env.sh
07/16/2025 9:26 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.