ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
5f4292488fcb5593c86962cd14a7e4318ff8922f4a628ad31c401979d91790a2CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
07/16/2025 9:26 PM UTC
039c4de47cea39c7eadb54443b1ca48b7476008c18234b489e19b55c4d8020a7ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
07/16/2025 9:26 PM UTC
496c689e052f0eed0757ff1086d7c4f934a550ab7fb209210f20c2e87b23556eRUN
ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.5 TORCHVISION_VER=0.22.0a0 SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.4.2 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.3 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc0 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc
07/16/2025 9:26 PM UTC
38ff77719649ceac1dd5307f29b6ffd309f4694ecb28391ea7894ba5df349b8bCOPY
ATTRIBUTION* LICENSE /workspace/
07/16/2025 9:26 PM UTC
768c071936eabdfb69364274677938379a39f6051c4c537e043777144d63efe9RUN
ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.5 TORCHVISION_VER=0.22.0a0 SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.4.2 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.3 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc0 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple uv pip install /workspace/benchmarks
07/16/2025 9:26 PM UTC
db85a3e3bad0f7e6268445dfa41aed76a3f4da81c8a2155f471d19c7fadeea0eCOPY
examples /workspace/examples
07/16/2025 9:26 PM UTC
53a2d687c3a67d6305cb08b973a883eff4e0163fedd139ac2cbfdfbf84d8eff3COPY
benchmarks /workspace/benchmarks
07/16/2025 9:26 PM UTC
d0be41af5d23478654c3293d6e7f5f75f70b5768b0d11d4ce407a7886a987cabCOPY
tests /workspace/tests
07/16/2025 9:26 PM UTC
9290b9b5c2a15f812d2458056fb4c1e1b37292d5414690718a15b204a9c5d756RUN
ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.5 TORCHVISION_VER=0.22.0a0 SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.4.2 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.3 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc0 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple echo 'source /usr/local/bin/set_trtllm_env.sh' >> /root/.bashrc
07/16/2025 9:26 PM UTC
170fa8bf4ee90199c325c5a2053cdb749a13455263ea0ef1b509498e8525ec60COPY
/usr/local/bin/set_trtllm_env.sh /usr/local/bin/set_trtllm_env.sh
07/16/2025 9:26 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.