ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    NVIDIA
    Dynamo Tensorrt-LLM Runtime
    Container
    NVIDIA
    NVIDIA
    Dynamo Tensorrt-LLM Runtime

    The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    —
    		07/16/2025 9:26 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    		07/16/2025 9:26 PM UTC
    sha256:5866168c5dd3e0bc46f079df747b0a13f9c0368ad61a462c0fdefc457c07f39bRUN
    ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.5 TORCHVISION_VER=0.22.0a0 SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.4.2 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.3 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc0 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc
    		07/16/2025 9:26 PM UTC
    sha256:d3def1bab4ecc596b05bb9b8234347fa751c5c6bcd3e779df995ecad9e5c00fdCOPY
    ATTRIBUTION* LICENSE /workspace/
    		07/16/2025 9:26 PM UTC
    sha256:f9a559fe42595729f43c32baddbcaa952e269fcb77c1564e97511cfbdf31f4f6RUN
    ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.5 TORCHVISION_VER=0.22.0a0 SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.4.2 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.3 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc0 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple uv pip install /workspace/benchmarks
    		07/16/2025 9:26 PM UTC
    sha256:18a3547389b042040a23cbc5b1aea3a78ad965c8db9aedf472b1430ddaa454edCOPY
    examples /workspace/examples
    		07/16/2025 9:26 PM UTC
    sha256:40ba214779375c1e5f0ca1ef4cd27daee5e63be04f0f30b5deb03adf2172a6ffCOPY
    benchmarks /workspace/benchmarks
    		07/16/2025 9:26 PM UTC
    sha256:38de6dc0e65a1096c15d564f10a05101b4e78e1f9b46b11ed7e1a6a75f6953adCOPY
    tests /workspace/tests
    		07/16/2025 9:26 PM UTC
    sha256:8212336acec6f760c9f4884e60180917dea99afbdf43be3ca063ae74d07c7f65RUN
    ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.5 TORCHVISION_VER=0.22.0a0 SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.4.2 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.3 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc0 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple echo 'source /usr/local/bin/set_trtllm_env.sh' >> /root/.bashrc
    		07/16/2025 9:26 PM UTC
    sha256:e9aece1760a01f6be2fd03e20471991de1dacee6f8b54e56da26158e51defcc9COPY
    /usr/local/bin/set_trtllm_env.sh /usr/local/bin/set_trtllm_env.sh
    		07/16/2025 9:26 PM UTC
    ...