ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    Dynamo Tensorrt-LLM Runtime
    Container
    NVIDIA
    Dynamo Tensorrt-LLM Runtime

    The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    —
    		09/17/2025 8:58 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    		09/17/2025 8:58 PM UTC
    sha256:5dc91f82d726d8f0d54f5e8b291b60c1477d1830f9b83197bb3c83f933d5fbd4RUN
    ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc6 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc
    		09/17/2025 8:58 PM UTC
    sha256:03477b23d7183f8248ad18d71b4727b7fea9e19ee368e6c5edbc437e3b70a449COPY
    ATTRIBUTION* LICENSE /workspace/
    		09/17/2025 8:58 PM UTC
    sha256:4454adfb57413b5da210b1048dbb8328f31d75a41f28731be1a95c0e59f8abf6RUN
    ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc6 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple python3 -m pip install --no-cache-dir --break-system-packages /workspace/benchmarks
    		09/17/2025 8:58 PM UTC
    sha256:85762c96f31f78fbb7ee2fd208eee9e4a5345db80a221da925e64da40b5506f5COPY
    components/backends/trtllm /workspace/components/backends/trtllm
    		09/17/2025 8:58 PM UTC
    sha256:565b5334bb55a6aeb92c7996e48dcbafa5464a702b5dfebd68245027181049a4COPY
    deploy /workspace/deploy
    		09/17/2025 8:58 PM UTC
    sha256:b41e43e5be47cfcf7a6809724f2a4db05ce7992ca783dd1893f46e2c2f618d8aCOPY
    benchmarks /workspace/benchmarks
    		09/17/2025 8:58 PM UTC
    sha256:24c718927c00edc03cd232f76d8f61dce9de7ef5067b1543633b9437a7e05b4eCOPY
    tests /workspace/tests
    		09/17/2025 8:58 PM UTC
    sha256:00d54a24ab8e6171f88634a8feee2f1a97cc43401d6be63b1e15bbb5ffdb6b4dCOPY
    /usr/local/lib/python3.12/dist-packages/pytorch_triton-3.3.0+git96316ce52.nvinternal.dist-info /usr/local/lib/python3.12/dist-packages/pytorch_triton-3.3.0+git96316ce52.nvinternal.dist-info
    		09/17/2025 8:58 PM UTC
    ...

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.