ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    NVIDIA
    Dynamo Tensorrt-LLM Runtime
    Container
    NVIDIA
    NVIDIA
    Dynamo Tensorrt-LLM Runtime

    The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    —
    		09/17/2025 8:58 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    		09/17/2025 8:58 PM UTC
    sha256:5dc91f82d726d8f0d54f5e8b291b60c1477d1830f9b83197bb3c83f933d5fbd4RUN
    ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc6 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc
    		09/17/2025 8:58 PM UTC
    sha256:03477b23d7183f8248ad18d71b4727b7fea9e19ee368e6c5edbc437e3b70a449COPY
    ATTRIBUTION* LICENSE /workspace/
    		09/17/2025 8:58 PM UTC
    sha256:4454adfb57413b5da210b1048dbb8328f31d75a41f28731be1a95c0e59f8abf6RUN
    ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc6 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple python3 -m pip install --no-cache-dir --break-system-packages /workspace/benchmarks
    		09/17/2025 8:58 PM UTC
    sha256:85762c96f31f78fbb7ee2fd208eee9e4a5345db80a221da925e64da40b5506f5COPY
    components/backends/trtllm /workspace/components/backends/trtllm
    		09/17/2025 8:58 PM UTC
    sha256:565b5334bb55a6aeb92c7996e48dcbafa5464a702b5dfebd68245027181049a4COPY
    deploy /workspace/deploy
    		09/17/2025 8:58 PM UTC
    sha256:b41e43e5be47cfcf7a6809724f2a4db05ce7992ca783dd1893f46e2c2f618d8aCOPY
    benchmarks /workspace/benchmarks
    		09/17/2025 8:58 PM UTC
    sha256:24c718927c00edc03cd232f76d8f61dce9de7ef5067b1543633b9437a7e05b4eCOPY
    tests /workspace/tests
    		09/17/2025 8:58 PM UTC
    sha256:00d54a24ab8e6171f88634a8feee2f1a97cc43401d6be63b1e15bbb5ffdb6b4dCOPY
    /usr/local/lib/python3.12/dist-packages/pytorch_triton-3.3.0+git96316ce52.nvinternal.dist-info /usr/local/lib/python3.12/dist-packages/pytorch_triton-3.3.0+git96316ce52.nvinternal.dist-info
    		09/17/2025 8:58 PM UTC
    ...