Skip to main content
ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    Dynamo Tensorrt-LLM Runtime
    Container
    NVIDIA
    Dynamo Tensorrt-LLM Runtime

    The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    —
    		11/07/2025 1:22 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    		11/07/2025 1:22 AM UTC
    sha256:b4fcaed0c62464e87ce58869721f7c85dce58b4d45bd316c6cadec468792af45RUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt-llm==1.1.0rc5 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
    		11/07/2025 1:22 AM UTC
    sha256:de2a58df04080417d70238d6ea37486095e111d0fc28c777ebcdbe6d64a903b0COPY
    ATTRIBUTION* LICENSE /workspace/
    		11/07/2025 1:22 AM UTC
    sha256:f3a6c684f4ac3b7fab78f7a433fdecdcd25d10b3dac4efa4837ad9dac57bccc1COPY
    recipes/ /workspace/recipes/
    		11/07/2025 1:22 AM UTC
    sha256:34109b7812d8662d7b3397d8a4183356ab3b791cb4e69773e22b03385a71fe05COPY
    components/ /workspace/components/
    		11/07/2025 1:22 AM UTC
    sha256:a3b812ec7c94e42efedac0b56c5d79d171e3c98d27b9e54c6f761d6fd86b1805COPY
    deploy /workspace/deploy
    		11/07/2025 1:22 AM UTC
    sha256:175b7567fed7c154951f5fed726c15ba3aeae81278bcdb9b1efc6b47e6aece4eCOPY
    benchmarks /workspace/benchmarks
    		11/07/2025 1:22 AM UTC
    sha256:c0bd15d4f3609165e640fa6921c40063f9bad60a454369034141497a5ef0172cCOPY
    examples /workspace/examples
    		11/07/2025 1:22 AM UTC
    sha256:cefff85e32e9fa93e6cf2d2edb17db47127ad2d6780f649ac014890fb0c87199COPY
    tests /workspace/tests
    		11/07/2025 1:22 AM UTC
    ...

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.