ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    Dynamo Tensorrt-LLM Runtime
    Container
    NVIDIA
    Dynamo Tensorrt-LLM Runtime

    The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    —
    		10/27/2025 6:23 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    		10/27/2025 6:23 PM UTC
    sha256:8fa7413d3ce117a07a1824e66325d63141777174f8fa2920bdd639c0adf1bdadRUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt-llm==1.1.0rc5 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
    		10/27/2025 6:23 PM UTC
    sha256:18c93c754800ac1ae488fe331426e3a5c0b323d7b60bd1ed9a89aec9b9414271COPY
    ATTRIBUTION* LICENSE /workspace/
    		10/27/2025 6:23 PM UTC
    sha256:a40a516804faee9de1a8703770308d68ec8ba9fbc56e7767cadf55ae1e819223COPY
    components/ /workspace/components/
    		10/27/2025 6:23 PM UTC
    sha256:da81ba31decdb95ca35e713a4ecdc8ae71d5ad75d389278e4dacd9f4ab333f0cCOPY
    deploy /workspace/deploy
    		10/27/2025 6:23 PM UTC
    sha256:672990c715d6fe03fdd9a83e9f6723e4c009c4aa3d202c409881f0be1821a8fbCOPY
    benchmarks /workspace/benchmarks
    		10/27/2025 6:23 PM UTC
    sha256:249ced5a4845060847d80427d84dac3ec1f2cfd7f10aac607f7d102097299a2cCOPY
    examples /workspace/examples
    		10/27/2025 6:23 PM UTC
    sha256:37c0263a2d181f4c1c20800e0a035d2cf9cb9dc04d598d355522459cd543b32aCOPY
    tests /workspace/tests
    		10/27/2025 6:23 PM UTC
    sha256:812024646f2544acd1a412523a1e0ddfd18ac543394d1c7bc0646ce3a4d32b48COPY
    /usr/local/cuda/lib64/libcusparseLt* /usr/local/cuda/lib64/
    		10/27/2025 6:23 PM UTC
    ...