ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    Dynamo Tensorrt-LLM Runtime
    Container
    NVIDIA
    Dynamo Tensorrt-LLM Runtime

    The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    —
    		11/06/2025 6:26 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    		11/06/2025 6:26 PM UTC
    sha256:97895bafd0bef314cb6b73fa422c4611f19c288bd33eafa19dad123c69bfb4dcRUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt-llm==1.1.0rc5 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
    		11/06/2025 6:26 PM UTC
    sha256:83ea660dabf4ece553b9482f5950c27ca9f3e8d40ae6ece66f69f073b00b852dCOPY
    ATTRIBUTION* LICENSE /workspace/
    		11/06/2025 6:26 PM UTC
    sha256:3dd460ed11cc5293b0eacfbec083003d96844528e0a947acbaa82e9bec90602aCOPY
    recipes/ /workspace/recipes/
    		11/06/2025 6:26 PM UTC
    sha256:4bf72216b86c8dd9ec10afe839b0351d880c5b642c4c77bd1100e289e13e6c5cCOPY
    components/ /workspace/components/
    		11/06/2025 6:26 PM UTC
    sha256:df6c7eb0f4cf4689ac57056718579a9c04faf4eb47c92cb68963775b34623c4eCOPY
    deploy /workspace/deploy
    		11/06/2025 6:26 PM UTC
    sha256:8d2bf6b2450e803a40719bad15d11dd82d1cdbfe743265880ff6731fdaad683eCOPY
    benchmarks /workspace/benchmarks
    		11/06/2025 6:26 PM UTC
    sha256:5a44fa87085bca17bc88856a259fcbce1814c73c6355d7caed2ab566b624c235COPY
    examples /workspace/examples
    		11/06/2025 6:26 PM UTC
    sha256:461740212cd3dd7a98a058e61f3d3a84b73be453b658728ae11295acdc7b63c2COPY
    tests /workspace/tests
    		11/06/2025 6:26 PM UTC
    ...