Skip to main content
ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    TensorRT LLM Develop
    Container
    NVIDIA
    TensorRT LLM Develop

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.trtllm.bolt-profiles-ref=6c1ce33e7fbb1730c3d85150e6ac73ebc1b76deb
    		08/31/2026 8:22 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    TRTLLM_BOLT_PROFILES=/opt/tensorrt_llm/bolt/profiles
    		08/31/2026 8:22 AM UTC
    sha256:a77ad5ffc60aeb0c4faba63b456a170f2232414267717f1f662a6e3ee58b5fdfCOPY
    bolt_bundle/ /opt/tensorrt_llm/bolt/profiles/
    		08/31/2026 8:22 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    BOLT_PROFILES_REF=6c1ce33e7fbb1730c3d85150e6ac73ebc1b76deb
    		08/31/2026 8:22 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    BOLT_BUNDLE_DIR=bolt_bundle
    		08/31/2026 8:22 AM UTC
    sha256:1312742eca26565532d1fd7c9352ed9b3d1830c9dd7651b81e709284cc3961bcRUN
    SH_ENV=/etc/shinit_v2 BASH_ENV=/etc/bash.bashrc GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip GIT_COMMIT=1b191b610b629c8a09bbd98516d638a6995ee89b TRT_LLM_VER=1.3.0rc26.dev202608310754 TARGETARCH=amd64 /bin/bash -c bash /tmp/gen_attribution.sh "devel" "${TRT_LLM_VER}" "${TARGETARCH}"
    		08/31/2026 8:12 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    TRT_LLM_GIT_COMMIT=1b191b610b629c8a09bbd98516d638a6995ee89b TRT_LLM_VERSION=1.3.0rc26.dev202608310754
    		08/31/2026 8:12 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    TARGETARCH=amd64
    		08/31/2026 8:12 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    TRT_LLM_VER=1.3.0rc26.dev202608310754
    		08/31/2026 8:12 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    GIT_COMMIT=1b191b610b629c8a09bbd98516d638a6995ee89b
    		08/31/2026 8:12 AM UTC
    ...