ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT LLM Develop
Container
NVIDIA
NVIDIA
TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
sha256:6851a189f936a471e46d10ad1269c78d163348f8f4637172389261f40155239dRUN
SH_ENV=/etc/shinit_v2 BASH_ENV=/etc/bash.bashrc GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip TRT_LLM_VER=1.3.0rc0 TARGETARCH=amd64 /bin/bash -c bash /tmp/generate_container_oss_attribution.sh "devel" "${TRT_LLM_VER}" "${TARGETARCH}" &&
  rm /tmp/generate_container_oss_attribution.sh
01/18/2026 7:48 AM UTC
sha256:bcbea9a55e92004c8e4aee22057f1e12e76fbd89c5863e0c9847929522e970dcCOPY
scripts/generate_container_oss_attribution.sh /tmp/generate_container_oss_attribution.sh
01/18/2026 7:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TARGETARCH=amd64
01/18/2026 7:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TRT_LLM_VER=1.3.0rc0
01/18/2026 7:48 AM UTC
sha256:8cc25ff9876312448937428c389ccbafab78747c2f1b92be91ed1a01b3603fabRUN
SH_ENV=/etc/shinit_v2 BASH_ENV=/etc/bash.bashrc GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c GITHUB_MIRROR=${GITHUB_MIRROR} bash ./install_ucx.sh &&
  GITHUB_MIRROR=${GITHUB_MIRROR} bash ./install_nixl.sh &&
  bash ./install_etcd.sh &&
  rm install_ucx.sh &&
  rm install_nixl.sh &&
  rm install_etcd.sh
01/18/2026 7:48 AM UTC
sha256:c0a9ac4ac085b4a9465bcc53c4ac0590a28e360a6ec0fb9e6112559e1bc59503RUN
SH_ENV=/etc/shinit_v2 BASH_ENV=/etc/bash.bashrc GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --no-cache-dir -r /tmp/constraints.txt &&
  rm /tmp/constraints.txt
01/18/2026 7:45 AM UTC
sha256:e8f6b722433a529eb94e9291efdc20b992d1016395d5ccd86b12e3d485ee4b6aCOPY
constraints.txt /tmp/constraints.txt
01/18/2026 7:45 AM UTC
sha256:f5397bd3d502d82a450ab3d5c2a616f763bd87cf99a8a5ad4d374aae8752182dRUN
SH_ENV=/etc/shinit_v2 BASH_ENV=/etc/bash.bashrc GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c GITHUB_MIRROR=${GITHUB_MIRROR} PYTHON_VERSION=${PYTHON_VERSION} TRT_VER=${TRT_VER} CUDA_VER=${CUDA_VER} CUDNN_VER=${CUDNN_VER} NCCL_VER=${NCCL_VER} CUBLAS_VER=${CUBLAS_VER} TORCH_INSTALL_TYPE=${TORCH_INSTALL_TYPE} bash ./install.sh --base --cmake --ccache --cuda_toolkit --tensorrt --polygraphy --mpi4py --pytorch --opencv &&
  rm install_base.sh &&
  rm install_cmake.sh &&
  rm install_ccache.sh &&
  rm install_cuda_toolkit.sh &&
  rm install_tensorrt.sh &&
  rm install_polygraphy.sh &&
  rm install_mpi4py.sh &&
  rm install_pytorch.sh &&
  rm install.sh
01/18/2026 7:45 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TORCH_INSTALL_TYPE=skip
01/18/2026 7:42 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
CUBLAS_VER
01/18/2026 7:42 AM UTC
...