ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT LLM Develop
Container
NVIDIA
NVIDIA
TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
e01150c18ce26c597c4707bc44587012f03297f32e88be20fcd322bdb961fb20CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp
03/30/2026 8:52 AM UTC
c130f844deaf015ce508cce7f4f494b6a23f653a4377af46179ac4cd8a863251ARG
TARGETARCH=amd64
03/30/2026 8:52 AM UTC
fac4daba784fc54753d1eea6c3fb7cc3878c0ee1f969bb0627c7e74019bf1ef5ARG
TRT_LLM_VER=1.3.0rc10
03/30/2026 8:52 AM UTC
a8670c58df7afb1a79e72ac5d8c4551da945206d1d7df4847fa17c77a468477fRUN
SH_ENV=/etc/shinit_v2 BASH_ENV=/etc/bash.bashrc GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c GITHUB_MIRROR=${GITHUB_MIRROR} bash /opt/docker/common/install_ucx.sh &&
  GITHUB_MIRROR=${GITHUB_MIRROR} bash /opt/docker/common/install_nixl.sh &&
  bash /opt/docker/common/install_etcd.sh &&
  rm -rf /root/.cache/uv/archive-v0 &&
  rm -rf /usr/local/lib/python3.12/dist-packages/setuptools/_vendor/jaraco.context-5.3.0.dist-info &&
  rm -rf /usr/local/lib/python3.12/dist-packages/setuptools/_vendor/wheel-*.dist-info
03/30/2026 8:52 AM UTC
3a99b29c3630a151418bc22cca18551a328dc5ca309db04e42380b6a555116feRUN
SH_ENV=/etc/shinit_v2 BASH_ENV=/etc/bash.bashrc GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --ignore-installed --no-cache-dir -r /tmp/constraints.txt &&
  rm /tmp/constraints.txt &&
  pip3 uninstall -y nbconvert ||
  true
03/30/2026 8:49 AM UTC
f8e015f7653d5c11a39ed7eee5a9ceba273d5ff775b4f20cd5bed13a1eeb3c6cCOPY
constraints.txt /tmp/constraints.txt
03/30/2026 8:49 AM UTC
ce460999e5dcf2876acad4e6521134a7f6ef40af3607d24a55687d019de5cbd4RUN
SH_ENV=/etc/shinit_v2 BASH_ENV=/etc/bash.bashrc GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c echo "Using GitHub mirror: ${GITHUB_MIRROR}" &&
  echo "Using Python version: ${PYTHON_VERSION}" &&
  GITHUB_MIRROR=${GITHUB_MIRROR} PYTHON_VERSION=${PYTHON_VERSION} TRT_VER=${TRT_VER} CUDA_VER=${CUDA_VER} CUDNN_VER=${CUDNN_VER} NCCL_VER=${NCCL_VER} CUBLAS_VER=${CUBLAS_VER} TORCH_INSTALL_TYPE=${TORCH_INSTALL_TYPE} bash /opt/docker/common/install.sh --base --cmake --ccache --cuda_toolkit --tensorrt --polygraphy --mpi4py --pytorch --opencv
03/30/2026 8:49 AM UTC
8cbacff27949736baec2be967c0e77bb5a4dd13d3063f7b58f65c48e3a8e1221ARG
TORCH_INSTALL_TYPE=skip
03/30/2026 8:36 AM UTC
541b72160554c4b27969947499c2839ac8a0c43cb174cf3a3933330cc8473b1cARG
CUBLAS_VER
03/30/2026 8:36 AM UTC
7dc697de27f43076395a9d69b9e17f4afe4baff1f4891875881b4d66dafe1e70ARG
NCCL_VER
03/30/2026 8:36 AM UTC
...