ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NVIDIA L4T TensorRT
Container
NVIDIA
NVIDIA
NVIDIA L4T TensorRT

NVIDIA TensorRT is a C++ library that facilitates high-performance inference on NVIDIA graphics processing units (GPUs). TensorRT takes a trained network and produces a highly optimized runtime engine that performs inference for that network.

LayerLabelCreated
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
TRT_VERSION=8.5.2.2 TRT_LIBNVINFER_VERSION=8.5.2 NVIDIA_TENSORRT_VERSION=8.5.2.2 PYVER=3.8 rm -rf /var/lib/apt/lists/*
06/20/2023 9:37 PM UTC
sha256:6d48c9cd840abb3cb30dc3244520aaf8112556a2430fc9ac08f648f43b6a6b48RUN
TRT_VERSION=8.5.2.2 TRT_LIBNVINFER_VERSION=8.5.2 NVIDIA_TENSORRT_VERSION=8.5.2.2 PYVER=3.8 rm /etc/apt/sources.list.d/trt.list
06/20/2023 9:37 PM UTC
sha256:2fd3565f42917b7b2b24191ec5cce62cf39a6953afa53e9efa1ef3471c1180d9RUN
TRT_VERSION=8.5.2.2 TRT_LIBNVINFER_VERSION=8.5.2 NVIDIA_TENSORRT_VERSION=8.5.2.2 PYVER=3.8 export PY=$(python -c 'import sys; print(str(sys.version_info[0])+str(sys.version_info[1]))') &&
  pip install /builds/TensorRT-$TRT_VERSION/python/tensorrt-$TRT_VERSION-cp38-none-linux_aarch64.whl /builds/TensorRT-$TRT_VERSION/graphsurgeon/graphsurgeon-0.4.6-py2.py3-none-any.whl /builds/TensorRT-$TRT_VERSION/python/tensorrt-$TRT_VERSION-cp${PY}-none-linux_aarch64.whl /builds/TensorRT-$TRT_VERSION/uff/uff-0.6.9-py2.py3-none-any.whl # COPY NGC-DL-CONTAINER-LICENSE /
06/20/2023 9:37 PM UTC
sha256:e14d07bbc5fb5a4fccbdb157f18a16d5ae0ef41d6de4edcefabb1357c2c664eaRUN
TRT_VERSION=8.5.2.2 TRT_LIBNVINFER_VERSION=8.5.2 NVIDIA_TENSORRT_VERSION=8.5.2.2 PYVER=3.8 curl -O https://bootstrap.pypa.io/get-pip.py &&
  python get-pip.py &&
  rm get-pip.py
06/20/2023 9:37 PM UTC
sha256:359a83348d03268fea9cfa7aa9853c802a97208e05de2ede4ebaf196b109aa34RUN
TRT_VERSION=8.5.2.2 TRT_LIBNVINFER_VERSION=8.5.2 NVIDIA_TENSORRT_VERSION=8.5.2.2 PYVER=3.8 MAJ=`echo "$PYVER" | cut -c1-1` &&
  rm -f /usr/bin/python$MAJ &&
  ln -s /usr/bin/python$PYVER /usr/bin/python$MAJ
06/20/2023 9:37 PM UTC
sha256:3fc9aed97998d5d2c463ddce4a07deb19de182db058c0d1ec7b7f9be30da6b9aRUN
TRT_VERSION=8.5.2.2 TRT_LIBNVINFER_VERSION=8.5.2 NVIDIA_TENSORRT_VERSION=8.5.2.2 PYVER=3.8 rm -f /usr/bin/python &&
  ln -s /usr/bin/python$PYVER /usr/bin/python
06/20/2023 9:36 PM UTC
sha256:3a1f3b2ccd139b89d4d38fff90ad19ecb3bf7ab5a9a6b004e0b5e72d7024a817RUN
TRT_VERSION=8.5.2.2 TRT_LIBNVINFER_VERSION=8.5.2 NVIDIA_TENSORRT_VERSION=8.5.2.2 PYVER=3.8 rm -rf /var/lib/apt/lists/*
06/20/2023 9:36 PM UTC
sha256:f973bd6b120d8260a810ad98aaee9c617b93d8bd071419f96b6ab4b694a92f98RUN
TRT_VERSION=8.5.2.2 TRT_LIBNVINFER_VERSION=8.5.2 NVIDIA_TENSORRT_VERSION=8.5.2.2 PYVER=3.8 apt-get update &&
  apt install -f libnvinfer8 libnvinfer-plugin8 libnvparsers8 libnvonnxparsers8 python3-libnvinfer libnvinfer-bin
06/20/2023 9:36 PM UTC
sha256:36ee7bd06ccf4349763bb9b983f22213d60d0e74aa9a6c76c3c4832ec7d87a04RUN
TRT_VERSION=8.5.2.2 TRT_LIBNVINFER_VERSION=8.5.2 NVIDIA_TENSORRT_VERSION=8.5.2.2 PYVER=3.8 apt-get update &&
  apt-get upgrade -y &&
  apt-get install -y --no-install-recommends gnupg2 curl ca-certificates &&
  curl -fsSL https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/sbsa/3bf863cc.pub | apt-key add - &&
  echo "deb http://cuda-internal.nvidia.com/release-candidates/kitpicks/tensorrt-rel-8-5-tegra/8.5.2/002/repos/l4t/arm64 /" > /etc/apt/sources.list.d/trt.list &&
  apt-get update &&
  apt-get install -y --no-install-recommends gnupg2 curl ca-certificates python$PYVER $DISTUTILS git pkg-config unzip
06/20/2023 9:35 PM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
TRT_VERSION=8.5.2.2 TRT_LIBNVINFER_VERSION=8.5.2 NVIDIA_TENSORRT_VERSION=8.5.2.2 PYVER=3.8 if [ "$PYVER" = "3.8" ]; then DISTUTILS="python3-distutils"; fi
06/20/2023 9:34 PM UTC
...