ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT LLM Develop
Container
NVIDIA
NVIDIA
TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
sha256:cca99df4d1775fdf41a4efc79d33b2c81bacd74c75a32c4ecf083f3a2e4eb7deRUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "protobuf>=4.25.8"
09/02/2025 1:00 AM UTC
sha256:7e59867f3c1745a42fc4a069a96b454d1977fee52c344d9ed97993bb9b92f9bfRUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv &&
  rm -rf /usr/local/lib/python3*/dist-packages/cv2/ &&
  pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir
09/02/2025 1:00 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
PYTORCH_CUDA_ALLOC_CONF=garbage_collection_threshold:0.99999
09/02/2025 1:00 AM UTC
sha256:583131a2b4b9550a4bc3c2a35f2a37b51f1f6280ffb8f8b84e00b8621c99c4b0RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE &&
  rm install_pytorch.sh
09/02/2025 1:00 AM UTC
sha256:d3bc88451646d5e60877eb370b6cb5c5fddcab9f795fd544ad0f7de4ed6f2b6bCOPY
docker/common/install_pytorch.sh install_pytorch.sh
09/02/2025 1:00 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TORCH_INSTALL_TYPE=skip
09/02/2025 1:00 AM UTC
sha256:d2f5ddcf490683d9e21d567667fbea13edd423e6846ee817248fef9b5f5b1a03RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c GITHUB_MIRROR=$GITHUB_MIRROR bash ./install_mpi4py.sh &&
  rm install_mpi4py.sh
09/02/2025 1:00 AM UTC
sha256:a00615da6cf9187b2c25292c6138183b9fbb0f8c83de006ff2f48352f035a4b8COPY
docker/common/install_mpi4py.sh install_mpi4py.sh
09/02/2025 12:59 AM UTC
sha256:4431603fbc4a1d92908a37a041102f7f58f33bf47ae2d5a878fd87dcabd17f4aRUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_polygraphy.sh &&
  rm install_polygraphy.sh
09/02/2025 12:59 AM UTC
sha256:a46873175b238bae7aa504888deb7ff2f987376e6fcfd77d3832fbcdfd57899fCOPY
docker/common/install_polygraphy.sh install_polygraphy.sh
09/02/2025 12:56 AM UTC
...