ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT LLM Develop
Container
NVIDIA
NVIDIA
TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
sha256:d9148a51100c92900770bb97146e46ea7c415cad6a3653bf4f42bd86b76b08e5RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "protobuf>=4.25.8"
08/19/2025 11:29 PM UTC
sha256:fcc993ad858adbb1067449c9a9b6a4b29b8f26c05bfb975948561283e373a574RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv &&
  rm -rf /usr/local/lib/python3*/dist-packages/cv2/ &&
  pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir
08/19/2025 11:20 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
PYTORCH_CUDA_ALLOC_CONF=garbage_collection_threshold:0.99999
08/19/2025 11:20 PM UTC
sha256:744c4eb71e98ce1375c340a93acc2f410ffe61b1b00db91de3234df944a0e737RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE &&
  rm install_pytorch.sh
08/19/2025 11:20 PM UTC
sha256:d01358575cfae1fdc81aa7ec1eeec589d27513f34cdfac6c706b9c6a6b9876c4COPY
docker/common/install_pytorch.sh install_pytorch.sh
08/19/2025 11:20 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TORCH_INSTALL_TYPE=skip
08/19/2025 11:20 PM UTC
sha256:c6ba49f7d472fe343b84a70d073b7e49e54fcb1c52587e076b34d6f2a1539331RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c GITHUB_MIRROR=$GITHUB_MIRROR bash ./install_mpi4py.sh &&
  rm install_mpi4py.sh
08/19/2025 11:20 PM UTC
sha256:7fabd8a9e5c6914286aa3f49b3d1d23e2a95d46ebee030b3336aa9053f6f907bCOPY
docker/common/install_mpi4py.sh install_mpi4py.sh
08/19/2025 10:44 PM UTC
sha256:4deb5bca35770dbbffe85c958c774ae0dbcd0a0eec0770af2b1b2452efdd8cc4RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_polygraphy.sh &&
  rm install_polygraphy.sh
08/19/2025 10:44 PM UTC
sha256:eb2623f63078695f44ce97d8f268e42c23db3fd88e7db79fd84564e49bcda95aCOPY
docker/common/install_polygraphy.sh install_polygraphy.sh
08/19/2025 10:44 PM UTC
...