ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT LLM Develop
Container
NVIDIA
NVIDIA
TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
sha256:412a177daec4e93d7bea93be4b6d9b0e3f0143c6c008df94c8f2d702104bf159RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "h11>=0.16" "tornado>=6.5.0" "setuptools>=78.1.1,<80"
06/16/2025 4:07 PM UTC
sha256:a1d5bac1c0568221a8e28e80ac298936f9f790679aebca1de8de9eb29dadd037RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_deep_ep.sh &&
  rm install_deep_ep.sh
06/16/2025 4:07 PM UTC
sha256:70575386f2dc7abd02a014610e32b349b476b884a2b039c071e0420027213dfbCOPY
docker/common/install_deep_ep.sh install_deep_ep.sh
06/16/2025 4:02 PM UTC
sha256:023b4620a691e41f2217860df4f43ac650e6e239e7afe279e2be8219a2a1aa35RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir
06/16/2025 4:02 PM UTC
sha256:43c793ace07924ee754ae72663c0979f3418f4dbe391a2d8782ee29a548c79aaRUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv &&
  rm -rf /usr/local/lib/python3*/dist-packages/cv2/
06/16/2025 4:00 PM UTC
sha256:cb86d104484f3703b88a81722cd37e39086bf36d712895dc74b8c888623811b1RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE &&
  rm install_pytorch.sh
06/16/2025 4:00 PM UTC
sha256:fae02f7b7b51a78c37ff7df37de9a405f4784380a4208bfeadc099415c256b5fCOPY
docker/common/install_pytorch.sh install_pytorch.sh
06/16/2025 4:00 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TORCH_INSTALL_TYPE=skip
06/16/2025 4:00 PM UTC
sha256:26fd9d534319718b7465b50e4e1391f11112d51513c710157b96f2da5fa51716RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_mpi4py.sh &&
  rm install_mpi4py.sh
06/16/2025 4:00 PM UTC
sha256:3074fac4565f6daa911e001fc08469069e3ac41101e8d14b34e4fc13a6c45930COPY
docker/common/install_mpi4py.sh install_mpi4py.sh
06/16/2025 4:00 PM UTC
...