ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT LLM Develop
Container
NVIDIA
NVIDIA
TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
sha256:cbb3c3279957312ceabc1d16009b26ad98ef749861b9f3cca4ed0a7ab5c8fdb4RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "h11>=0.16" "tornado>=6.5.0" "setuptools>=78.1.1,<80"
06/29/2025 12:20 PM UTC
sha256:5482ad3155aeebee9b79286c446d668bb29064014a12f666be58cd8733407c64RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_deep_ep.sh &&
  rm install_deep_ep.sh
06/29/2025 12:20 PM UTC
sha256:341a8877ac0eacd7df4ead697547c0a236d79805cf0fe9f7e787368b2ab67e00COPY
docker/common/install_deep_ep.sh install_deep_ep.sh
06/29/2025 12:16 PM UTC
sha256:24b835534e6bd6cc3e56b75a356c4f323c937c8345728580c06d53c32adfdcd1RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir
06/29/2025 12:16 PM UTC
sha256:3839d963d7dfcf897de480cc5cdf6f19562c7120d4eadf3ac6ca7c3df7755348RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv &&
  rm -rf /usr/local/lib/python3*/dist-packages/cv2/
06/29/2025 12:16 PM UTC
sha256:5019a1b968629abc8bcf0caa79ee80e6043ef2a2e523934040e6c463a1edc741RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE &&
  rm install_pytorch.sh
06/29/2025 12:16 PM UTC
sha256:fbbb46cbbd261b6d1347b0dd1302416789acc9066b77f9d20900ecdd84281a78COPY
docker/common/install_pytorch.sh install_pytorch.sh
06/29/2025 12:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TORCH_INSTALL_TYPE=skip
06/29/2025 12:16 PM UTC
sha256:6f3f79f8c238c0e1c6dd354df7f31a5cfcbf8f4b1000c47108af4a6abc48e3aeRUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_mpi4py.sh &&
  rm install_mpi4py.sh
06/29/2025 12:16 PM UTC
sha256:fba8e0b0a6f5bfc17e7045903e0db63c10507b49f395a5eb188d4c2a214bf4a4COPY
docker/common/install_mpi4py.sh install_mpi4py.sh
06/29/2025 12:15 PM UTC
...