ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT LLM Develop
Container
NVIDIA
NVIDIA
TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
sha256:ce5d5d7d278a32124d62305edbf9ab545a78e7c267fc7acc172f5e8f5eafa0a5RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "protobuf>=4.25.8"
08/15/2025 8:39 AM UTC
sha256:28e3b47bd9ee74e114e556abf99cef2d9ace30a022bd6ab90e5bbd8d93d22f72RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir
08/15/2025 8:39 AM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv &&
  rm -rf /usr/local/lib/python3*/dist-packages/cv2/
08/15/2025 8:39 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
PYTORCH_CUDA_ALLOC_CONF=garbage_collection_threshold:0.99999
08/15/2025 8:39 AM UTC
sha256:89889961be9c7eea52f1932c13885d5c5b7c2255c520d2193a6c90578ddca9e0RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE &&
  rm install_pytorch.sh
08/15/2025 8:39 AM UTC
sha256:13ee63dba7833c60939169f12b1c1ff4ca834b9399a30ac4e8a8873f55026ba1COPY
docker/common/install_pytorch.sh install_pytorch.sh
08/15/2025 8:39 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TORCH_INSTALL_TYPE=skip
08/15/2025 8:39 AM UTC
sha256:778e9690edd7a0d6a178c0c485ec882739409ee4a9510d91365a3389f132cfefRUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c GITHUB_MIRROR=$GITHUB_MIRROR bash ./install_mpi4py.sh &&
  rm install_mpi4py.sh
08/15/2025 8:39 AM UTC
sha256:8939c7eef79d2a7845d41d72c9e22fe131fb59666214b5f0222950b4197e3461COPY
docker/common/install_mpi4py.sh install_mpi4py.sh
08/15/2025 8:37 AM UTC
sha256:ad699a70e87ab87ae4c619cf2bdf06e81277f80279ef52932f40b479fe155fc5RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_polygraphy.sh &&
  rm install_polygraphy.sh
08/15/2025 8:37 AM UTC
...