ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT LLM Develop
Container
NVIDIA
NVIDIA
TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
sha256:507b891a2a719f0ec1abfaa5c3b72ed507023a34e252b661fe5071726a24cc40RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "h11>=0.16" "tornado>=6.5.0" "setuptools>=78.1.1,<80" "protobuf>=4.25.8" "jupyter-core>=5.8.1"
07/14/2025 6:19 AM UTC
sha256:19cea0d84091d00b669520b359a11e5f98ac30d54fcbe94a68ba719e2b1c7c23RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir
07/14/2025 6:19 AM UTC
sha256:b3d53c53d40c1976d3a0a9189bc4e37b6a89fd6edbc4997761747c0183e47591RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv &&
  rm -rf /usr/local/lib/python3*/dist-packages/cv2/
07/14/2025 6:17 AM UTC
sha256:d0547455422769130920ba1ecd39769f29374650b14f9efd72d0bb0e8c419f6dRUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE &&
  rm install_pytorch.sh
07/14/2025 6:17 AM UTC
sha256:01fdd2bddbc657a2a3ffac4278f2d955f37f6e3b3ff3a7976e9bf7e761bf6fadCOPY
docker/common/install_pytorch.sh install_pytorch.sh
07/14/2025 6:17 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TORCH_INSTALL_TYPE=skip
07/14/2025 6:17 AM UTC
sha256:68304dca1e63f20cb040c4b3172aa6a29c68b2da1fb2e876cccb807e41fd48acRUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c GITHUB_MIRROR=$GITHUB_MIRROR bash ./install_mpi4py.sh &&
  rm install_mpi4py.sh
07/14/2025 6:17 AM UTC
sha256:6cf21a1c549c0002aae8faa3dc849f165fa019f676a41a5257e724431281e6f2COPY
docker/common/install_mpi4py.sh install_mpi4py.sh
07/14/2025 6:17 AM UTC
sha256:ac6ffc9590793ea39abb7128d2141594f925af027cd89f5e0375e950a10342dfRUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_polygraphy.sh &&
  rm install_polygraphy.sh
07/14/2025 6:17 AM UTC
sha256:ccb637a579831e75850432b254e2097978f08b91e03903697b5d46fd7ce16625COPY
docker/common/install_polygraphy.sh install_polygraphy.sh
07/14/2025 6:15 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.