ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    TensorRT LLM Develop
    Container
    NVIDIA
    TensorRT LLM Develop

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

  • LayerLabelCreated
    sha256:d9148a51100c92900770bb97146e46ea7c415cad6a3653bf4f42bd86b76b08e5RUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "protobuf>=4.25.8"
    		08/19/2025 11:29 PM UTC
    sha256:fcc993ad858adbb1067449c9a9b6a4b29b8f26c05bfb975948561283e373a574RUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv &&
  rm -rf /usr/local/lib/python3*/dist-packages/cv2/ &&
  pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir
    		08/19/2025 11:20 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    PYTORCH_CUDA_ALLOC_CONF=garbage_collection_threshold:0.99999
    		08/19/2025 11:20 PM UTC
    sha256:744c4eb71e98ce1375c340a93acc2f410ffe61b1b00db91de3234df944a0e737RUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE &&
  rm install_pytorch.sh
    		08/19/2025 11:20 PM UTC
    sha256:d01358575cfae1fdc81aa7ec1eeec589d27513f34cdfac6c706b9c6a6b9876c4COPY
    docker/common/install_pytorch.sh install_pytorch.sh
    		08/19/2025 11:20 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    TORCH_INSTALL_TYPE=skip
    		08/19/2025 11:20 PM UTC
    sha256:c6ba49f7d472fe343b84a70d073b7e49e54fcb1c52587e076b34d6f2a1539331RUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c GITHUB_MIRROR=$GITHUB_MIRROR bash ./install_mpi4py.sh &&
  rm install_mpi4py.sh
    		08/19/2025 11:20 PM UTC
    sha256:7fabd8a9e5c6914286aa3f49b3d1d23e2a95d46ebee030b3336aa9053f6f907bCOPY
    docker/common/install_mpi4py.sh install_mpi4py.sh
    		08/19/2025 10:44 PM UTC
    sha256:4deb5bca35770dbbffe85c958c774ae0dbcd0a0eec0770af2b1b2452efdd8cc4RUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_polygraphy.sh &&
  rm install_polygraphy.sh
    		08/19/2025 10:44 PM UTC
    sha256:eb2623f63078695f44ce97d8f268e42c23db3fd88e7db79fd84564e49bcda95aCOPY
    docker/common/install_polygraphy.sh install_polygraphy.sh
    		08/19/2025 10:44 PM UTC
    ...

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.