ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    NVIDIA
    TensorRT LLM Develop
    Container
    NVIDIA
    NVIDIA
    TensorRT LLM Develop

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

  • LayerLabelCreated
    sha256:da16a811b9417a088be5024d1a9b22bde10a0592a39b305657186907f7fdea43RUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install --upgrade --no-cache-dir "h11>=0.16" "tornado>=6.5.0" "setuptools>=78.1.1,<80"
    		08/03/2025 3:27 PM UTC
    sha256:8aada5d7086bd04a589101a15906bcb6d1176742631d6b1e50954b88c75120abRUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_deep_ep.sh &&
  rm install_deep_ep.sh
    		08/03/2025 3:27 PM UTC
    sha256:d37bc1b743a723a78855c762ced319e5efa288ecaff140cceb92e58b8d6d0bf6COPY
    docker/common/install_deep_ep.sh install_deep_ep.sh
    		08/03/2025 3:22 PM UTC
    sha256:c31d895070f4f735fab3a781c81e2cf8413e2a1dc866eb929b19be7e6d677838RUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir
    		08/03/2025 3:22 PM UTC
    sha256:d721baf4c2bdb549cdbb2d21c24dc4ab54245d10c2fcfff1ff9daec967f20a07RUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv &&
  rm -rf /usr/local/lib/python3*/dist-packages/cv2/
    		08/03/2025 3:21 PM UTC
    sha256:99c98ac8360257c1d4bc8f9007228fa3df22a56241457e48facb0cbd5c31af4bRUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE &&
  rm install_pytorch.sh
    		08/03/2025 3:21 PM UTC
    sha256:ee5fa0c67747ec6143f04760ee81f54bb5cec42f566f6ed13a6416b583c0eb63COPY
    docker/common/install_pytorch.sh install_pytorch.sh
    		08/03/2025 3:21 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    TORCH_INSTALL_TYPE=skip
    		08/03/2025 3:21 PM UTC
    sha256:9ceebea482c610223d15ed782fa86ae437e56667d2ddb3baff29bfc5dbf813a7RUN
    GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_mpi4py.sh &&
  rm install_mpi4py.sh
    		08/03/2025 3:21 PM UTC
    sha256:859a6b2beae7373be664b04460b53d886a5e28330aedef456fb1ca3ba6d6d925COPY
    docker/common/install_mpi4py.sh install_mpi4py.sh
    		08/03/2025 3:17 PM UTC
    ...