ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT LLM Develop
Container
NVIDIA
NVIDIA
TensorRT LLM Develop

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

LayerLabelCreated
aa45c264da59d91b44adb0890fa77a0125653049c7eca356edbaace2a3b8aec4CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp
07/14/2025 6:19 AM UTC
15051b95b7bd92225f3e89966a1b7eccae55282fd92f3a310c605644dce88be7RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 install opencv-python-headless --force-reinstall --no-deps --no-cache-dir
07/14/2025 6:19 AM UTC
93f7fb0bfcad56ecfa68e90e26080a543adbe79ba5826b0885113ee29f5c659aRUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c pip3 uninstall -y opencv &&
  rm -rf /usr/local/lib/python3*/dist-packages/cv2/
07/14/2025 6:17 AM UTC
a5d7501716141860072cfae08aa2a7d1d45ef5faa95dac02b976ceb277fd6565RUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= TORCH_INSTALL_TYPE=skip /bin/bash -c bash ./install_pytorch.sh $TORCH_INSTALL_TYPE &&
  rm install_pytorch.sh
07/14/2025 6:17 AM UTC
7b5288d153db68885f7d434cc940f71b096965785362fba85c27e0d41a0db531COPY
docker/common/install_pytorch.sh install_pytorch.sh
07/14/2025 6:17 AM UTC
2567a1b38092b8e7d75f16c38dfa2f5ac09e1c830e3efdc7e2095e7c3ec6bff9ARG
TORCH_INSTALL_TYPE=skip
07/14/2025 6:17 AM UTC
9721bb19be501a57ea3dcf8c8d1b6901ce2291b7054944c995154c22bbf3907cRUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c GITHUB_MIRROR=$GITHUB_MIRROR bash ./install_mpi4py.sh &&
  rm install_mpi4py.sh
07/14/2025 6:17 AM UTC
19f35afddb427f8680ef15eaa7633ba4ba7b9c05857fb58e2a40e4d4921e40e6COPY
docker/common/install_mpi4py.sh install_mpi4py.sh
07/14/2025 6:17 AM UTC
c020e5ac44e803b573326b020f5f41d79aeacb7ebb40cec94a67229ff5b388dbRUN
GITHUB_MIRROR=https://urm.nvidia.com/artifactory/github-go-remote PYTHON_VERSION=3.12.3 TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= /bin/bash -c bash ./install_polygraphy.sh &&
  rm install_polygraphy.sh
07/14/2025 6:17 AM UTC
cf1b2f2eab895aaa26d3365be28f5aebc6ae2003e6bc65904bbcfb8f066c8ebaCOPY
docker/common/install_polygraphy.sh install_polygraphy.sh
07/14/2025 6:15 AM UTC
...