ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NVIDIA MLPerf Inference
Container
NVIDIA
NVIDIA
NVIDIA MLPerf Inference

MLPerf Inference containers are base containers for people interested in NVIDIA's MLPerf Inference submission results

LayerLabelCreated
sha256:7be46cd8e3843f5da81edb0f39a4a6acf0b0c0167dcb3da3eea4a17e8c6e7b41COPY
NVIDIA_MLPerf_Evaluation_License /
03/14/2023 5:43 PM UTC
sha256:b489c1f133f63fcc9eedfb87c568aade691eb655a7ecd768bf313fd65fddf9bfRUN
CUDA_VER=11.4 TRT_DEB_URL=http://cuda-repo/release-candidates/Libraries/TensorRT/v8.5/8.5.2.1-6ebd8d1c/11.4-r470/l4t-aarch64/deb/ TRT_MAJOR_VER=8 TRT_MINOR_VER=5 TRT_PATCH_VER=2 TRT_VER=8.5.2 ldconfig
03/14/2023 5:43 PM UTC
sha256:3f7f285f5ce9ff5c30fbb953b92ba40f00d95c35a5868f966975de37a163fbb1RUN
CUDA_VER=11.4 TRT_DEB_URL=http://cuda-repo/release-candidates/Libraries/TensorRT/v8.5/8.5.2.1-6ebd8d1c/11.4-r470/l4t-aarch64/deb/ TRT_MAJOR_VER=8 TRT_MINOR_VER=5 TRT_PATCH_VER=2 TRT_VER=8.5.2 install_deb_pkg() { wget -nv $TRT_DEB_URL/$1 -O $1 &&
  dpkg -i $1 &&
  rm $1; } &&
  install_deb_pkg libnvinfer${TRT_MAJOR_VER}_${TRT_VER}-1+cuda${CUDA_VER}_arm64.deb &&
  install_deb_pkg libnvinfer-dev_${TRT_VER}-1+cuda${CUDA_VER}_arm64.deb &&
  install_deb_pkg libnvinfer-plugin${TRT_MAJOR_VER}_${TRT_VER}-1+cuda${CUDA_VER}_arm64.deb &&
  install_deb_pkg libnvinfer-plugin-dev_${TRT_VER}-1+cuda${CUDA_VER}_arm64.deb &&
  install_deb_pkg libnvparsers${TRT_MAJOR_VER}_${TRT_VER}-1+cuda${CUDA_VER}_arm64.deb &&
  install_deb_pkg libnvparsers-dev_${TRT_VER}-1+cuda${CUDA_VER}_arm64.deb &&
  install_deb_pkg libnvonnxparsers${TRT_MAJOR_VER}_${TRT_VER}-1+cuda${CUDA_VER}_arm64.deb &&
  install_deb_pkg libnvonnxparsers-dev_${TRT_VER}-1+cuda${CUDA_VER}_arm64.deb &&
  install_deb_pkg python3-libnvinfer_${TRT_VER}-1+cuda${CUDA_VER}_arm64.deb &&
  install_deb_pkg python3-libnvinfer-dev_${TRT_VER}-1+cuda${CUDA_VER}_arm64.deb &&
  install_deb_pkg graphsurgeon-tf_${TRT_VER}-1+cuda${CUDA_VER}_arm64.deb &&
  install_deb_pkg uff-converter-tf_${TRT_VER}-1+cuda${CUDA_VER}_arm64.deb &&
  install_deb_pkg libnvinfer-bin_${TRT_VER}-1+cuda${CUDA_VER}_arm64.deb &&
  unset -f install_deb_pkg
03/14/2023 5:43 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TRT_VER=8.5.2
03/14/2023 5:42 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TRT_PATCH_VER=2
03/14/2023 5:42 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TRT_MINOR_VER=5
03/14/2023 5:42 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TRT_MAJOR_VER=8
03/14/2023 5:42 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
TRT_DEB_URL=http://cuda-repo/release-candidates/Libraries/TensorRT/v8.5/8.5.2.1-6ebd8d1c/11.4-r470/l4t-aarch64/deb/
03/14/2023 5:42 PM UTC
sha256:1512ca18be8d1e5a004da5c3226abeb8a13148b4efba1895e8f7a6fe4ec1e7e8RUN
CUDA_VER=11.4 cp /var/cudnn-local-tegra-repo-ubuntu2004-8.5.0.96/*-keyring.gpg /usr/share/keyrings/ &&
  apt update &&
  apt install -y libcudnn8*
03/14/2023 5:42 PM UTC
sha256:b276feb12a34a3cbaffdafd88de58cdefde617b4f3d8628279c2ca0aa90f28e5RUN
CUDA_VER=11.4 wget -nv http://cuda-repo/release-candidates/kitpicks/cudnn-v8-5-tegra/8.5.0.96/001/local_installers/cudnn-local-tegra-repo-ubuntu2004-8.5.0.96_1.0-1_arm64.deb &&
  echo "059821695ccfa1fe8b335592b9e62765fe81d72a2525c33fbe010eaf61595c41  cudnn-local-tegra-repo-ubuntu2004-8.5.0.96_1.0-1_arm64.deb" | sha256sum --check &&
  dpkg -i ./cudnn-local-tegra-repo-ubuntu2004-8.5.0.96_1.0-1_arm64.deb &&
  rm cudnn*.deb
03/14/2023 5:37 PM UTC

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.