CUDA

NVIDIA CUDA

CUDA is a parallel computing platform and programming model developed by NVIDIA for general computing on graphical processing units (GPUs). With CUDA, developers can dramatically speed up computing applications by harnessing the power of GPUs.

The CUDA Toolkit from NVIDIA provides everything you need to develop GPU-accelerated applications. The CUDA Toolkit includes GPU-accelerated libraries, a compiler, development tools and the CUDA runtime.

The CUDA container images provide an easy-to-use distribution for CUDA supported platforms and architectures.

End User License Agreements

The images are governed by the following NVIDIA End User License Agreements. By pulling and using the CUDA images, you accept the terms and conditions of these licenses. Since the images may include components licensed under open-source licenses such as GPL, the sources for these components are archived here.

NVIDIA Deep learning Container License

To view the NVIDIA Deep Learning Container license, click here

Documentation

For more information on CUDA, including the release notes, programming model, APIs and developer tools, visit the CUDA documentation site.

Announcement

CUDA Container Support Policy

CUDA image container tags have a lifetime. The tags will be deleted Six Months after the last supported "Tesla Recommended Driver" has gone end-of-life OR a newer update release has been made for the same CUDA version.

Please see CUDA Container Support Policy for more information.

Breaking changes are announced on Gitlab Issue #209.

Cuda Repo Signing Key has Changed!

This may present itself as the following errors.

debian:

Reading package lists... Done
W: GPG error: http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1604/x86_64  InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY A4B469963BF863CC
W: The repository 'http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1604/x86_64  InRelease' is not signed.
N: Data from such a repository can't be authenticated and is therefore potentially dangerous to use.
N: See apt-secure(8) manpage for repository creation and user configuration details.

RPM:

warning: /var/cache/dnf/cuda-fedora32-x86_64-d60aafcddb176bf5/packages/libnvjpeg-11-1-11.3.0.105-1.x86_64.rpm: Header V4 RSA/SHA512 Signature, key ID d42d0685: NOKEY
cuda-fedora32-x86_64                                                                                  23 kB/s | 1.6 kB     00:00
Importing GPG key 0x7FA2AF80:
 Userid     : "cudatools <cudatools@nvidia.com>"
 Fingerprint: AE09 FE4B BD22 3A84 B2CC FCE3 F60F 4B3D 7FA2 AF80
 From       : https://developer.download.nvidia.com/compute/cuda/repos/fedora32/x86_64/7fa2af80.pub
Is this ok [y/N]: y
Key imported successfully
Import of key(s) didn't help, wrong key(s)?
Public key for libnvjpeg-11-1-11.3.0.105-1.x86_64.rpm is not installed. Failing package is: libnvjpeg-11-1-11.3.0.105-1.x86_64
 GPG Keys are configured as: https://developer.download.nvidia.com/compute/cuda/repos/fedora32/x86_64/7fa2af80.pub
The downloaded packages were saved in cache until the next successful transaction.
You can remove cached packages by executing 'dnf clean packages'.
Error: GPG check FAILED

Updated images will be pushed out over the next few days containing the new repo key. Please follow progress using the links below:

• https://forums.developer.nvidia.com/t/notice-cuda-linux-repository-key-rotation/212771h
• https://gitlab.com/nvidia/container-images/cuda/-/issues/158

Multi-arch image manifests are now LIVE for all supported CUDA container image versions

It is now possible to build CUDA container images for all supported architectures using Docker Buildkit in one step. See the example script below.

The deprecated image names nvidia/cuda-arm64 and nvidia/cuda-ppc64le will remain available, but no longer supported.

The following product pages still exist but will no longer be supported:

• https://hub.docker.com/r/nvidia/cuda-ppc64le
• https://hub.docker.com/r/nvidia/cuda-arm64

The following gitlab repositories will be archived:

• https://gitlab.com/nvidia/container-images/cuda-ppc64le

Deprecated: "latest" tag

The "latest" tag for CUDA, CUDAGL, and OPENGL images has been deprecated on NGC and Docker Hub.

With the removal of the latest tag, the following use case will result in the "manifest unknown" error:

$ docker pull nvidia/cuda
Error response from daemon: manifest for nvidia/cuda:latest not found: manifest unknown: manifest
unknown

This is not a bug.

Overview of Images

Three flavors of images are provided:

• base: Includes the CUDA runtime (cudart)
• runtime: Builds on the base and includes the CUDA math libraries, and NCCL. A runtime image that also includes cuDNN is available.
• devel: Builds on the runtime and includes headers, development tools for building CUDA images. These images are particularly useful for multi-stage builds.

The Dockerfiles for the images are open-source and licensed under 3-clause BSD. For more information see the Supported Tags section below.

NVIDIA Container Toolkit

The NVIDIA Container Toolkit for Docker is required to run CUDA images.

For CUDA 10.0, nvidia-docker2 (v2.1.0) or greater is recommended. It is also recommended to use Docker 19.03.

How to report a problem

Read NVIDIA Container Toolkit Frequently Asked Questions to see if the problem has been encountered before.

After it has been determined the problem is not with the NVIDIA runtime, report an issue at the CUDA Container Image Issue Tracker.

Supported tags

Supported tags are updated to the latest CUDA and cuDNN versions. These tags are also periodically updated to fix CVE vulnerabilities.

For a full list of supported tags, click here.

LATEST CUDA 12.4.1

Visit OpenSource @ Nvidia for the GPL sources of the packages contained in the CUDA base image layers.

ubuntu22.04 [arm64, x86_64]

• 12.4.1-runtime-ubuntu22.04 (12.4.1/ubuntu2204/runtime/Dockerfile)
• 12.4.1-devel-ubuntu22.04 (12.4.1/ubuntu2204/devel/Dockerfile)
• 12.4.1-base-ubuntu22.04 (12.4.1/ubuntu2204/base/Dockerfile)

ubuntu20.04 [arm64, x86_64]

• 12.4.1-runtime-ubuntu20.04 (12.4.1/ubuntu2004/runtime/Dockerfile)
• 12.4.1-devel-ubuntu20.04 (12.4.1/ubuntu2004/devel/Dockerfile)
• 12.4.1-base-ubuntu20.04 (12.4.1/ubuntu2004/base/Dockerfile)

ubi9 [arm64, x86_64]

• 12.4.1-runtime-ubi9 (12.4.1/ubi9/runtime/Dockerfile)
• 12.4.1-devel-ubi9 (12.4.1/ubi9/devel/Dockerfile)
• 12.4.1-base-ubi9 (12.4.1/ubi9/base/Dockerfile)

ubi8 [arm64, ppc64le, x86_64]

• 12.4.1-runtime-ubi8 (12.4.1/ubi8/runtime/Dockerfile)
• 12.4.1-devel-ubi8 (12.4.1/ubi8/devel/Dockerfile)
• 12.4.1-base-ubi8 (12.4.1/ubi8/base/Dockerfile)

rockylinux9 [arm64, x86_64]

• 12.4.1-runtime-rockylinux9 (12.4.1/rockylinux9/runtime/Dockerfile)
• 12.4.1-devel-rockylinux9 (12.4.1/rockylinux9/devel/Dockerfile)
• 12.4.1-base-rockylinux9 (12.4.1/rockylinux9/base/Dockerfile)

rockylinux8 [arm64, x86_64]

• 12.4.1-runtime-rockylinux8 (12.4.1/rockylinux8/runtime/Dockerfile)
• 12.4.1-devel-rockylinux8 (12.4.1/rockylinux8/devel/Dockerfile)
• 12.4.1-base-rockylinux8 (12.4.1/rockylinux8/base/Dockerfile)

Unsupported tags

A list of tags that are no longer supported can be found here

Source of this description

This Readme is located in the doc directory of the CUDA Container Image source repository. (history)