NVIDIA DeepStream SDK

NVIDIA’s DeepStream SDK is a multi-sensor AI-based streaming analytics toolkit for video, image, and audio understanding. DeepStream is an integral part of NVIDIA Metropolis, the platform for building end-to-end services and solutions that transform real-time pixels and sensor data into actionable insights. DeepStream SDK features hardware-accelerated building blocks, called plugins, which bring deep neural networks and other complex processing tasks into a processing pipeline. The DeepStream SDK allows you to focus on building optimized Vision AI applications without having to design complete solutions from scratch.

The DeepStream SDK uses AI to perceive pixels and generate metadata while offering integration from the edge-to-the-cloud. The DeepStream SDK can be used to build applications across various use cases including retail analytics, patient monitoring in healthcare facilities, parking management, optical inspection (AOI), supply chain management (logistics), operations and manufacturing.

* NOTE: Deepstream-l4t container NGC repo will not be updated in future DeepStream releases; though old releases will remain accessible to the users.

Starting with the next DS release, the DeepStream container NGC repo will be the official repo for all containers (Jetson and dGPU).

What is in the NVIDIA DeepStream SDK Collection

NVIDIA NGC offers collections that easily group relevant information together. We have created the NVIDIA DeepStream SDK collection, so it is easy to find all the information in a single place.

• DeepStream x86 containers: Containers for Enterprise Grade GPUs. DeepStream is part of NVIDIA AI Enterprise Production Branches.

• DeepStream Jetson containers: Containers for Thor based systems.

• DeepStream ARM SBSA and Spark container container: Container for ARM SBSA based systems. ARM SBSA and Spark containers are now unified

• DeepStream Debian Installers: For both x86 and Jetson (ARM) based platforms. These assets are now available under the resource page of NGC. 

• DeepStream Libraries: For x86 only. These assets allow you to install the DeepStream Libraries from a single python wheel.

• TAO Pretrained Models Supported: Details on how to run these models with DeepStream are available in the new Inference Builder GitHub repo, the legacy DeepStream-TAO GitHub repo or the DeepStream documentation.

* NOTE: GXF and Graph Composer are deprecated with DeepStream 9.0.

We have consolidated the DeepStream containers as follows:

td, th { text-align: left; }

NOTE: Some DeepStream dockerfiles are available on GitHub for easy customization.

DeepStream SDK 9.0 Release

For a full list of new features and changes, and known limitations please refer to the DeepStream 9.0 Release Notes.

Key New Features and Enhancements available in DeepStream 9.0:

Documentation

Supported Hardware and Software Dependencies

---

Note:

If you are looking for older versions of DeepStream, please refer to the x86 or Jetson archive. Archived documentation is available here.

Technical Support

DeepStream Support is available via:

Known Limitations

There are known bugs and limitations in the SDK. To learn more about those, refer to the release notes.

License

The following licenses apply to the DeepStream SDK assets:

NOTE: By pulling, downloading, or using the DeepStream SDK, you accept the terms and conditions of the EULA licenses listed above:

Ethical AI

NVIDIA’s platforms and application frameworks enable developers to build a wide array of AI applications. Consider potential algorithmic bias when choosing or creating the models being deployed. Work with the model’s developer to ensure that it meets the requirements for the relevant industry and use case; that the necessary instruction and documentation are provided to understand error rates, confidence intervals, and results; and that the model is being used under the conditions and in the manner intended.