NVIDIA Holoscan

NVIDIA Holoscan

NVIDIA Holoscan is the AI sensor processing platform that combines hardware systems for low-latency sensor and network connectivity, optimized libraries for data processing and AI, and core microservices to run streaming, imaging, and other applications, from embedded to edge to cloud. It can be used to build streaming AI pipelines for a variety of domains, including Medical Devices, High Performance Computing at the Edge, Industrial Inspection and more.

In previous releases, the prefix Clara was used to define Holoscan as a platform designed initially for medical devices. As Holoscan has grown, its potential to serve other areas has become apparent. With version 0.4.0, we're proud to announce that the Holoscan SDK is now officially built to be domain-agnostic and can be used to build sensor AI applications in multiple domains. Note that some of the content of the SDK (sample applications) or the documentation might still appear to be healthcare-specific pending additional updates. Going forward, domain specific content will be hosted on the HoloHub repository.

Visit the NGC demo website for a live demonstration of some of Holoscan capabilities.

What's in this collection

• Holoscan: this container image includes the Holoscan libraries, GXF extensions, headers, example source code, and sample datasets. It is the simplest way to run sample streaming applications or create your own application using Holoscan.
• Holoscan OpenEmbedded Builder: this container image contains runtime dependencies, scripts, and the NVIDIA-proprietary binary packages that are required to build an OpenEmbedded BSP image for NVIDIA Holoscan Developer Kits
• Sample Application Data: the following AI models and video source datasets are included in the Holoscan container and automatically fetched when building from source:
  • Sample App Data for AI-based Endoscopy Tool Tracking
  • Sample App Data for AI-based Bone Scoliosis Segmentation
  • Sample App Data for AI Colonoscopy Segmentation of Polyps
  • Sample App Data for Multi-AI Ultrasound Pipeline
• GXF development packages (arm64, x86_64): GXF is used as a backend to define the graph components, connect them, and execute the applications (see the User Guide for more details). The development packages are included in the Holoscan container and automatically fetched when building from source.