NVIDIA Holoscan

NVIDIA Holoscan

NVIDIA Holoscan is the AI sensor processing platform that combines hardware systems for low-latency sensor and network connectivity, optimized libraries for data processing and AI, and core microservices to run streaming, imaging, and other applications, from embedded to edge to cloud. It can be used to build streaming AI pipelines for a variety of domains, including Medical Devices, High Performance Computing at the Edge, Industrial Inspection and more.

In releases prior to version 0.4.0, the prefix Clara was used to define Holoscan as a platform designed initially for medical devices. As Holoscan has grown, its potential to serve other areas has become apparent. Starting with version 0.4.0, we're proud to announce that the Holoscan SDK is now officially built to be domain-agnostic and can be used to build sensor AI applications in multiple domains. Note that some of the content of the SDK (sample applications) or the documentation might still appear to be healthcare-specific pending additional updates. Going forward, domain specific content will be hosted on the HoloHub repository.

Visit the NGC demo website for a live demonstration of some of Holoscan capabilities.

What's in this collection

• Holoscan Container: this container image includes the Holoscan libraries, GXF extensions, headers, example source code, and sample datasets, as well as all the dependencies that were tested with Holoscan. It is the recommended way to run the Holoscan examples, while still allowing you to create your own C++ and Python Holoscan application.
• Holoscan Debian package: includes the libraries, headers, example applications and CMake configurations needed for both C++ and Python developers. It does not include sample datasets.
• Holoscan OpenEmbedded Builder: this container image contains runtime dependencies, scripts, and the NVIDIA-proprietary binary packages that are required to build an OpenEmbedded BSP image for NVIDIA Holoscan Developer Kits
• L4T Compute Assist: this container image allows running compute-only applications using CUDA and TensorRT on the integrated GPU (iGPU) of the NVIDIA Holoscan Developer Kits while other applications can run on a discrete GPU (dGPU), natively or in another container.
• Application Data: the following AI models and video datasets have been packaged for use with Holoscan:
  • Sample Data for AI-based Endoscopy Tool Tracking
  • Sample App Data for AI-based Bone Scoliosis Segmentation
  • Sample Data for AI Colonoscopy Segmentation of Polyps
  • Sample Data for Multi-AI Ultrasound Pipeline
  • Sample Data for AI Endoscopy Out of Body Detection
  • Sample Data for AI Endoscopy Depth Estimation