NVIDIA Holoscan for Media

NVIDIA Holoscan for Media is the most advanced AI platform for live media, allowing live video pipelines to run on AI infrastructure. It revolutionizes application development for this rapidly evolving market by enabling NVIDIA-accelerated container orchestration for multi-vendor live production and AI. Developers can take advantage of templates and reference services for building and deploying applications.

What's Included

This collection and the associated user guide provide Holoscan for Media install files and the information needed to use them. Together, they include automation scripts, reference applications (Helm charts and containers), and links to NVIDIA SDKs and application frameworks used with the platform.

See what's new in the latest Release Notes.

Getting Started

Install Files

The platform setup guide explains the different installation options for the Holoscan for Media platform and includes step-by-step instructions based on your needs.

These instructions make use of the following NGC resources:

• Platform Setup – Ansible playbooks to install and configure a Red Hat OpenShift compact cluster for Holoscan for Media in production.
• Local Developer Setup – Ansible playbooks to install and configure Kubernetes for Holoscan for Media application developers using NVIDIA Cloud Native Stack.

Prerequisites

The user guide covers system requirements and the specific prerequisites for the Local Developer and Production setups.

Reference Applications

The user guide provides comprehensive instructions for deploying reference applications on the platform.

These instructions make use of the following NGC resources.

Platform Tools

• Helm Dashboard – Helm Dashboard is an open-source project which offers a UI-driven way to view, manage and install Helm charts. The Helm Dashboard container is also on NGC.
• Chrome Remote Desktop - Set up remote access to a desktop environment running on the cluster.

NMOS Tools

• NMOS Registry – This Helm chart installs a containerized implementation of an AMWA Networked Media Open Specifications (NMOS) Registry, with a JavaScript-based NMOS Client/Controller and an embedded NMOS Virtual Node. The NMOS Registry container is also on NGC.
• NMOS Controller – This Helm chart installs a browser-based application that uses NMOS APIs to discover, connect and manage resources within a networked media system. The NMOS Controller container is also on NGC.

Media Gateway

• Media Gateway – Media Gateway is a reference application for Holoscan for Media, built on DeepStream. It provides NMOS registration and control of ST 2110 sinks and sources in a flexible GStreamer pipeline passed to the container. The Media Gateway container is also on NGC and the source code can be downloaded from the associated Media Gateway resource.

Platform Verification

The user guide describes how to use the verification tool to validate cluster readiness and assess key performance characteristics of the Holoscan for Media platform.

It can be downloaded from the associated Verification Tool resource on NGC.

Platform Monitoring

The user guide provides instructions for enabling monitoring and installing dashboards for GPU, SR-IOV network, PTP, and NMOS Registry metrics.

These instructions make use of the following NGC resources:

• PTP Monitoring - Set up PTP Monitoring dashboards.
• SR-IOV Network Monitoring - Set up SR-IOV Network Monitoring dashboards.

Application Development

The user guide includes information about application development, including key software technologies, debugging, testing, and packaging.

Troubleshooting and Getting Help

The user guide includes troubleshooting sections and additional information to help with the core concepts, tools, and SDKs used with Holoscan for Media.

License

By downloading and using this software, you accept the terms and conditions of the NVIDIA AI Product Agreement.

Release Notes

Release 25.9

Release notes for Release 25.9

	Release Notes
Documentation	Holoscan for Media user guide
Automation	Production setup updated to OpenShift 4.18 and local developer setup updated to Cloud Native Stack v25.7 Automated OpenShift installation on more servers (Lenovo and Dell) Automated installation and configuration of standard (5+ nodes) clusters as well as compact (3 nodes) and single node clusters Automated installation of additional services, including monitoring stack and GPU time slicing
Reference Applications	Media Gateway updated to DeepStream 8.0 with open-sourced nvdsudpsrc and nvdsudpsink newly supporting RTP timestamp read/write/passthrough and ST 2022-7
Verification Tool	Validate platform hardware and software configuration Create an archive to be shared with NVIDIA for troubleshooting

Known issues for Release 25.9

	Known Issue
5653416	PTP domain number is hard-coded as 127 in the production automation.
5491941	Media Gateway does not re-register with an NMOS Registry through a redundant interface after a failure with the primary interface.
5597128	Media Gateway sometimes does not play after re-establishing connections of both video and audio receivers.

Release 25.4

Announcement: Supercharging Live Media Workflows with NVIDIA NIM and NVIDIA Holoscan for Media

Release notes for Release 25.4

	Release Notes
Reference Applications	AI Virtual Cameras from ST 2110 video using a person detection model, DeepStream and Rivermax, in Python Automatic Speech Recognition on ST 2110 audio using Riva ASR NIM, DeepStream and Rivermax, in Python Media Gateway updated to DeepStream 7.1
Monitoring Stack	Monitoring additions for production (OpenShift) and local developer setup (Cloud Native Stack) Grafana Dashboards for SR-IOV Network and PTP Vector sidecar-based integration for NMOS Registry reference application with application-specific Grafana Dashboard
Automation	Automated Single Node OpenShift installation as well as compact (3-node) clusters Automated configuration of more networking variants and red/blue networking for ST 2022-7 redundancy Improved and simplified automation for Local Developer Setup, now supporting Ubuntu 24.04 Automated installation of reference applications (Helm Dashboard, NMOS Registry, NMOS Controller, Media Gateway, etc.)

Production-Ready Platform Release

Announcement:

• Live Media Reimagined: NVIDIA Holoscan for Media Now Available for Production
• Transform Live Media Pipelines with NVIDIA Holoscan for Media

Release notes for Limited Availability release (September 2024)

	Release Notes
Platform	Updated to OpenShift 4.14 Extended Update Support release Supports Single Node OpenShift for standalone server deployment Updated to Network Operator 24.7 for fast reboot Adjusts recommended network configuration to enable hardware offload for ST 2022-7 redundancy Adds NUMA-aware scheduling and node tuning for high stream density
Developer experience	Includes new Local Developer Setup guide for Kubernetes and updated guide for Docker Simplifies deployment and integration of Rivermax SDK and license Includes new AI and integration code samples, provided on request

Expanded Developer Availability Release

Announcement: Next-Generation Live Media Apps on Repurposable Clusters with NVIDIA Holoscan for Media

Release notes for expanded Developer Availability release (April 2024)

	Release Notes
Platform	The platform reference deployment guide now covers the deployment of additional Kubernetes services including persistent block and file storage (Longhorn), load balancer (MetalLB), and service mesh (Istio)
Reference applications	All Holoscan for Media containers are now built on a consistent Ubuntu 22.04 base image
Open source	Source code is now available for the Media Gateway Next container in the associated Media Gateway Next resource

Early Access Update 2

Announcement: Next-Generation Live Media Apps on Repurposable Clusters with NVIDIA Holoscan for Media

Release notes for Early Access Update 2 (March 2024)

	Release Notes
Platform refresh	Holoscan for Media is now based on Red Hat OpenShift 4.13 This includes fixes, features and enhancements, and enables access to updated drivers
Platform automation	Automation has been extended, so that after automated installation, a second Ansible playbook can fully configure the cluster for Holoscan for Media This applies the required Performance Profile, and installs and configures the NVIDIA Network Operator, GPU Operator, SR-IOV Network Operator and PTP Operator, among others
Developer experience	A new Helm chart supports easy deployment of Chrome Remote Desktop pods to aid application testing The Media Gateway Next container is now multi-architecture and is built on the DeepStream 6.4 (Ubuntu 22.04) base image, bringing new NVIDIA and GStreamer features The NMOS Registry container has been updated to the latest sony/nmos-cpp release The Local Developer Setup guide and other documentation have been expanded

Early Access Update 1

Announcement: Streamline Live Media Application Development with New Features in NVIDIA Holoscan for Media

Release notes for Early Access Update 1 (January 2024)

	Release Notes
New Helm Dashboard functionality	Helm Dashboard container and Helm chart Simple UI for application deployment onto a Holoscan for Media cluster, no need for CLI Demonstrates the "open app store" concept Works with NGC and other helm chart/container repositories
New automation for OpenShift cluster installation	Ansible playbook to deploy a cluster from bare metal using Redfish and OpenShift Assisted Installer APIs
New highly-configurable Media Gateway Next reference container	Media Gateway Next container and Helm chart Run any GStreamer pipeline with ST 2110/NMOS integration Examples of pipelines for video and audio test sources and sinks Extend the examples with GStreamer elements by simply changing the pipeline description (e.g. using Helm Dashboard)
Updated Platform Reference Deployment Guide	More detailed steps for installation and operator configuration
New Local Developer Setup guide	Get all the Holoscan for Media containerized applications running on a single Linux host* with ConnectX network adapter NMOS Registry, NMOS Controller and multiple Media Gateway containers, can all be run side-by-side
New Developer Starting Guide	Describes the building blocks of Holoscan For Media, covers the recommended NVIDIA SDKs to boost your application development, and includes useful links to get you started