The NVIDIA Intelligent Camera Tracker (ICT) system analyzes a primary video stream to identify and monitor each individual, subsequently generating a distinct, personalized camera output feed for every detected person. Initially, selective cropping is applied to maintain the tracked person in a central focus. Following this, a robust stabilization algorithm is employed to mitigate jitteriness and camera movement, thereby producing a smooth, professional feed. Finally, the system upscales the processed video utilizing NVIDIA’s RTX Video Super Resolution to ensure the preservation of high fidelity. Furthermore, ICT also provides an option for virtual background feature, enabling the replacement of the physical environment with a solid background color.
The processing pipeline incorporates various NVIDIA's AI for Media components to enhance real-time performance.

This solution is now available on Holoscan for Media platform. Holoscan for Media eases the integration of AI into application development due to its underlying architecture, which enables software-defined video to be deployed on the same software stack as AI applications, including generative AI-based tools. This benefits vendors and research and development departments looking to incorporate AI apps into live video.

NVIDIA's ICT serves as an example of an AI application readily available for integration into the broadcasting pipeline.

Usage Guide

Please refer the NVIDIA Intelligent Camera Tracker - Usage Guide for more details

Package

• NVIDIA ICT Service Container
• NVIDIA ICT Sample Container (Sender)
• NVIDIA ICT Sample Container (Receiver)
• NVIDIA ICT Service Helm Chart
• NVIDIA ICT Sample Helm Chart
• NVIDIA ICT Usage Guide
• NVIDIA Maxine Sample Data License

License

• Use of the software and models is governed by the NVIDIA Software and Model Evaluation License .
• Use of the sample data is governed by the NVIDIA Maxine Sample Data License.