Eye Contact

The Eye Contact collection contains the required components to run the NVIDIA AR SDK Eye Contact effect. Eye Contact, also known as Gaze Redirection, estimates the gaze angles of a person in an image or video and redirects the gaze to make it frontal. It can operate in two modes: one mode where head pose and gaze angles are estimated in camera coordinates without any redirection, and another where the eyes of the person are redirected to make eye contact with the camera within a permissible range.

This collection is part of the NVIDIA Augmented Reality SDK.

This feature is ready for commercial use.

Technical Details

For detailed model architecture, specifications, training information, and ethical considerations, please visit the Eye Contact Model Page.

Installation

To install the Eye Contact feature:

Download the Augmented Reality SDK Core

To download the SDK Core package:

1. Navigate to the Augmented Reality SDK Core Resource
2. Choose the appropriate version for your platform, either <version>_windows or <version>_linux
3. Click Download to download the package

Install the Augmented Reality SDK Core and Features

To install the SDK Core and features, navigate to the AR SDK Documentation and follow the installation instructions for Windows or Linux.

To install the Eye Contact feature using the install_feature.ps1 or install_feature.sh script, use the feature name nvargazeredirection.

Try It Out

To try out the Eye Contact feature, after downloading the SDK and feature, head over to the NVIDIA AR SDK Sample Apps GitHub repository to download and compile the sample applications that demonstrate the Eye Contact functionality. The Eye Contact feature is demonstrated by the GazeRedirectionApp.

Documentation

User Guide: AR SDK Documentation

Terms of Use

The use of NVIDIA Eye Contact is governed by the following agreements:

• NVIDIA Software License Agreement
• Product Specific Terms for NVIDIA AI Products
• NVIDIA Community Model License

NIM Container

NVIDIA offers a ready-to-deploy NIM container for Eye Contact/Gaze Redirection:

Eye Contact NIM

The Eye Contact NIM leverages state-of-the-art AI models to dynamically redirect a user's eye position towards the camera in real-time to simulate natural eye contact and enhance remote digital engagement.

To deploy the NIM container:

docker pull nvcr.io/nim/nvidia/maxine-eye-contact:latest

For detailed deployment instructions, visit the NIM container page.