Face Mesh

The Face Mesh collection contains the required components to run the Maxine AR SDK Face Mesh effect, also known as Face 3D Reconstruction, which reconstructs a 3D face mesh from 2D facial landmarks for face tracking applications.

This feature is ready for commercial use.

Technical Details

For detailed model architecture, specifications, training information, and ethical considerations, please visit the Face Mesh Model Page. To find the model page, click on the Artifacts tab above, and then click on Face Mesh under the "Model" section.

Installation

SDK

To install the Face Mesh feature:

1. Download and set up the AR SDK Core for your operating system. To find the Core SDK, click on the Artifacts tab above, and then click on Maxine Augmented Reality SDK Core under the "Resource" section.

   • For Linux: Choose the tag <Version>_linux (example: 1.0.0.0_linux)
   • For Windows: Choose the tag <Version>_windows (example: 1.0.0.0_windows)

   Follow the instructions on the SDK collection page to set up the SDK.

2. Install the Face Mesh feature, also known as Face 3D Reconstruction, using the appropriate script:

   For Windows:

   cd <ARSDK_root>\features
   .\install_feature.ps1 -gpu <gpu_compute_capability> -features nvarface3dreconstruction -version <version>
   

   Example for an Ada GPU such as RTX 4090, which has GPU architecture sm_89 / CUDA Compute Capability 8.9:

   .\install_feature.ps1 -gpu 89 -features nvarface3dreconstruction -version 1.0.0.0
   

   For Linux:

   cd /usr/local/ARSDK/features
   ./install_feature.sh -f nvarface3dreconstruction -v <version>
   

   Example:

   ./install_feature.sh -f nvarface3dreconstruction -v 1.0.0.0
   

   Notes:

   • Windows: GPU parameter is required (e.g., 75, 86, 89, 120). See NVIDIA CUDA GPUs for your GPU's compute capability.
   • Linux: GPU is auto-detected, or use -g <gpu_type> (e.g., a100, t4, h100)
   • Replace <version> with your SDK version (default: 1.0.0.0)

The installation script will:

• Download the Face Mesh feature libraries from NGC
• Download the appropriate TensorRT models (if any) for your GPU architecture
• Install them into the SDK's features directory

Try It Out

To try out the Face Mesh feature, after downloading the SDK and feature, head over to the NVIDIA Maxine AR SDK Sample Apps GitHub repository to download and compile the sample applications that demonstrate the Face Mesh functionality. This is demonstrated as part of the FaceTrackApp.

Documentation

User Guide: AR SDK Documentation

Terms of Use

The use of NVIDIA Maxine's Face Mesh is governed by the following agreements:

• NVIDIA Software License Agreement
• Product Specific Terms for NVIDIA AI Products