Video Live Portrait

The Video Live Portrait collection contains the required components to run the Maxine AR SDK Video Live Portrait effect, which animates still portrait images to create realistic video sequences.

This feature is ready for commercial use.

Technical Details

For detailed model architecture, specifications, training information, and ethical considerations, please visit the Video Live Portrait Model Page. To find the model page, click on the Artifacts tab above, and then click on Video Live Portrait under the "Model" section.

Installation

SDK

To install the Video Live Portrait feature:

1. Download and set up the AR SDK Core for your operating system. To find the Core SDK, click on the Artifacts tab above, and then click on Maxine Augmented Reality SDK Core under the "Resource" section.

   • For Linux: Choose the tag <Version>_linux (example: 1.0.0.0_linux)
   • For Windows: Choose the tag <Version>_windows (example: 1.0.0.0_windows)

   Follow the instructions on the SDK collection page to set up the SDK.

2. Install the Video Live Portrait feature using the appropriate script:

   For Windows:

   cd <ARSDK_root>\features
   .\install_feature.ps1 -gpu <gpu_compute_capability> -features nvarliveportrait -version <version>
   

   Example for an Ada GPU such as RTX 4090, which has GPU architecture sm_89 / CUDA Compute Capability 8.9:

   .\install_feature.ps1 -gpu 89 -features nvarliveportrait -version 1.0.0.0
   

   For Linux:

   cd /usr/local/ARSDK/features
   ./install_feature.sh -f nvarliveportrait -v <version>
   

   Example:

   ./install_feature.sh -f nvarliveportrait -v 1.0.0.0
   

   Notes:

   • Windows: GPU parameter is required (e.g., 75, 86, 89, 120). See NVIDIA CUDA GPUs for your GPU's compute capability.
   • Linux: GPU is auto-detected, or use -g <gpu_type> (e.g., a100, t4, h100)
   • Replace <version> with your SDK version (default: 1.0.0.0)

The installation script will:

• Download the Video Live Portrait feature libraries from NGC
• Download the appropriate TensorRT models for your GPU architecture
• Install them into the SDK's features directory

Try It Out

To try out the Video Live Portrait feature, after downloading the SDK and feature, head over to the NVIDIA Maxine AR SDK Sample Apps GitHub repository to download and compile the sample applications that demonstrate the Video Live Portrait functionality. This is demonstrated by the LivePortraitApp, and if using triton, the VideoLivePortraitTritonClientApp.

Documentation

User Guide: AR SDK Documentation

Terms of Use

The use of NVIDIA Maxine's Video Live Portrait is governed by the following agreements:

• NVIDIA Software License Agreement
• Product Specific Terms for NVIDIA AI Products
• NVIDIA Community Model License