Collection of artifacts related to the Maxine AR SDK Frame Selection Effect
Frame Selection
The Frame Selection collection contains the required components to run the Maxine AR SDK Frame Selection effect, which automatically selects the best frames from video sequences for optimal processing. It is used for driving video calibration and to find a neutral frame required by the Video Live Portrait feature of the AR SDK.
This feature is ready for commercial use.
Technical Details
For detailed model architecture, specifications, training information, and ethical considerations, please visit the Frame Selection Model Page. To find the model page, click on the Artifacts tab above, and then click on Frame Selection under the "Model" section.
Installation
SDK
To install the Frame Selection feature:
-
Download and set up the AR SDK Core for your operating system. To find the Core SDK, click on the Artifacts tab above, and then click on Maxine Augmented Reality SDK Core under the "Resource" section.
- For Linux: Choose the tag
<Version>_linux(example:1.0.0.0_linux) - For Windows: Choose the tag
<Version>_windows(example:1.0.0.0_windows)
Follow the instructions on the SDK collection page to set up the SDK.
- For Linux: Choose the tag
-
Install the Frame Selection feature using the appropriate script:
For Windows:
cd <ARSDK_root>\features .\install_feature.ps1 -gpu <gpu_compute_capability> -features nvarframeselection -version <version>Example for an Ada GPU such as RTX 4090, which has GPU architecture sm_89 / CUDA Compute Capability 8.9:
.\install_feature.ps1 -gpu 89 -features nvarframeselection -version 1.0.0.0For Linux:
cd /usr/local/ARSDK/features ./install_feature.sh -f nvarframeselection -v <version>Example:
./install_feature.sh -f nvarframeselection -v 1.0.0.0Notes:
- Windows: GPU parameter is required (e.g., 75, 86, 89, 120). See NVIDIA CUDA GPUs for your GPU's compute capability.
- Linux: GPU is auto-detected, or use
-g <gpu_type>(e.g., a100, t4, h100) - Replace
<version>with your SDK version (default: 1.0.0.0)
The installation script will:
- Download the Frame Selection feature libraries from NGC
- Download the appropriate TensorRT models (if any) for your GPU architecture
- Install them into the SDK's features directory
Try It Out
To try out the Frame Selection feature, after downloading the SDK and feature, head over to the NVIDIA Maxine AR SDK Sample Apps GitHub repository to download and compile the sample applications that demonstrate the Frame Selection functionality. There is no standalone sample application for frame selection feature; it is demonstrated within the LivePortraitApp.
Documentation
User Guide: AR SDK Documentation
Terms of Use
The use of NVIDIA Maxine's Frame Selection is governed by the following agreements:
