ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
—
LipSync
Collection
—
LipSync

Collection of artifacts related to the NVIDIA AR SDK LipSync Effect

AI4M Restricted GA
NVIDIA AI Enterprise Supported
Subscribe to get accessSubscribe to the product below to access this premium content:
AI4M Restricted GA
AI4M Restricted GAJoin the AI4M Restricted GA program for access
Note: You can gain access to hundreds more GPU-optimized artifacts by creating a free NGC account.
Already Subscribed?Log in
Subscribe Now

LipSync

The LipSync collection contains the required components to run the NVIDIA AR SDK LipSync effect, which synchronizes lip movements in videos to match target audio containing human speech.

This collection is part of the NVIDIA Augmented Reality SDK.

This model is feature for commercial use. To try out this feature, you must join the Private Access Program. You may request access at Private Access Program.

Technical Details

For detailed model architecture, specifications, training information, and ethical considerations, please visit the LipSync Model Page.

Please note the model included in this feature is a foundation model, trained to work well across various languages. Language-specific fine-tuned models are also available; please contact us for more details.

Installation

To install the LipSync feature:

Download the Augmented Reality SDK Core

To download the SDK Core package:

  1. Navigate to the Augmented Reality SDK Core Resource
  2. Choose the appropriate version for your platform, either <version>_windows or <version>_linux
  3. Click Download to download the package

Install the Augmented Reality SDK Core and Features

To install the SDK Core and features, navigate to the AR SDK Documentation and follow the installation instructions for Windows or Linux.

To install the LipSync feature using the install_feature.ps1 or install_feature.sh script, use the feature name nvarlipsync.

Try It Out

To try out the LipSync feature, after downloading the SDK and feature, head over to the NVIDIA AR SDK Sample Apps GitHub repository to download and compile the sample applications that demonstrate the LipSync functionality.

Documentation

User Guide: AR SDK Documentation

Terms of Use

The use of NVIDIA LipSync is governed by the following agreements:

NIM Container

NVIDIA offers a ready-to-deploy NIM container for LipSync. To deploy the NIM container:

docker pull nvcr.io/nim/nvidia/lipsync:latest

For detailed deployment instructions, visit the NIM container page.

LipSync
Publisher
—
UpdatedJune 2, 2026 UTC
Labels
NSPECT-YRBX-TLRC