What Is Audio2Face-3D UCS Microservice?

The Audio2Face-3D UCS Microservice is a templatized Helm Chart to use with UCS Tools, allowing you to deploy Audio2Face-3D NIM.

The Audio2Face-3D NIM simplifies the deployment of the Audio2Face tuned models which are optimized for language understanding, reasoning, and text generation use cases, and outperforms many of the available open source chat models on common industry benchmarks. NVIDIA Audio2Emotion is embedded within Audio2Face, and it is designed to automatically recognize the emotions in human speech.

The Audio2Face-3D (A2F-3D) microservice is a key component of our facial animation technology stack, designed to process audio input and generate corresponding facial animations. In legacy mode, A2F-3D integrates both server and client functionalities using gRPC to seamlessly handle data streams within a larger pipeline. Audio2Face-3D NIM exposes the following gRPCs:

• Bidirectional Streaming gRPC or 2 Unidirectional Streaming endpoints for processing audio data and getting animation data.
• Unary gRPC for getting the current configuration of the microservice.

Getting Started

Please follow the Quick start guide for Prerequisites & dependencies

Refer to the Audio2Face Microservice documentation for more details.

Compatible Infrastructure Software Versions

OS      : Ubuntu 22.04 (bare-metal or with WSL)
CUDA    : 12.6
Driver  : 535.183.06 (for Data Center GPUs), 560.35.03 (for RTX GPUs) and 560.94 (for Windows WSL)
NVIDIA Container Toolkit : latest version
Docker	: latest version

NOTE: Any Linux distribution should work but has not been tested by our teams. Your Docker environment must support NVIDIA GPUs. Please refer to the NVIDIA Container Toolkit for more information. Security Vulnerabilities in OSS packages

Please review the Security Scanning tab to view the latest security scan results. For certain open-source vulnerabilities listed in the scan results, NVIDIA provides a response in the form of a Vulnerability Exploitability eXchange (VEX) document. The VEX information can be reviewed and downloaded from the Security Scanning Security Scanning tab.

Getting Help

Enterprise Support Get access to knowledge base articles and support cases or submit a ticket: https://www.nvidia.com/en-us/data-center/products/ai-enterprise-suite/support/

Governing Terms

This software is governed by the NVIDIA Software License Agreement and Product Specific Terms for AI Products. Use of the models is governed by the NVIDIA Community Model License.

You are responsible for ensuring that your use of NVIDIA AI Foundation Models complies with all applicable laws.