What Is Audio2Face-3D NIM Helm Chart?
The Audio2Face-3D NIM Helm Chart allows you to deploy Audio2Face-3D NIM.
The Audio2Face-3D NIM simplifies the deployment of the Audio2Face tuned models which are optimized for language understanding, reasoning, and text generation use cases, and outperforms many of the available open source chat models on common industry benchmarks. NVIDIA Audio2Emotion is embedded within Audio2Face, and it is designed to automatically recognize the emotions in human speech.
The Audio2Face-3D (A2F-3D) microservice is a key component of our facial animation technology stack, designed to process audio input and generate corresponding facial animations. In legacy mode, A2F-3D integrates both server and client functionalities using gRPC to seamlessly handle data streams within a larger pipeline. Audio2Face-3D NIM exposes the following gRPCs:
- Bidirectional Streaming gRPC or 2 Unidirectional Streaming endpoints for processing audio data and getting animation data.
- Unary gRPC for getting the current configuration of the microservice.
Getting Started
Please follow the Quick start guide for Prerequisites & dependencies
Refer to the Audio2Face Microservice documentation for more details.
Compatible Infrastructure Software Versions
OS : Ubuntu 22.04 (bare-metal or with WSL)
CUDA : 12.6
Driver : 535.183.06 (for Data Center GPUs), 560.35.03 (for RTX GPUs) and 560.94 (for Windows WSL)
NVIDIA Container Toolkit : latest version
Docker : latest version
NOTE: Any Linux distribution should work but has not been tested by our teams. Your Docker environment must support NVIDIA GPUs. Please refer to the NVIDIA Container Toolkit for more information. Security Vulnerabilities in OSS packages
Please review the Security Scanning tab to view the latest security scan results. For certain open-source vulnerabilities listed in the scan results, NVIDIA provides a response in the form of a Vulnerability Exploitability eXchange (VEX) document. The VEX information can be reviewed and downloaded from the Security Scanning Security Scanning tab.
Usage Restrictions
You may not use the Software or any of its components for the purpose of emotion recognition. Any technology included in the Software may only be used as fully integrated in the Software and consistent with all applicable documentation.
License/Terms of Use:
GOVERNING TERMS: Use of this software is governed by the NVIDIA Software License Agreement and Product-Specific Terms for NVIDIA AI Products. Use of the Audio2Face models is governed by the NVIDIA Open Model License. Use of the Audio2Emotion model is governed by the License Agreement for NVIDIA Audio2Emotion Model for Use with Audio2Face Project.
AUDIO2EMOTION MODEL NOTICE: This model and any technology included with this model may only be used in connection with the NVIDIA Audio2Face project consistent with all applicable documentation. You may not use this model and any technology included with it outside of the Audio2Face project. You may not use this model or any of its components for the purpose of emotion recognition.
NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their supporting model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.
For more detailed information on ethical considerations for this model, please see the Model Card++ Explainability, Bias, Safety & Security, and Privacy Subcards. Please report security vulnerabilities or NVIDIA AI Concerns here.
You are responsible for ensuring that your use of NVIDIA provided models complies with all applicable laws.