Overview

Nemotron Voice Agent provides a comprehensive, end-to-end voice agent blueprint built with NVIDIA Nemotron state-of-the-art open models, as NVIDIA NIM for acceleration and scaling. It is designed to guide developers through the creation of a cascaded pipeline, integrating Nemotron ASR, LLM, and TTS, while solving for the complexities of streaming, interruptible conversations.

This is the pipeline container used as part of the NVIDIA AI Blueprint for Nemotron Voice Agent and used to orchestrate the end-to-end voice pipeline (ASR, LLM, TTS) with WebRTC/WebSocket transport.

Source Code

Documentation and source code regarding how to get started can be found here.

Ethical Considerations

NVIDIA believes Trustworthy AI is a shared responsibility, and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their supporting model team to ensure the models meet requirements for the relevant industry and use case and address unforeseen product misuse. For more detailed information on ethical considerations for the models, please see the Model Card++ Explainability, Bias, Safety & Security, and Privacy Subcards. Please report security vulnerabilities or NVIDIA AI concerns here.

License

This NVIDIA AI Blueprint is governed by the BSD 2-Clause license, and enable the use of separate open source and proprietary software governed by their respective licenses: NVIDIA Community Model License Agreement, NVIDIA Nemotron Open Model License Agreement, NVIDIA Open Model License, Llama 3.3 Community License Agreement, BSD 2-Clause License.