Linux / amd64
NVIDIA ACE Agent is a GPU-accelerated SDK for building conversational AI agents or bots that are powered by LLMs, customized for your use case and deliver real-time performance. It offers a complete workflow to build and deploy virtual agents that can support multi-turn and multi-user contextual conversation flow. It provides connectivity between AI skills like NVIDIA Riva Speech AI, NVIDIA ACE Avatar AI & Vision AI, use case specific custom plugins, and user interfaces through efficient system integration and composable dialog management.
ACE Agent Plugin server allows us to add use case or domain specific business logic in the bots. The Plugin server is a FastAPI-based server that enables ACE Agent microservices to interact with custom business logic using a REST interface. It exposes a Swagger endpoint, which allows developers to easily write and validate plugins in a sandbox environment.
The Plugin server also allows developer to integrate a custom agent built using LangChain or LlamaIndex or any other framework with a simple interface and allows to add Speech AI and Avatar AI using ACE microservices.
Follow the NVIDIA ACE Agent documentation for getting started.
For optimal performance, deploy the supported NVIDIA AI Enterprise Infrastructure software with this NIM.
Please review the Security Scanning tab to view the latest security scan results.
For certain open-source vulnerabilities listed in the scan results, NVIDIA provides a response in the form of a Vulnerability Exploitability eXchange (VEX) document. The VEX information can be reviewed and downloaded from the Security Scanning tab.
Get access to knowledge base articles and support cases or submit a ticket.
Visit the NVIDIA AI Enterprise Documentation Hub for release documentation, deployment guides and more.
Go to the NVIDIA Licensing Portal to manage your software licenses. licensing portal for your products. Get Your Licenses
This container is licensed under the NVIDIA AI Product Agreement. By pulling and using this container, you accept the terms and conditions of this license.
You are responsible for ensuring that your use of NVIDIA AI Foundation Models complies with all applicable laws.