Chat Engine Microservice drives the conversation flow for bots built using ACE Agent
What Is ACE Agent?
NVIDIA ACE Agent is a GPU-accelerated SDK for building conversational AI agents or bots that are powered by LLMs, customized for your use case and deliver real-time performance. It offers a complete workflow to build and deploy virtual agents that can support multi-turn and multi-user contextual conversation flow. It provides connectivity between AI skills like NVIDIA Riva Speech AI, NVIDIA ACE Avatar AI & Vision AI, use case specific custom plugins, and user interfaces through efficient system integration and composable dialog management.
ACE Agent Chat Engine
Chat Engine is the key component of the NVIDIA ACE Agent which drives the conversation pipeline. It interacts with other components in the ACE Agent ecosystem to formulate a textual response for the user query. It is responsible for maintaining user context and conversational history.
The Chat Engine is based on the NVIDIA NeMo Guardrails with architecture described here. You can design conversational flow using Colang which is an event-based dialog modeling language to enable the design of highly flexible conversational interactions between a human and a bot. Since learning a new language is not an easy task, Colang was designed as a mix of natural language and Python. Under the hood, Colang scripts are interpreted by a Python runtime that is currently part of NeMo Guardrails (0.8.1)
Getting started with ACE Agent
Follow the NVIDIA ACE Agent documentation for getting started.
Compatible Infrastructure Software Versions
For optimal performance, deploy the supported NVIDIA AI Enterprise Infrastructure software with this NIM.
Get Help
Enterprise Support
Get access to knowledge base articles and support cases or submit a ticket.
NVIDIA AI Enterprise Documentation
Visit the NVIDIA AI Enterprise Documentation Hub for release documentation, deployment guides and more.
NVIDIA Licensing Portal
Go to the NVIDIA Licensing Portal to manage your software licenses. licensing portal for your products. Get Your Licenses
License
This chart is licensed under the NVIDIA AI Product Agreement. By pulling and using this chart, you accept the terms and conditions of this license.