NeMo Guardrails Microservice Container

NeMo Guardrails microservice performs safety checks and moderates responses from LLMs to improve the safety, security, and trustworthiness of any LLM-based application.

You can configure the NeMo Guardrails microservice to perform both these checks by using the application LLM, NVIDIA NIM microservices, or third-party models.

Resources

Helm Chart | User Guide

Note: Use, distribution or deployment of this microservice in production requires an NVIDIA AI Enterprise License.

Governing Terms

The software and materials are governed by the NVIDIA Software License Agreement and the Product-Specific Terms for NVIDIA AI Products.