NeMo Deployment Management Microservice Helm Chart

NeMo Deployment Management microservice enables deployment and management of NVIDIA NIM and other workloads in Kubernetes environments. The service provides APIs to create, update, delete, and monitor various deployment types including NIM services, training jobs, and validation workflows.

You can use this service to deploy NVIDIA NIMs for large language models, manage model deployment configurations, set up training workflows with data handlers, and orchestrate the validation of datasets and models within your Kubernetes cluster.

Alternative: Platform Deployment

You can install NeMo Deployment Management as part of the NeMo microservices platform by using the NeMo Microservices Helm Chart (chart | documentation).

Resources

Container | Helm Installation Guide | User Guide

Note: Use, distribution or deployment of this microservice in production requires an NVIDIA AI Enterprise License.

Governing Terms

The software and materials are governed by the NVIDIA Software License Agreement and the Product-Specific Terms for NVIDIA AI Products.