## NeMo NIM Proxy Microservice Helm Chart

NeMo NIM Proxy microservice provides a unified access point for all NVIDIA NIM (NVIDIA Inference Microservice) deployments within your Kubernetes cluster through a single OpenAI-compatible API.

You can use the NIM Proxy microservice to interact with multiple NIM microservices through a unified endpoint proxy API. With this microservice, you can retrieve the deployed NIM microservices and make inference requests to the `chat/completions` and `completions` APIs.

### Alternative: Platform Deployment

You can install NeMo NIM Proxy as part of the NeMo microservices platform by using the NeMo Microservices Helm Chart ([chart](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/nemo-microservices/helm-charts/nemo-microservices-helm-chart) | [documentation](https://docs.nvidia.com/nemo/microservices/latest/set-up/deploy-as-platform/index.html)).

### Resources

[Container](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/nemo-microservices/containers/nim-proxy) | [Helm Installation Guide](https://docs.nvidia.com/nemo/microservices/latest/set-up/deploy-as-microservices/index.html) | [User Guide](https://docs.nvidia.com/nemo/microservices/latest/run-inference/nim-proxy/user-guide.html)

> **Note:** Use, distribution or deployment of this microservice in production requires an NVIDIA AI Enterprise License.

### Governing Terms

The software and materials are governed by the [NVIDIA Software License Agreement](https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-software-license-agreement/) and the [Product-Specific Terms for NVIDIA AI Products](https://www.nvidia.com/en-us/agreements/enterprise-software/product-specific-terms-for-ai-products/).