Skip to main content
ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NeMo NIM Proxy
Container
NVIDIA
NeMo NIM Proxy

Proxy service for NIM microservices

Sign in to access all content for this ContainerSigning in will also allow download accessSign In

End of Support — "This artifact is no longer supported. NVIDIA strongly recommends artifacts that are up to date and supported"

NeMo NIM Proxy Microservice Container

NeMo NIM Proxy microservice provides a unified access point for all NVIDIA NIM (NVIDIA Inference Microservice) deployments within your Kubernetes cluster through a single OpenAI-compatible API.

You can use the NIM Proxy to interact with multiple deployed models through standardized endpoints for retrieving model lists and making inference requests to chat completions and completions APIs.

Note: NeMo microservices has been sunset as of October 1, 2026. There will be no new releases.

Resources

Helm Chart | User Guide

Note: Use, distribution or deployment of this microservice in production requires an NVIDIA AI Enterprise License.

Governing Terms

The software and materials are governed by the NVIDIA Software License Agreement and the Product-Specific Terms for NVIDIA AI Products.

Get Help

NVIDIA Developer Community Forum

For support, Visit the NVIDIA Developer Community Forum

Publisher
NVIDIA
Latest Tag25.12
UpdatedDecember 16, 2025 UTC
Compressed Size37.5 MB
Multinode SupportNo
Multi-Arch SupportYes
System
Labels

Modal Content

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.

Manage Settings