NVIDIA NIM for GPU accelerated NVIDIA Retrieval QA E5 Embedding v5 inference.Please add description

Text Embedding NIM
NeMo Retriever Text Embedding NIM (Text Embedding NIM) brings the power of state-of-the-art text embedding models to your applications, offering unparalleled natural language processing and understanding capabilities. You can use Text Retriever NIM for semantic search, Retrieval Augmented Generation (RAG) pipelines, or any application that uses text embeddings. Text Embedding NIM is built on the NVIDIA software platform, incorporating CUDA, TensorRT, and Triton to offer out-of-the-box GPU acceleration.
What is NVIDIA Retrieval QA E5 Embedding v5 NIM Production Branch 6?
The NVIDIA Retrieval QA E5 Embedding v5 NIM Production Branch, exclusively available with NVIDIA AI Enterprise, is a 9-month supported, API-stable branch that includes monthly fixes for high and critical software vulnerabilities. This branch provides a stable and secure environment for building your mission-critical AI applications. The NVIDIA Retrieval QA E5 Embedding v5 NIM production branch releases every six months with a three-month overlap in between two releases.
Getting started with the NIM
Deploying and integrating the NIM is straightforward thanks to our industry standard APIs. Visit the NIM Container page for release documentation, deployment guides and more.
Government Ready: STIG/FIPS Hardening
This ensures the highest level of security for regulated environments, the x86 container image for this branch is:
- STIG Ubuntu 24.04 hardened
- Supports FIPS 140-2 / 3 validated crypto / uses libraries that support FIPS crypto
Learn more about NVIDIA's hardened image in the AI Software for Regulated Environments White Paper.
Compatible Infrastructure Software Versions
For the optimized performance, it is highly recommended to deploy the supported NVIDIA AI Enterprise Infrastructure software in conjunction with your AI software. Production Branch 6 (PB6) is compatible with NVIDIA AI Enterprise Infrastructure 8.
Security Vulnerabilities in Open Source Packages
Please review the Security Scanning tab on NGC to view the latest security scan results.
For certain open-source vulnerabilities listed in the scan results, NVIDIA provides a response in the form of a Vulnerability Exploitability eXchange (VEX) document. The VEX information can be reviewed and downloaded from the Security Scanning tab.
Get Help
Enterprise Support
Get access to knowledge base articles and support cases or submit a ticket.
Governing Terms
The NIM container is governed by NVIDIA Agreements | Enterprise Software | NVIDIA Software License Agreement and NVIDIA Agreements | Enterprise Software | Product Specific Terms for AI Product; and the use of this model is governed by the NVIDIA Community Model License.
Additionally, the NIM container supports the following models with additional license info:
- NV-EmbedQA-E5-v5: MIT license.
You are responsible for ensuring that your use of NVIDIA AI Foundation Models complies with all applicable laws.