Skip to main content
ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
Nemotron Rerank
Container
NVIDIA
Nemotron Rerank

NVIDIA Nemotron Rerank NIM provides GPU-accelerated inference for document reranking in retrieval-augmented generation (RAG) and agentic retrieval applications

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
/opt/nim/start_server.sh
10/29/2026 2:52 PM UTC
sha256:454c6e84620dab247c6b4f9266878f3be347f6c676111f26c79de3a05587cb6bCOPY
NOTICE /opt/nim/NOTICE
10/29/2026 2:52 PM UTC
sha256:a9454ea07f7d6c2a890ef18dac15070bb1f17a43219f5282df08b14047097b93COPY
VERSION /opt/nim/VERSION
10/29/2026 2:52 PM UTC
sha256:0d8f9fa29a5531a100f37932a6182ad3cb1bec24cd2cb26b16151d6798b11358COPY
LICENSE /opt/nim/LICENSE
10/29/2026 2:52 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_ENGINE_MODEL_DOWNLOAD_PROVIDER=auto
10/29/2026 2:52 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_PIPELINE_MAX_SEQ_LEN=10240
10/29/2026 2:52 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_ENGINE_MODEL_NAME=nvidia/Nemotron-3.5-Rerank-8B-BF16
10/29/2026 2:52 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_ENGINE_PRECISION=fp16
10/29/2026 2:52 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_HTTP_API_PORT=8000
10/29/2026 2:52 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_NSPECT_ID=NSPECT-8TPD-PH99
10/29/2026 2:52 PM UTC
1-10 of 32 items

Modal Content

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.

Manage Settings