ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
Mistral AI
Mistral AI
Nemotoron-Mini-4B-Instruct-ONNX-INT4-RTX
Model
Mistral AI
Mistral AI
Nemotoron-Mini-4B-Instruct-ONNX-INT4-RTX

Nemotron-Mini-4B Instruct model is for generating responses for roleplaying, retrieval augmented generation, and function calling. It is a small language model optimized through distillation, pruning and quantization for speed and on-device deployment.

Runs on RTX
NameSizeUpdatedActions
3rd_party_licenses.txt
2.34 KBFebruary 28, 2025 UTC
genai_config.json
1.62 KBFebruary 28, 2025 UTC
License.txt
351 BFebruary 28, 2025 UTC
model.onnx
385.09 KBFebruary 28, 2025 UTC
model.onnx_data
4.19 GBFebruary 28, 2025 UTC
quantization_log.txt
3.54 KBFebruary 28, 2025 UTC
quantization_pip.txt
11.54 KBFebruary 28, 2025 UTC
readme.txt
0 BFebruary 28, 2025 UTC
Readme.txt
536 BFebruary 28, 2025 UTC
special_tokens_map.json
292 BFebruary 28, 2025 UTC
tokenizer_config.json
184.11 KBFebruary 28, 2025 UTC
tokenizer.json
33.2 MBFebruary 28, 2025 UTC

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.