Use the NGC CLI to download:
Copied!
Model
Built with Llama - Meta-Llama 3.1 8B Instruct INT4 ONNX model is the AWQ quantized version model, which is an auto-regressive language model that uses an optimized transformer architecture for multilingual dialogue use cases.
Use the NGC CLI to download:
Copied!
| Name | Size | Updated | Actions |
|---|---|---|---|
3rd_party_licenses.txt | 2.34 KB | February 28, 2025 UTC | |
config.json | 893 B | February 28, 2025 UTC | |
genai_config.json | 1.7 KB | February 28, 2025 UTC | |
License.txt | 367 B | February 28, 2025 UTC | |
model.onnx | 352.64 KB | February 28, 2025 UTC | |
model.onnx_data | 5.34 GB | February 28, 2025 UTC | |
notice.txt | 114 B | February 28, 2025 UTC | |
readme.txt | 0 B | February 28, 2025 UTC | |
Readme.txt | 536 B | February 28, 2025 UTC | |
special_tokens_map.json | 312 B | February 28, 2025 UTC | |
tokenizer_config.json | 56.07 KB | February 28, 2025 UTC | |
tokenizer.json | 9.06 MB | February 28, 2025 UTC |