Use the NGC CLI to download:
Copied!
Model
Mistral-7B-Instruct is a language model that can follow instructions, complete requests, and generate creative text formats.
Use the NGC CLI to download:
Copied!
5 Versions
bs1_int8wo_RTX4090_windowsSelected06/13/2024 11:27 PM UTC6.14 GBCopied!
bs1_int8wo_RTX4090_windowsSelected
06/13/2024 11:27 PM UTC6.14 GB
Copied!
TRT Cloud Engine Properties
| Key | Value |
|---|---|
| cpu_arch | x86_64 |
| os | Windows |
| num_gpus | 1 |
| trtllm_version | 0.10.0 |
| max_batch_size | 1 |
| weightless | False |
| gpu | RTX4090 |
06/13/2024 11:26 PM UTC6.14 GBCopied!
06/13/2024 11:26 PM UTC6.14 GB
Copied!
TRT Cloud Engine Properties
| Key | Value |
|---|---|
| cpu_arch | x86_64 |
| os | Windows |
| num_gpus | 1 |
| trtllm_version | 0.10.0 |
| weight_stripped | False |
| max_batch_size | 1 |
| gpu | RTX4070 |
06/13/2024 11:26 PM UTC3.21 GBCopied!
06/13/2024 11:26 PM UTC3.21 GB
Copied!
TRT Cloud Engine Properties
| Key | Value |
|---|---|
| cpu_arch | x86_64 |
| os | Windows |
| num_gpus | 1 |
| trtllm_version | 0.10.0 |
| max_batch_size | 1 |
| weightless | False |
| gpu | RTX4090 |
06/13/2024 11:25 PM UTC3.2 GBCopied!
06/13/2024 11:25 PM UTC3.2 GB
Copied!
TRT Cloud Engine Properties
| Key | Value |
|---|---|
| cpu_arch | x86_64 |
| os | Windows |
| num_gpus | 1 |
| trtllm_version | 0.10.0 |
| weight_stripped | False |
| max_batch_size | 1 |
| gpu | RTX4070 |
06/13/2024 11:25 PM UTC3.2 GBCopied!
06/13/2024 11:25 PM UTC3.2 GB
Copied!
TRT Cloud Engine Properties
| Key | Value |
|---|---|
| cpu_arch | x86_64 |
| os | Windows |
| num_gpus | 1 |
| trtllm_version | 0.10.0 |
| weight_stripped | False |
| max_batch_size | 1 |
| gpu | RTX4060TI |