Model Overview

Description:

The Mistral-7B-Instruct-v0.1 Large Language Model (LLM) is a instruct fine-tuned version of the Mistral-7B-v0.1 generative text model using a variety of publicly available conversation datasets. Mistral-7B is released under the Apache 2.0 license

This instruction model is a transformer model with the following architecture choices:

• Grouped-Query Attention
• Sliding-Window Attention
• Byte-fallback BPE tokenizer

Terms of use:

By accessing this model, you are agreeing to the Mistral 7B Terms and Conditions of the License, Terms of Service.

References(s):

• Mistral 7B Instruct Model Card on Hugging Face
• Mistral 7B paper
• Mistral 7B blogpost

Model Architecture:

Architecture Type: Transformer

Network Architecture: Mistral-7B

Input:

Input Format: Text

Input Parameters: None

Output:

Output Format: Text

Output Parameters: None

Software Integration:

Supported Hardware Platform(s): RTX 4090, Ada GPUs

Supported Operating System(s): Windows

Inference:

TRT-LLM Inference Engine
Windows Setup with TRT-LLM

Test Hardware:

RTX 4090