The Phi-3-Medium-128K-Instruct is a 14B parameters, lightweight, open model trained with the Phi-3 datasets that includes both synthetic data and the filtered publicly available websites data with a focus on high-quality and reasoning dense properties.
Description:
Phi-3 Medium is a lightweight, state-of-the-art open model. The model belongs to the Phi-3 model family, and the small version comes in two variants 4K and 128K which is the context length (in tokens) it can support. The model underwent a rigorous enhancement process, incorporating both supervised fine-tuning and direct preference optimization to ensure precise instruction adherence and robust safety measures.
The model is licensed under the MIT license
Terms of use:
By accessing this model, you are agreeing to the Terms and Conditions of the MIT License.
References(s):
- Phi-3-medium-128k-instruct Model Card
- Phi-3 blogpost
Model Architecture:
Architecture Type: Transformer
Input:
Input Format: Text
Input Parameters: None
Output:
Output Format: Text
Output Parameters: None
Software Integration:
Supported Hardware Platform(s): RTX 4090, Ada GPUs
Supported Operating System(s): Windows
Inference:
TRT-LLM Inference Engine
Windows Setup with TRT-LLM
Test Hardware:
RTX 4090