Built with Meta Llama 3 - Meta Llama 3 family of large language models (LLMs) is a collection of pretrained and instruction tuned generative text models in 8B and 70B sizes.
Model Overview
Description:
Built with Meta Llama 3 - The Meta Llama 3 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes. The Llama 3 instruction tuned models are optimized for dialogue use cases and outperform many of the available open source chat models on common industry benchmarks. Llama 3 is an auto-regressive language model that uses an optimized transformer architecture.
Terms of use
By accessing this model, you are agreeing to the LLama 3 terms and conditions of the license, acceptable use policy, and Meta’s privacy policy
References(s):
- Meta Llama 3 Model Card on Hugging Face
- Meta Llama 3 blogpost
Model Architecture:
Architecture Type: Transformer
Network Architecture: Llama 3
Model version: N/A
Input:
Input Format: Text
Input Parameters: Temperature, TopP
Output:
Output Format: Text and code Output Parameters: Max output tokens
Software Integration:
Runtime(s): N/A
Supported Hardware Platform(s): RTX 4090
Supported Operating System(s): Windows
Inference:
TRT-LLM Inference Engine
Windows Setup with TRT-LLM
Test Hardware:
RTX 4090