Built with Meta Llama 3 - The Meta Llama 3 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes. The Llama 3 instruction tuned models are optimized for dialogue use cases and outperform many of the available open source chat models on common industry benchmarks. Llama 3 is an auto-regressive language model that uses an optimized transformer architecture.
By accessing this model, you are agreeing to the LLama 3 terms and conditions of the license, acceptable use policy, and Meta’s privacy policy
Architecture Type: Transformer
Network Architecture: Llama 3
Model version: N/A
Input Format: Text
Input Parameters: Temperature, TopP
Output Format: Text and code Output Parameters: Max output tokens
Runtime(s): N/A
Supported Hardware Platform(s): RTX 4090
Supported Operating System(s): Windows
TRT-LLM Inference Engine
Windows Setup with TRT-LLM
RTX 4090