NGC | Catalog
CatalogModelsCode Llama 13B

Code Llama 13B

Logo for Code Llama 13B
Description
Code Llama is a code-specialized version of Llama 2. It can generate code, and natural language about code, from both code and natural language prompts.
Publisher
Meta
Latest Version
1.1
Modified
December 18, 2023
Size
22.49 GB

Model Overview

Description:

Code Llama is a large language AI model built from a collection of models capable of generating code in response to prompts. It is based on Llama 2.

Terms of use:

By accessing this model, you are agreeing to the LLama 2 Terms and Conditions of the License, Acceptable Use Policy and Meta’s Privacy Policy

References(s):

Code Llama: Open Foundation Models for Code paper

Meta's Code Llama model card

Model Architecture:

Architecture Type: Transformer

Network Architecture: Llama 2

Input:

Input Format: Text

Input Parameters: Temperature, Top P (Nucleus Sampling)

Output:

Output Format: Text (code)

Output Parameters: Max Output Tokens

Software Integration:

Supported Hardware Platform(s): RTX 4090, Ada GPUs

Supported Operating System(s): Windows

Training & Finetuning:

Dataset:

Near-duplicated dataset of publicly available code, propriety of Meta. 8% of samples data are sourced from natural language datasets related to code and containing discussions about code and code snippets included in natural language questions or answers. To help the model retain natural language understanding skills, dataset also inclues a small proportion of batches from a natural language dataset.

Inference:

Engine: TRT-LLM

Test Hardware: RTX 4090