NGC | Catalog

Code Llama

Description
Code Llama is an LLM capable of generating code, and natural language about code, from both code and natural language prompts.
Curator
Meta
Modified
January 30, 2024
Containers
Sorry, your browser does not support inline SVG.
Helm Charts
Sorry, your browser does not support inline SVG.
Models
Sorry, your browser does not support inline SVG.
Resources
Sorry, your browser does not support inline SVG.

Model Overview

Description:

Code Llama is a large language AI model built from a collection of models capable of generating code in response to prompts. It is based on Llama 2.

Terms of use

By accessing this model, you are agreeing to the LLama 2 Terms and Conditions of the License, Acceptable Use Policy and Meta’s Privacy Policy

References(s):

Model Architecture:

Architecture Type: Transformer
Network Architecture: Llama 2

Input:

Input Format: Text
Input Parameters: Temperature, Top P (Nucleus Sampling)

Output:

Output Format: Text (code)
Output Parameters: Max Output Tokens

Software Integration:

Supported Hardware Platform(s): Hopper, Ampere/Turing
Supported Operating System(s): Linux

Training & Finetuning:

Dataset:

Near-deduplicated dataset of publicly available code, propriety of Meta. 8% of samples data are sourced from natural language datasets related to code and containing discussions about code and code snippets included in natural language questions or answers. To help the model retain natural language understanding skills, dataset also inclues a small proportion of batches from a natural language dataset.

Inference:

Engine: Triton
Test Hardware: Other