Model Overview
--------------

### Description:
CodeGemma is a collection of lightweight open code models built on top of Gemma.  CodeGemma models are text-to-text decoder-only models.  This is a 7 billion parameter instruction-tuned varient for code chat and instruction. 


### Terms of use:
Use of this model is governed by the  [NVIDIA AI Foundation Models Community License](https://developer.download.nvidia.com/ai-foundation-models/nvidia-ai-foundation-models-license-10Nov2023.pdf). ADDITIONAL INFORMATION: [Gemma Terms of Use](https://ai.google.dev/gemma/terms) and [Google Prohibited Use Policy](https://ai.google.dev/gemma/prohibited_use_policy).

### References(s):

* CodeGemma [Model Card](https://ai.google.dev/gemma/docs/codegemma)  

### Model Architecture:

**Architecture Type:** Transformer  

### Input:
**Input Format:** Text  

**Input Parameters:** None 

### Output:

**Output Format:** Text

**Output Parameters:** None

### Software Integration:

**Supported Hardware Platform(s):** RTX 4090

**Supported Operating System(s):** Windows

### Inference:

[TRT-LLM Inference Engine](https://github.com/NVIDIA/TensorRT-LLM/tree/gemma/examples/gemma)  
[Windows Setup with TRT-LLM](https://github.com/NVIDIA/TensorRT-LLM/tree/gemma/windows) 

### Test Hardware:
RTX 4090

codegemma7bitint4

CodeGemma is a collection of lightweight open code models built on top of Gemma.  CodeGemma models are text-to-text decoder-only models.  This is a 7 billion parameter instruction-tuned varient for code chat and instruction.

CodeGemma-7B-IT-INT4-RTX

Model Overview

Description:

Terms of use:

References(s):

Model Architecture:

Input:

Output:

Software Integration:

Inference:

Test Hardware: