Gemma-2B is a 2.5B parameter model from Gemma family of models from Google. It has been instruction-tuned so it can respond to prompts in a conversational manner.
Model Overview
Terms of use:
GOVERNING TERMS: By accessing this engine, you are agreeing to NVIDIA TensorRT Engine License.
ATTRIBUTION: Gemma Terms of Use available at https://ai.google.dev/gemma/terms; and Gemma Prohibited Use Policy available at https://ai.google.dev/gemma/prohibited_use_policy.
Third-Party Community Consideration
This model is not owned or developed by NVIDIA. This model has been developed and built to a third-party’s requirements for this application and use case.
Description:
Gemma-2B is a 2.5B parameter model from Gemma family of models from Google. It has been instruction-tuned so it can respond to prompts in a conversational manner. Nvidia has converted original Gemma weights and format into weights and format that can be consumed by TensorRT-LLM. TensorRT engines optimizing Gemma-2B are generated by TensorRT-Cloud.
These TensorRT engines are ready for commercial use.
References(s):
- Gemma Model Card
- Gemma blogpost
Input:
Input Format: Text
Input Parameters: None
Output:
Output Format: Text
Output Parameters: None
Software Integration:
Check the version tag for engine support matrix
Inference:
Ethical Considerations:
NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse. Please report security vulnerabilities or NVIDIA AI Concerns here.