This container houses the StarCoder2-7B, a 7B parameter open-source LLM for code from the BigCode collaboration. Trained on 600+ languages, it generates code from natural language and assists with tasks like code completion, synthesis, and infilling.
Starcoder2-7B
Description:
This container houses the StarCoder2-7B, which generates source code from natural language instructions and code prompts across a wide range of programming languages. This 7-billion parameter model is part of the next generation of open-source large language models for code, developed by the BigCode collaboration, and was trained on The Stack v2, a massive, permissively licensed dataset covering over 600 programming languages. It is specifically designed to assist with tasks like code completion, code synthesis, and infilling (filling in missing code within a file).
The container components are ready for commercial/non-commercial use.
Third-Party Community Consideration
The model embedded in the container is not owned or developed by NVIDIA. This model has been developed and built to a third-party's requirements for this application and use case; see link to bigcode/starcoder2-7b · Hugging Face.
License/Terms of Use:
GOVERNING TERMS: The NIM container is governed by the NVIDIA Software License Agreement and the Product-Specific Terms for NVIDIA AI Products.
The use of any models in this container is governed by the NVIDIA Open Model Agreement in addition to any terms which govern the specific models used.
You are responsible for ensuring that your use of any provided models complies with all applicable laws.
The use of this model is governed by the NVIDIA Open Model Agreement.
The underlying model is also licensed under the BigCode Model License Agreement.
Deployment Geography:
Global
Release Date:
Build.NVIDIA.com 03/18/2024 via
starcoder2-7b Model by BigCode | NVIDIA NIM
Github 02/28/2024 via
GitHub - bigcode-project/starcoder2: Home of StarCoder2!
Huggingface 02/28/2024 via
bigcode/starcoder2-7b · Hugging Face
StarCoder2-7B
StarCoder2-7B Container includes the following model:
| Model Name & Link | Use Case | How to Pull the Model |
|---|---|---|
| StarCoder2-7B | A 7-billion parameter language model that generates and completes source code based on natural language descriptions and existing code context. | Automatic |
Deployment Details:
Our AI models are designed and/or optimized to run on NVIDIA GPU-accelerated systems. By leveraging NVIDIA’s hardware (e.g. GPU cores) and software frameworks (e.g., CUDA libraries), the model achieves faster training and inference times compared to CPU-only solutions.
Documentation
Visit the LNIM Container LLM page for release documentation, deployment guides, and more.
Security Common Vulnerabilities and Exposures (CVEs)
Please review the Security Scanning tab on NGC to view the latest security scan results.
For certain open-source vulnerabilities listed in the scan results, NVIDIA provides a response in the form of a Vulnerability Exploitability eXchange (VEX) document. The VEX information can be reviewed and downloaded from the Security Scanning tab.
Ethical Considerations:
NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal developer team to ensure these software components meet requirements for the relevant industry and use case and address unforeseen product misuse.
Please report quality, risk, security vulnerabilities or NVIDIA AI Concerns here.
Get Help
Enterprise Support
Get access to knowledge base articles and support cases or submit a ticket.