NVIDIA
NVIDIA
Starcoder2-7B
Container
NVIDIA
NVIDIA
Starcoder2-7B

This container houses the StarCoder2-7B, a 7B parameter open-source LLM for code from the BigCode collaboration. Trained on 600+ languages, it generates code from natural language and assists with tasks like code completion, synthesis, and infilling.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
/opt/nim/start_server.sh
07/17/2026 3:19 AM UTC
sha256:55133b9e011e4f7deed21f683c41e2b8ff7c947bc1e3acd1b5094f8a0b4fa0fcCOPY
--chown=nim:nim NOTICE /opt/nim/NOTICE
07/17/2026 3:19 AM UTC
sha256:0b6c998f295e6c8e42f6ddcd104b4deeb5640948d2da875fb071384def983bf7COPY
--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
07/17/2026 3:19 AM UTC
sha256:871623cb966fd99aa000a2cb4847dd38f18046a4b0aa640d2166fe98f6ee41a1COPY
--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
07/17/2026 3:19 AM UTC
sha256:6b3adfb31746398c2eebfb8ab2982e1569e5a67fc592b1c0c6f08558fc0d9600COPY
--chown=nim:nim VERSION /opt/nim/VERSION
07/17/2026 3:19 AM UTC
sha256:0f2d65da1f2789a2506d6758248be4ffef858b81a98913b170404474ba31deb9COPY
--chown=nim:nim LICENSE /opt/nim/LICENSE
07/17/2026 3:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.9
07/17/2026 3:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_SERVED_MODEL_NAME=bigcode/starcoder2-7b
07/17/2026 3:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_HTTP_API_PORT=8000
07/17/2026 3:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NSPECT_ID=NSPECT-GLGZ-U7GA
07/17/2026 3:19 AM UTC
...