NVIDIA
NVIDIA
Starcoder2-7B
Container
NVIDIA
NVIDIA
Starcoder2-7B

This container houses the StarCoder2-7B, a 7B parameter open-source LLM for code from the BigCode collaboration. Trained on 600+ languages, it generates code from natural language and assists with tasks like code completion, synthesis, and infilling.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
/opt/nim/start_server.sh
05/06/2026 10:57 PM UTC
sha256:041f85591cffc7621b22398f525f5f794f51658f95295705a31d991d1bf4baceCOPY
--chown=nim:nim NOTICE /opt/nim/NOTICE
05/06/2026 10:57 PM UTC
sha256:d38183db2a460a51a36d11496c59c881b8e07fe9f4ab5148d81fa1256993db1eCOPY
--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
05/06/2026 10:57 PM UTC
sha256:1c395be8e1e2e696415f3acc5d125c496437a327ebe76515c5856cacd8b1fa88COPY
--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
05/06/2026 10:57 PM UTC
sha256:620ccc82db6efa648faecc809baae63f42d6de47fe33eb0e0f302ba6bde0a2aaCOPY
--chown=nim:nim VERSION /opt/nim/VERSION
05/06/2026 10:57 PM UTC
sha256:cb62356eea2a0ea8b0795b16f90d48ebec472d3a3143acb5f7a4ecb305d4f3a0COPY
--chown=nim:nim LICENSE /opt/nim/LICENSE
05/06/2026 10:57 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.4
05/06/2026 10:57 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_SERVED_MODEL_NAME=bigcode/starcoder2-7b
05/06/2026 10:57 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_HTTP_API_PORT=8000
05/06/2026 10:57 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NSPECT_ID=NSPECT-GLGZ-U7GA
05/06/2026 10:57 PM UTC
...