StarCoderBase 15.5B | NVIDIA NGC

NVIDIA

StarCoderBase 15.5B

Container

NVIDIA

StarCoderBase 15.5B

NVIDIA NIM for GPU accelerated StarCoderBase15.5B inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:5b24d8dc655d72f1552002aa1c264655cc46bc7f7f9224da05aef7d4877320b7	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	01/23/2025 6:59 PM UTC
sha256:1cbd4ff2f348da3d5935e2f354cc9b35745073f59e226bb9fd8c53d79e47898a	COPY	`./NOTICES/* /opt/nim/`	01/23/2025 6:59 PM UTC
sha256:1e6f9df53ff5a19442f8af433308222325c4b8cb54614b3579ef1f023ee02417	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	01/23/2025 6:59 PM UTC
sha256:0d32a666532cc98a59ef5cb046d0e48743ca4a70474279567f74da8f13fc215b	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	01/23/2025 6:59 PM UTC
sha256:b532776e2ed2ebf4cd21dba415b17cd8ba5a66a58995c325f611746b2ce48eb3	COPY	`./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	01/23/2025 6:59 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NAME=bigcode/bigcode-starcoderbase-15b`	01/23/2025 6:59 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	01/23/2025 6:59 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=RC9`	01/23/2025 6:59 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-I5ZQ-E9L3`	01/23/2025 6:59 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-FZI8-SK2D`	01/23/2025 6:59 PM UTC