CodeLlama-13B-Instruct | NVIDIA NGC

NVIDIA

CodeLlama-13B-Instruct

Container

NVIDIA

CodeLlama-13B-Instruct

NVIDIA NIM for GPU accelerated CodeLlama-13B inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:565dfbaa156a404bc870f61524f588e10c22cf8523a73848ec8f5704ca0d38b7	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	10/04/2024 11:19 PM UTC
sha256:1b705cdbf32f551ac4c76558c3636ad7e874f22152602957a3fadb296f80878e	COPY	`./notices/* /opt/nim/`	10/04/2024 11:19 PM UTC
sha256:f2c6c5fe949d36b16892563612da5f7a5bb287eb2aa5d943acae76142c89d09b	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	10/04/2024 11:19 PM UTC
sha256:c123c56354359411834391974ed1504be7c8643b54d8c9264134d92734423f81	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	10/04/2024 11:19 PM UTC
sha256:cb8fb350992c5894eac3ccd2cef2de4d834f42d01de249a380dff61308fb73f3	COPY	`./model_manifest.yaml /etc/nim/config/model_manifest.yaml`	10/04/2024 11:19 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	10/04/2024 11:19 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.2.2`	10/04/2024 11:19 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-WNG1-TFXP`	10/04/2024 11:19 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-6OPJ-52E6`	10/04/2024 11:19 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=codellama/codellama-13b-instruct`	10/04/2024 11:19 PM UTC