CodeLlama-34B-Instruct | NVIDIA NGC

NVIDIA

CodeLlama-34B-Instruct

Container

NVIDIA

CodeLlama-34B-Instruct

NVIDIA NIM for GPU accelerated CodeLlama-34B inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:b072e75960fc3b0c1fd4113980ab2246ac0e9503a1ed497997cc4cd4f1008efb	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	10/04/2024 11:18 PM UTC
sha256:aada3896159c11da6093012a7822d3a3697162d39e476b5578c0c036898893e7	COPY	`./notices/* /opt/nim/`	10/04/2024 11:18 PM UTC
sha256:6fd523741d7a0bffb8f4c0f4957f16e5f12365e0b981050b699f12ed2e9009df	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	10/04/2024 11:18 PM UTC
sha256:8d81160f7f75337c0e8dd60a19674a257767fb0e391a311ab4942eec8b5acdb7	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	10/04/2024 11:18 PM UTC
sha256:744165d9d196db44cd644ffc7c1a00bb39a57a63a01c8b944ba134d95fbfb764	COPY	`./model_manifest.yaml /etc/nim/config/model_manifest.yaml`	10/04/2024 11:18 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	10/04/2024 11:18 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.1.2`	10/04/2024 11:18 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-4WB3-Q6G8`	10/04/2024 11:18 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-49LM-AWWM`	10/04/2024 11:18 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=codellama/codellama-34b-instruct`	10/04/2024 11:18 PM UTC