CodeLlama-70B-Instruct | NVIDIA NGC

NVIDIA

CodeLlama-70B-Instruct

Container

NVIDIA

CodeLlama-70B-Instruct

NVIDIA NIM for GPU accelerated CodeLlama-70B inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:2089dd0a2865b3df46db3042c790e54c68a3ed48e8d8eff23d0fa8ce3d4bc396	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	10/04/2024 11:21 PM UTC
sha256:4b5f57e6e9a3ca4d6afabf4b2f3f13ad1fb9e4fc142b770a4b732f5de4ebe30b	COPY	`./notices/* /opt/nim/`	10/04/2024 11:21 PM UTC
sha256:6590c1cbc77663ce1b4a45af92d612e1d9bdb5d91a0d6da21bcde0575c3b6aa2	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	10/04/2024 11:21 PM UTC
sha256:24e99db140e16ae0ec9bf7595add3bfa79bb5da2c43a061bf8948006b97c20db	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	10/04/2024 11:21 PM UTC
sha256:c5a0262c15534e26f798d418709241e0a623e747efaf42c9a0e9b87247100f49	COPY	`./model_manifest.yaml /etc/nim/config/model_manifest.yaml`	10/04/2024 11:21 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	10/04/2024 11:21 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.2.2`	10/04/2024 11:21 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-7CO4-FC5U`	10/04/2024 11:21 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-HNHX-NLIR`	10/04/2024 11:21 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=codellama/codellama-70b-instruct`	10/04/2024 11:21 PM UTC