Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a243f68bcfed69e0b61119ee384dcad616f2998f10b9ab2274c6e30135142a2b	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	12/12/2024 7:15 PM UTC
sha256:6fab1da7f05c93488959347e9fc67151aadb4afad62b328ffa84550b60d48a27	COPY	`./notices/* /opt/nim/`	12/12/2024 7:15 PM UTC
sha256:88e9c65433154bf071525f12adcf243b42accbfab44eca2ad53bd5a779ea3210	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	12/12/2024 7:15 PM UTC
sha256:e4b9695edb96e77d8cd6dc5f5528ffcca2fc997c6ee929ff53aa0c81829132db	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	12/12/2024 7:15 PM UTC
sha256:96f8c9e4d65971ab71ddb9b86daf60423609aaa9b555f1150d0afce180034cd0	COPY	`./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	12/12/2024 7:15 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	12/12/2024 7:15 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.3.3`	12/12/2024 7:15 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-7S3F-QFG8`	12/12/2024 7:15 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-X37N-G0O5`	12/12/2024 7:15 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	12/12/2024 7:15 PM UTC