Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

Layer	Label		Created
sha256:860df728413b0ef4ba890ec28255d19ffe0a9738cf9685d854cf6a33ba99cbd9	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	07/23/2024 11:40 PM UTC
sha256:6a1a14281feb4125aa8ddfdea6002baf28a99d1bde0d24dc4d81070bdedf8791	COPY	`./notices/* /opt/nim/`	07/23/2024 11:40 PM UTC
sha256:db1a40fd720c1b6ef38dd1cf3f90b84147d88fe19db1d12770dcc287ce5747c3	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	07/23/2024 11:40 PM UTC
sha256:3b0ba8baa2b98dcafff26db521e9ad31ef4fbb4e53d394b422b0b5979aa7f5ba	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	07/23/2024 11:40 PM UTC
sha256:7ccb52b12127793ee67847f4c9f1632736e6b1be04ef95bdfa9441b83029c9c8	COPY	`./model_manifest.yaml /etc/nim/config/model_manifest.yaml`	07/23/2024 11:40 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-7S3F-QFG8`	07/23/2024 11:40 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-X37N-G0O5`	07/23/2024 11:40 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NAME=nim/meta/llama-3_1-70b-instruct`	07/23/2024 11:40 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	USER	`1000`	07/23/2024 11:40 PM UTC
sha256:50978f65a451fe3e5e42981a3cbb194b5ad1a502e8b56c9bd7d41531a831d201	RUN	`NIM_MODEL_NAME=meta/llama-3_1-70b-instruct NIM_MODEL_NAME_ENV=nim/meta/llama-3_1-70b-instruct NIM_VERSION=1.1.0 NIM_CONTAINER_NSPECT_ID=NSPECT-X37N-G0O5 NIM_MODEL_NSPECT_ID=NSPECT-7S3F-QFG8 NIM_TYPE=llm NIM_USER_ID=1000 chown ${NIM_USER_ID}:${NIM_USER_ID} /.triton`	07/23/2024 11:40 PM UTC