Meta/Llama3-70b-instruct | NVIDIA NGC

NVIDIA

Meta/Llama3-70b-instruct

Container

NVIDIA

Meta/Llama3-70b-instruct

NVIDIA NIM for GPU accelerated Llama 3 70B inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:8ea8f45067c87c66cc914018eefe98a22052f91cd2b3263f2bf7ae2a3b637f92	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	07/31/2024 11:12 PM UTC
sha256:77c67e8e030ca32cd8592c0c5995fe70292b79343ba34547d8847a89bf9853a4	COPY	`./notices/* /opt/nim/`	07/31/2024 11:12 PM UTC
sha256:c7870a547175e337733278b39a3f35157ddb4e23b57758f20e6031380996f038	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	07/31/2024 11:12 PM UTC
sha256:b2e33fc1fc2b2814e82d3026f2ed721d9285fce8a1cb3418bfbef7c2e94f54cc	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	07/31/2024 11:12 PM UTC
sha256:5c3d4d82e1ff824b2142286fde7aa69ee27a789b88556355105397227f7ddda5	COPY	`./model_manifest.yaml /etc/nim/config/model_manifest.yaml`	07/31/2024 11:12 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.0.3`	07/31/2024 11:12 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-8JJD-ZCD1`	07/31/2024 11:12 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-MB5F-LVUL`	07/31/2024 11:12 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NAME=meta/llama3-70b-instruct`	07/31/2024 11:12 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	USER	`1000`	07/31/2024 11:12 PM UTC