Meta/Llama3-70b-instruct | NVIDIA NGC

NVIDIA

Meta/Llama3-70b-instruct

Container

NVIDIA

Meta/Llama3-70b-instruct

NVIDIA NIM for GPU accelerated Llama 3 70B inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:268bcca40b762b2714db5eaa17aa7401d1a44a5ad855631e55f3795447770421	COPY	`./docker/nim/NSPECT-8JJD-ZCD1/notices/* /opt/nim/`	05/31/2024 8:09 PM UTC
sha256:4aadc1bd8c8a5f636c1c2353af2d977a67828f03d8575a9cd24d07207b4d0c9a	COPY	`./docker/nim/NSPECT-8JJD-ZCD1/banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	05/31/2024 8:08 PM UTC
sha256:a76bf8c63bc7ef11c51390b9082f40d6d566eac781abeb2e582c7ad9269c6df1	COPY	`./docker/nim/NSPECT-8JJD-ZCD1/LICENSE /opt/nim/MODEL_LICENSE`	05/31/2024 8:08 PM UTC
sha256:ddb02ef514f8b10bb7fbd7f91e004029e359a46bdb176f16d77140bef9e96cce	COPY	`./docker/nim/NSPECT-8JJD-ZCD1/nim_config.yaml /etc/nim/config/model_manifest.yaml`	05/31/2024 8:08 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-8JJD-ZCD1`	05/31/2024 8:08 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-MB5F-LVUL`	05/31/2024 8:08 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NAME=nim/meta/llama3-70b-instruct`	05/31/2024 8:08 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	USER	`1000`	05/31/2024 8:08 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NIM_USER_ID=1000`	05/31/2024 8:08 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start-server.sh`	05/31/2024 8:08 PM UTC