Llama-3-Taiwan-70B-Instruct | NVIDIA NGC

NVIDIA

Llama-3-Taiwan-70B-Instruct

Container

NVIDIA

Llama-3-Taiwan-70B-Instruct

NVIDIA NIM for GPU accelerated Llama-3-Taiwan-70B-Instruct inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:6898c74de3d0cc5dea3e90fc38d3e1877274137f9fcff5e29b9e2e222cd41612	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	08/27/2024 8:38 AM UTC
sha256:ba4c6a723de598df0f216ffee3a6ad8af31e3bcf198fd8ce6375d186c2045ec7	COPY	`./notices/* /opt/nim/`	08/27/2024 8:38 AM UTC
sha256:a4e3682ca1f8b1d6349513d66029e2c24fdeb1b80785785ed46f00729c7723c3	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	08/27/2024 8:38 AM UTC
sha256:f83c54cdd05329498892432d8bfa51a935ca259200850b3ba72a2ceb08a0ec4c	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	08/27/2024 8:38 AM UTC
sha256:54d5bcb5340241dafdaa6900d31106e11b9a59b5b206ce40a3535d91da0298f9	COPY	`./model_manifest.yaml /etc/nim/config/model_manifest.yaml`	08/27/2024 8:38 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.1.2`	08/27/2024 8:38 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-V6QH-NZ1W`	08/27/2024 8:38 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-DUR6-L0CU`	08/27/2024 8:38 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=yentinglin/llama-3-taiwan-70b-instruct`	08/27/2024 8:38 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NAME=yentinglin/llama-3-taiwan-70b-instruct`	08/27/2024 8:38 AM UTC