Llama-3.1-405b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-405b-instruct

Container

NVIDIA

Llama-3.1-405b-instruct

NVIDIA NIM for GPU accelerated Llama 3.1 405B inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:d48a9c6fad1c53bf5cad61581efcf7d9651a35225fd3e5d13921a8248b6a7977	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	09/10/2024 4:48 AM UTC
sha256:a40cad65a73f743fb5b5a2ceb65a2bc3500c0f408a5a64e0439d93df98e893b2	COPY	`./notices/* /opt/nim/`	09/10/2024 4:48 AM UTC
sha256:83fdcb5c43205994eaa2c0a5e3737a51e81e70174bf790316c964ae48bda9a6a	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	09/10/2024 4:48 AM UTC
sha256:84792d5db6d93df60236b5f68b2678f0bcc162ac676e0a77369aabd26342102f	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	09/10/2024 4:48 AM UTC
sha256:edab8795b56f50e19919135044b8456f21ce4e450c1728a53050374e77f8da61	COPY	`./model_manifest.yaml /etc/nim/config/model_manifest.yaml`	09/10/2024 4:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	09/10/2024 4:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.2.0`	09/10/2024 4:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-M7I6-UYMF`	09/10/2024 4:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-346W-0PAH`	09/10/2024 4:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-405b-instruct`	09/10/2024 4:48 AM UTC