Llama-3.1-405b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-405b-instruct

Container

NVIDIA

Llama-3.1-405b-instruct

NVIDIA NIM for GPU accelerated Llama 3.1 405B inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:c6d376465ec15ebfa75545eec058b7f334f451049d115eab1a56d08c387b7c21	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	08/13/2024 10:09 PM UTC
sha256:b6ed8c8ee3978abae452e66c789e4faef5da42598f6eb0956be854e9f2c18fb0	COPY	`./notices/* /opt/nim/`	08/13/2024 10:09 PM UTC
sha256:7bf905f3a197677e3b7afc651be73a8f9113594a9c3cc10443e57871f2637c03	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	08/13/2024 10:09 PM UTC
sha256:62d98af700c78b537cb5f76465c32bfd26b95ea27ee26a1efa075d175ace7217	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	08/13/2024 10:09 PM UTC
sha256:c03da05026d807cc3536fd61ccf1e574888a27a7d2c78493ebc0818f38e0a8e9	COPY	`./model_manifest.yaml /etc/nim/config/model_manifest.yaml`	08/13/2024 10:09 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.1.2`	08/13/2024 10:09 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-M7I6-UYMF`	08/13/2024 10:09 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-346W-0PAH`	08/13/2024 10:09 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NAME=nim/meta/llama-3.1-405b-instruct`	08/13/2024 10:09 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	USER	`1000`	08/13/2024 10:09 PM UTC