NVIDIA
Meta/Llama3-8b-instruct
Container
NVIDIA
Meta/Llama3-8b-instruct

NVIDIA NIM for GPU accelerated Llama 3 8B inference through OpenAI compatible APIs

LayerLabelCreated
sha256:2f316c86cc449c66a45d049c5616d95084e62833ff6c157305ea2d7b23417cb4COPY
./CONTAINER_LICENSE /opt/nim/LICENSE
07/31/2024 11:07 PM UTC
sha256:7f9170d73ef7c51d87288c0a86343456ffb6f97659eb9bc26ab9e7ff9f1a4c30COPY
./notices/* /opt/nim/
07/31/2024 11:07 PM UTC
sha256:73ed3ef06141c2228fe9186a4fcbb0bf43d2ebfc647270a0685578f8c8112a93COPY
./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
07/31/2024 11:07 PM UTC
sha256:b259fca21f4dcae79fe96a29a20bb93fdf086a7ba037f628389a540c1659a325COPY
./MODEL_LICENSE /opt/nim/MODEL_LICENSE
07/31/2024 11:07 PM UTC
sha256:161acb59b28cd8cc1ab9389bc6a153b4b55c94ff14b57cc32e1a7a3148477876COPY
./model_manifest.yaml /etc/nim/config/model_manifest.yaml
07/31/2024 11:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.0.3
07/31/2024 11:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NSPECT_ID=NSPECT-OORG-DPTR
07/31/2024 11:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_NSPECT_ID=NSPECT-MB5F-LVUL
07/31/2024 11:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NAME=meta/llama3-8b-instruct
07/31/2024 11:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
1000
07/31/2024 11:07 PM UTC
...