NVIDIA
NVIDIA
Llama-3.1-8B-Instruct
Container
NVIDIA
NVIDIA
Llama-3.1-8B-Instruct

NVIDIA NIM for GPU accelerated Llama-3.1-8B-Instruct inference through OpenAI compatible APIs

LayerLabelCreated
sha256:3e9d9b963a05128c255ebecde44345b8951cb3aebf7479dc91f124ecb1d99cf5COPY
./CONTAINER_LICENSE /opt/nim/LICENSE
07/23/2024 11:40 PM UTC
sha256:f99d54ef3ae79b7a0e3bbb6e1b88850e3c06a8e2c294b26d2ecd86a7c5765257COPY
./notices/* /opt/nim/
07/23/2024 11:40 PM UTC
sha256:ef06447075caaf8bb444cc0986fdcc77ac4d817c75a88f0fbf0862aee325a197COPY
./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
07/23/2024 11:40 PM UTC
sha256:b5370c878a6a6d81b3c956043aa0e35f4858bac8f0ad7a54340208194850f6e9COPY
./MODEL_LICENSE /opt/nim/MODEL_LICENSE
07/23/2024 11:40 PM UTC
sha256:7287af4b9806e8f490358371b0953801c92fcdef433364a341133114fde996dbCOPY
./model_manifest.yaml /etc/nim/config/model_manifest.yaml
07/23/2024 11:40 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NSPECT_ID=NSPECT-0DQP-LNLV
07/23/2024 11:40 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_NSPECT_ID=NSPECT-ZP6P-5LPY
07/23/2024 11:40 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NAME=nim/meta/llama-3_1-8b-instruct
07/23/2024 11:40 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
1000
07/23/2024 11:40 PM UTC
sha256:b2241ad70a66b9dfa1d9f1a35b9f3e0f60fab9cdb36de854135fa2a5647d6f5fRUN
NIM_MODEL_NAME=meta/llama-3_1-8b-instruct NIM_MODEL_NAME_ENV=nim/meta/llama-3_1-8b-instruct NIM_VERSION=1.1.0 NIM_CONTAINER_NSPECT_ID=NSPECT-ZP6P-5LPY NIM_MODEL_NSPECT_ID=NSPECT-0DQP-LNLV NIM_TYPE=llm NIM_USER_ID=1000 chown ${NIM_USER_ID}:${NIM_USER_ID} /.triton
07/23/2024 11:40 PM UTC
...