Llama-3.1-8B-Instruct | NVIDIA NGC

NVIDIA

Llama-3.1-8B-Instruct

Container

NVIDIA

Llama-3.1-8B-Instruct

NVIDIA NIM for GPU accelerated Llama-3.1-8B-Instruct inference through OpenAI compatible APIs

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:06875b10b08babb5fce6233ad6a4785168b8ddff0f947c1d6275d3180981f977	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	04/30/2025 6:32 PM UTC
sha256:6967975365eff32da3aff7f5d4248ecef318b2bd356bcfd08195054606b15617	COPY	`./NOTICES/* /opt/nim/`	04/30/2025 6:32 PM UTC
sha256:423a9948201286c3d666a5eee90b35dad29f442231b348f49b64d34c88759762	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	04/30/2025 6:32 PM UTC
sha256:7773dcd13101c513aefc7cc311e610b96c34c55699db821cf59671a0fc8a213c	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	04/30/2025 6:32 PM UTC
sha256:784efbd7e37ced6f91ec84a4d6a4eec7d52b4d179104ca7874cb457f034cdaf9	COPY	`./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	04/30/2025 6:32 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NAME=meta/llama-3.1-8b-instruct`	04/30/2025 6:32 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	04/30/2025 6:32 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.4`	04/30/2025 6:32 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-0DQP-LNLV`	04/30/2025 6:32 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-ZP6P-5LPY`	04/30/2025 6:32 PM UTC