Llama-3.1-8B-Instruct | NVIDIA NGC

NVIDIA

Llama-3.1-8B-Instruct

Container

NVIDIA

Llama-3.1-8B-Instruct

NVIDIA NIM for GPU accelerated Llama-3.1-8B-Instruct inference through OpenAI compatible APIs

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	04/20/2026 5:16 AM UTC
sha256:c4c6aaf8f33dbf68250e4e748b791b8d7b651f42ec489b7fd95ab69f6788e550	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	04/20/2026 5:16 AM UTC
sha256:d2b427498b43566c00d642eaf38cb514f3124d358eb9b5d64e813859825cf35f	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	04/20/2026 5:16 AM UTC
sha256:d12d0d2905c95acf129462c5a969ea5d5e2c0610fb3da8b3e3c8eec1abf369ac	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	04/20/2026 5:16 AM UTC
sha256:671446fb56a8de48f1275d2f0982cc5373c50a5761ada52219dc86b16579cff7	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	04/20/2026 5:16 AM UTC
sha256:108ac932cd7806e99864eb72b2f53efecdbbabe3d67afd7855df18f12d53e9d7	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	04/20/2026 5:16 AM UTC
sha256:d3d593e0942a2af1baa831a9c0140ac5cd4c60dedb51f621b9cd6693d46dab7b	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	04/19/2026 3:51 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.3`	04/19/2026 3:51 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-8b-instruct`	04/19/2026 3:51 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	04/19/2026 3:51 PM UTC