Llama-3.1-8B-Instruct | NVIDIA NGC

NVIDIA

Llama-3.1-8B-Instruct

Container

NVIDIA

Llama-3.1-8B-Instruct

NVIDIA NIM for GPU accelerated Llama-3.1-8B-Instruct inference through OpenAI compatible APIs

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	08/27/2026 7:57 AM UTC
sha256:b187b6c68408db2f1c9c69dbda121857500f5141b918cc8a4bb70a8a9b6a2813	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	08/27/2026 7:57 AM UTC
sha256:e4fd1b2ab42545d7a5de309da7d47c5f93dd68ea79626a23dff65e744aafb362	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	08/27/2026 7:57 AM UTC
sha256:d7dfc7d17d049cd315e786989c586b995d415a97bc861791e525257e572a1960	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	08/27/2026 7:57 AM UTC
sha256:2f3beffef8b3c302ae90d0f54aaf32e4e427c3964486fde2f1eb6d57e343a5c4	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	08/27/2026 7:57 AM UTC
sha256:921e7bc284ba23201dc246bb5700c671686dbfb55c95e7aa9972e0623a44b7d6	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	08/27/2026 7:57 AM UTC
sha256:97039e283d1c9944d9dcd491d9779f001ea008ea0d8c8328865c678883a031f2	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	08/27/2026 7:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.12`	08/27/2026 7:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-8b-instruct`	08/27/2026 7:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	08/27/2026 7:57 AM UTC