Llama-3.1-Nemotron-Nano-8B-v1 | NVIDIA NGC

NVIDIA

Llama-3.1-Nemotron-Nano-8B-v1

Container

NVIDIA

Llama-3.1-Nemotron-Nano-8B-v1

NVIDIA NIM for GPU accelerated Llama-3.1-Nemotron-Nano-8B-v1 inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:a6b61163a0740b50710dd41d8d201236917aac2556a1149b026114141d55817e	COPY	`CONTAINER_LICENSE /opt/nim/LICENSE`	05/29/2025 4:16 PM UTC
sha256:d144ed7717b9d9a97f86865939b4629de9d16c313ef66444e230464f7107fe0f	COPY	`./notices/* /opt/nim/`	05/29/2025 4:16 PM UTC
sha256:f678be7ab3528d1b126a9edcf3a8dd963800ee8d19a462080faa4b4ddfe9c7b0	COPY	`banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	05/29/2025 4:16 PM UTC
sha256:d95732a2d46e609e47a5bbe80229cfa8fbf3bd9e9671cb03d78dfd7c0d88218a	COPY	`MODEL_LICENSE /opt/nim/MODEL_LICENSE`	05/29/2025 4:16 PM UTC
sha256:a2e1d7d1662d84199b1e0fac168dd4d80b3612e25e5ff85f41b3f1aec0bdad13	COPY	`model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	05/29/2025 4:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	05/29/2025 4:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-KZF6-2OL5`	05/29/2025 4:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-CNS2-2J2H`	05/29/2025 4:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=nvidia/llama-3.1-nemotron-nano-8b-v1`	05/29/2025 4:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NAME=nvidia/llama-3.1-nemotron-nano-8b-v1`	05/29/2025 4:16 PM UTC