Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a04b7939b7db3c96e1f486ada346a51c7e6825792baf320580e7b451e7e235c3	COPY	`CONTAINER_LICENSE /opt/nim/LICENSE`	05/29/2025 4:11 AM UTC
sha256:0e5eb628652edb59d3171bf276509174b12011b1564fc3b1d123021a610b9893	COPY	`./NOTICES/* /opt/nim/`	05/29/2025 4:11 AM UTC
sha256:7eb41317a6227aa44c8bb646f17d0a271cf3a9b124ddb37e89f1037f39d0b386	COPY	`banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	05/29/2025 4:11 AM UTC
sha256:97e95be4f83de2e40b6576a5214370d6f71b5f3ba881b0a58a846d66082687fd	COPY	`MODEL_LICENSE /opt/nim/MODEL_LICENSE`	05/29/2025 4:11 AM UTC
sha256:a56c0b68f99fdece60b80762846addcc64e21e8968bc96fc44fb27a7eab52eff	COPY	`model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	05/29/2025 4:11 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	05/29/2025 4:11 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.4`	05/29/2025 4:11 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-L26U-IFIN`	05/29/2025 4:11 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-0JUQ-8PSN`	05/29/2025 4:11 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	05/29/2025 4:11 AM UTC