Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	04/07/2026 7:32 PM UTC
sha256:470d6c9e5f508149e5f5c52232a0d9dc14e1998ef00668aa0c74d7b9cabb6294	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	04/07/2026 7:32 PM UTC
sha256:967df04d44ce29e05192caadf614e7d1930d56b87ffd38e8c24dee90a2dd4be0	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	04/07/2026 7:32 PM UTC
sha256:34b28db79ca93806ebcd059675eb91cd21e8c0e8c6cac7402584dc458670070a	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	04/07/2026 7:32 PM UTC
sha256:cac2487fd0bcec890bf0450c58e18634aee52fa8f341fda800feb9dff478c3f5	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	04/07/2026 7:32 PM UTC
sha256:9bf3265650418f542adb479334a5b9bb71802a5ceaca3d60861f93f94a405598	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	04/07/2026 7:32 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.2`	04/07/2026 7:32 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	04/07/2026 7:32 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	04/07/2026 7:32 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-L26U-IFIN`	04/07/2026 7:32 PM UTC