Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	04/20/2026 5:25 AM UTC
sha256:28b0bde536904f738f227bcb2117f03e28a5d4994784ab2f7a94b8fc2838367e	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	04/20/2026 5:25 AM UTC
sha256:2dbeca6e8da53f5c6820693ba48f9490a678b3b6fe366fc81ae925f00d66d23a	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	04/20/2026 5:25 AM UTC
sha256:8ea22c12d93a439d6f1b1b8e33885bc1e74f5a6b0691f8c47de27eef887a45ef	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	04/20/2026 5:25 AM UTC
sha256:ffc142e4580344fbc09d90cfaddd16a6bc130697fbf151c5716a7deb8c510749	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	04/20/2026 5:25 AM UTC
sha256:b273566864e94ed6776d6a98e2f01b7adad1724bcff637177b620d8c46d65d2d	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	04/20/2026 5:25 AM UTC
sha256:97d1f66110ed8e7a0636ad68b432e039e3bbc0b72c32768ed98cbe1c8da3652e	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	04/20/2026 5:25 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.3`	04/20/2026 5:25 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	04/20/2026 5:25 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	04/20/2026 5:25 AM UTC