Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	05/19/2026 1:59 AM UTC
sha256:d78ae0f3f42050c730fce55a2d96c65da62e88053e6cb1e9dd1befb1b6ef99e0	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	05/19/2026 1:59 AM UTC
sha256:6ad3a9c3fede4666407bc0e14724a613ad3f2334dcbe999286b12424f6182c12	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	05/19/2026 1:59 AM UTC
sha256:72410bd208b322961cc3062fc2e55836be493cb077287adc02d363467fad4ebb	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	05/19/2026 1:59 AM UTC
sha256:8c9ed5ef05d4cafffce079cb7aa31ec48de88b08b4fbcc7d8ff18224a4323503	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	05/19/2026 1:59 AM UTC
sha256:8c228ea0a782723da9e1d5cb5ecbb4bd8f5aac43b3152420bd686bd2180a95ee	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	05/19/2026 1:59 AM UTC
sha256:1235fb297126e352ce681f0da4d72ff23099a87656468c720acc6d99f50d56a8	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	05/19/2026 1:59 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.5`	05/19/2026 1:59 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	05/19/2026 1:59 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	05/19/2026 1:59 AM UTC