Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	07/22/2026 3:13 AM UTC
sha256:3678653353228f70e594a7fecf54ba2a5e154a3f9d9e8e75407007212ef7af6c	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	07/22/2026 3:13 AM UTC
sha256:5ef400274363ad3796041ef3d57d416d82b4f6ef40312ee983bac1bba5c4028d	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	07/22/2026 3:13 AM UTC
sha256:e1697414798f415e407287ac9486fe45640b04e7d2ffaadb936fd32d08ef9902	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	07/22/2026 3:13 AM UTC
sha256:c671a4d078729e638000f37e46cc894eea36985ac25700c8f2e257e9a3f33df1	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	07/22/2026 3:13 AM UTC
sha256:184153fda0ede07a627634069e523dd922375363e11ad3e65dbf3d44e530b332	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	07/22/2026 3:13 AM UTC
sha256:66908e834f5da73a0157054bc323df5a85f8afac43237c76caaba75ea2ae6e04	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	07/22/2026 3:13 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.9`	07/22/2026 3:13 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	07/22/2026 3:13 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	07/22/2026 3:13 AM UTC