Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	06/23/2026 9:16 PM UTC
sha256:912b627fdce440d813fb0f371bdbb242372fe3213cad622b19aad5ca7be24114	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	06/23/2026 9:16 PM UTC
sha256:91529c171ea697ed5875310a3517fb3c1b318a0f4d8a7679dbcecd52e4ef39b0	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	06/23/2026 9:16 PM UTC
sha256:929b2aed43a6ef905384f608d0da68283da2a4de40855ba17724c20b484c54e5	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	06/23/2026 9:16 PM UTC
sha256:88fd5a7056884ff83399e5fff24fd623b567998dbbc76959dede6b143170c03c	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	06/23/2026 9:16 PM UTC
sha256:013440afeb1343e15c25a67b7e462aeaf45623be94ed6f7fc8805e466c414575	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	06/23/2026 9:16 PM UTC
sha256:b0eebc8e4a688bd0da75cddb7ce4f8deccfaf1721aed96313d3483b7ffd0f6af	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	06/23/2026 9:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.7`	06/23/2026 9:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	06/23/2026 9:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	06/23/2026 9:16 PM UTC