Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	05/06/2026 2:48 PM UTC
sha256:21c11306fb8b7c2325e9d444f141484e2eda65c3ac032cdb299e979359a96dac	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	05/06/2026 2:48 PM UTC
sha256:abd91b1bd6c6e5c1cfc60bb639b3a612b1a03fdc97cad3510fdb6b1be7e14a81	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	05/06/2026 2:48 PM UTC
sha256:4a319dedbe786ca1cadfa742efbdcdaaa754794ecaf05fb07be41563b4794e8d	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	05/06/2026 2:48 PM UTC
sha256:3cbdc32312231698ba78236c281a1a5c7137304170d05d9256118fa00001b8e2	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	05/06/2026 2:48 PM UTC
sha256:60e789750dc18981231f8c7c2a2f567d30b6eb88ab0f8dbdf917c23c228e052c	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	05/06/2026 2:48 PM UTC
sha256:f0bfda4f3e5a070e8e7b3dacbdd93c78eb4a2c4e3601ca08971a5a3e20d002b1	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	05/06/2026 2:48 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.4`	05/06/2026 2:48 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	05/06/2026 2:48 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	05/06/2026 2:48 PM UTC