Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	03/25/2026 6:55 PM UTC
sha256:40011c3aa86118ecb313178efadb731c156c054e326a3662ef19b833f7e86b04	COPY	`--chown=nim:nim NOTICE_1 /opt/nim/NOTICE_1`	03/25/2026 6:55 PM UTC
sha256:fdfe07218b968a90ab82a373a0bda502601bcdca28fefffcc5933d5b324cc36d	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	03/25/2026 6:55 PM UTC
sha256:335b38cd3008bfade90a63758a695d0d161a1194b344eb88a3a422cd10021d04	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	03/25/2026 6:55 PM UTC
sha256:5e04abb14f697ed7d07a0c3a7dda60f3d6f44377ca7a3fc99d2f903087761501	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	03/25/2026 6:55 PM UTC
sha256:6386dad853e37b6e66f0c65da99bef08064076b6df2da919eb6cf4612a72b639	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	03/25/2026 6:55 PM UTC
sha256:024e5a838fd2a71c1d7774fb22e37d9c1497804245b193b24f98c61812d8e76e	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	03/25/2026 6:55 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.1`	03/25/2026 6:55 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	03/25/2026 6:55 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	03/25/2026 6:55 PM UTC