Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	07/07/2026 12:49 PM UTC
sha256:c544730a5b57ecd72432e83e43c680125a92bde20b15e5d9af32bec3d8995bda	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	07/07/2026 12:49 PM UTC
sha256:19c707e57203ac551029525a4f1558f1a313e3f53a300a9a265cb9478bb6fc6b	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	07/07/2026 12:49 PM UTC
sha256:db9da614730c08a067d9871c4f2e0f5f34ef13a95eb63ada16f07d51fa22e685	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	07/07/2026 12:49 PM UTC
sha256:2a1cb2f8ecd577b4422d1aa8439b0c464ebf64f4b4cb3278c11a479dd61aabed	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	07/07/2026 12:49 PM UTC
sha256:0372ab1cf29f686b7a9e568ebd7ec57f0688e1d8132fb4de0d73ea31750f0ab5	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	07/07/2026 12:49 PM UTC
sha256:2a45451b9e4a236e21f485c568bb6727434d73fb6006c9fb80f39c41f226b141	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	07/07/2026 12:49 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.8`	07/07/2026 12:49 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	07/07/2026 12:49 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	07/07/2026 12:49 PM UTC