Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	06/02/2026 4:18 PM UTC
sha256:fa8fe85792dee0a7a05155b778dc4f3e4784ddf1ea6f93fec55f452486c7e919	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	06/02/2026 4:18 PM UTC
sha256:e2275cc5cb4208a30278be4705482ccec604682e41239528ec1571115cb76e97	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	06/02/2026 4:18 PM UTC
sha256:03c14594288837b4b323d245b00f178f31939fcb0315307999057de716312d81	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	06/02/2026 4:18 PM UTC
sha256:6894d77664ca01761321c8bcc8a8551df8e215ca5c152b4cf37c82d5636ff77f	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	06/02/2026 4:18 PM UTC
sha256:2f56368509072f33b02763a8b4f406f360e27d9e01b347c4ca4b66938e9d885e	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	06/02/2026 4:18 PM UTC
sha256:12ba39b62d1d8b92e505b4c2d8ca22e8354f5d4215383c4aaa837ab5467a9e79	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	06/02/2026 4:18 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.6`	06/02/2026 4:18 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	06/02/2026 4:18 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	06/02/2026 4:18 PM UTC