Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	08/05/2026 4:53 PM UTC
sha256:ee6635e1f35f3df142c4cf410a72b1cdbf06208718793e0ee606206ea5ed5cad	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	08/05/2026 4:53 PM UTC
sha256:5628e482df09636586a0ec8efce002e6302bc08205ce924d4ff23719cc3e31ab	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	08/05/2026 4:53 PM UTC
sha256:06544a7ef2c40346a9e9954e3563b71c3f9e380beb531b80d8a04c0ecdd15798	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	08/05/2026 4:53 PM UTC
sha256:c1174fd6635117f40902d439a2c468541e138cc77043e272e906bfbfbd445b6f	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	08/05/2026 4:53 PM UTC
sha256:3f6f09f94634830a6799c2a3bad00787393c37ad9038e6ac92e3a22e9e03c9e0	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	08/05/2026 4:53 PM UTC
sha256:70b7db6ecd63f48fa624058284dee076d41036adc6dac23dcc4faf96b077fd9a	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	08/05/2026 4:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.10`	08/05/2026 4:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	08/05/2026 4:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	08/05/2026 4:53 PM UTC