Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:3751ba1ff38b94aa1844a1ce9c7ce7e14b222a1397b57f8937f7a1d3290d3926	COPY	`CONTAINER_LICENSE /opt/nim/LICENSE`	04/07/2025 10:31 PM UTC
sha256:3632a26ed94c6a1c63f7061a30831ef5c1d35a2ed15dcdd936df218e58f1e936	COPY	`./NOTICES/* /opt/nim/`	04/07/2025 10:31 PM UTC
sha256:85d6188378336ce472fcf442e0bc169ca1778559aa21e7b9f533c1482b3ef83d	COPY	`banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	04/07/2025 10:31 PM UTC
sha256:23aab22c536e2661b497923c9cde4b3c928b9958d46c07fd9212fe6e381cbe96	COPY	`MODEL_LICENSE /opt/nim/MODEL_LICENSE`	04/07/2025 10:31 PM UTC
sha256:a53a605af4c442bbcc34661c0874055b75cee3fc1e0080850f3e2429c7c6f0c2	COPY	`model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	04/07/2025 10:31 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	04/07/2025 10:31 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.3`	04/07/2025 10:31 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-L26U-IFIN`	04/07/2025 10:31 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-0JUQ-8PSN`	04/07/2025 10:31 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	04/07/2025 10:31 PM UTC