Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:7e910081f72388309ade73a00aced73e380873df8aba50fd9c7573bdbc0dffcf	COPY	`CONTAINER_LICENSE /opt/nim/LICENSE`	01/17/2025 10:09 PM UTC
sha256:de41213ebd6b3481d6c98b5514726122f5c78c841873493fd3b08c3c90a61bd6	COPY	`./notices/* /opt/nim/`	01/17/2025 10:09 PM UTC
sha256:0472106c5d0b4fd1c82339af874b78f755794ec55f91310eb1ad17aa92bb490a	COPY	`banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	01/17/2025 10:09 PM UTC
sha256:5c19d4978482d4de1be005c2b2ff3c2f6735271a3f328980299d4c4ae47807b1	COPY	`MODEL_LICENSE /opt/nim/MODEL_LICENSE`	01/17/2025 10:09 PM UTC
sha256:7036944b4941960d92fec91331b7fa70fa9c17eeef948b97bbb0722ecf90d62b	COPY	`model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	01/17/2025 10:09 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	01/17/2025 10:09 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.5.0`	01/17/2025 10:09 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-L26U-IFIN`	01/17/2025 10:09 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-0JUQ-8PSN`	01/17/2025 10:09 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	01/17/2025 10:09 PM UTC