Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:f193bca26c45441d7d4ffdf6bcf5f156d31e38bee0232791ac7e1e587aec79d9	COPY	`CONTAINER_LICENSE /opt/nim/LICENSE`	01/31/2025 2:51 AM UTC
sha256:107a4a7694bb819093c854e50defb2bfcbbe709649740e5d5783c23a6e1d9452	COPY	`./notices/* /opt/nim/`	01/31/2025 2:51 AM UTC
sha256:bfba6517c742308ad2ab9f25ed37f88e60d9ec15f3aa435931585bad375ccf71	COPY	`banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	01/31/2025 2:51 AM UTC
sha256:af1c0cfa31c0b7dfb9eaea15513cb880b0bb4c956e1693e1b95979bfdb034d83	COPY	`MODEL_LICENSE /opt/nim/MODEL_LICENSE`	01/31/2025 2:51 AM UTC
sha256:402a31155c8ecf7ed5c3b719d3e28a8330ab1798525c4735ef1f7a6613ef97ae	COPY	`model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	01/31/2025 2:51 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	01/31/2025 2:51 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.5.2`	01/31/2025 2:51 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-L26U-IFIN`	01/31/2025 2:51 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-0JUQ-8PSN`	01/31/2025 2:51 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	01/31/2025 2:51 AM UTC