Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

Layer	Label		Created
sha256:37219738f4648078e4e236b3c21f071d98db627646f682bb6b839dec7341a92a	COPY	`CONTAINER_LICENSE /opt/nim/LICENSE`	03/21/2025 6:15 AM UTC
sha256:6dc61860100852e790e232c8000c044d4b90cb775e2617be4e7081916f48a9c5	COPY	`./NOTICES/* /opt/nim/`	03/21/2025 6:15 AM UTC
sha256:c092274fcda4f15ffeba8a80a9f1429e7f0a9833f57be9655a8fa8aaec8748e8	COPY	`banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	03/21/2025 6:15 AM UTC
sha256:cee729a58d90bab881f8e2f34de485bee5e6930f3f906ecabbdbe77871fa881f	COPY	`MODEL_LICENSE /opt/nim/MODEL_LICENSE`	03/21/2025 6:15 AM UTC
sha256:a34e094aa51bdb41b57c9cd550dc9e13835c9a1203268ac01719cc3255079af7	COPY	`model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	03/21/2025 6:15 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	03/21/2025 6:15 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.2`	03/21/2025 6:15 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-L26U-IFIN`	03/21/2025 6:15 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-0JUQ-8PSN`	03/21/2025 6:15 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	03/21/2025 6:15 AM UTC