Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:424bda0f863cd5f0229e06a39c3f9250245dde2615e8d3900e7f72ba0376c4df	COPY	`CONTAINER_LICENSE /opt/nim/LICENSE`	01/17/2025 8:34 PM UTC
sha256:0368882bd9bffa292671e261ff37f97ed68e28a8fe279ed1b7e23ed92bbbb85e	COPY	`./notices/* /opt/nim/`	01/17/2025 8:34 PM UTC
sha256:8dbff8bcb85239b541abe5fa9b8437e3639596647cd8752da40dfd3fdf871767	COPY	`banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	01/17/2025 8:34 PM UTC
sha256:f7866b8a8a9d6489c9d658e3fe26a7cc91afcdc3ef68962269d19de7c64f85f4	COPY	`MODEL_LICENSE /opt/nim/MODEL_LICENSE`	01/17/2025 8:34 PM UTC
sha256:691b6767bf30e52aef374ee3c62cebab0fd39a0516a9652dddac564d4d16e29e	COPY	`model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	01/17/2025 8:34 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	01/17/2025 8:34 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.5.0`	01/17/2025 8:34 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-L26U-IFIN`	01/17/2025 8:34 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-0JUQ-8PSN`	01/17/2025 8:34 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	01/17/2025 8:34 PM UTC