Llama-3.3-70b-Instruct

NVIDIA

Container

NVIDIA

Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

Layer	Label		Created
sha256:aec57aa84c208ac45d411a0142c80114c4d6671d7c6e08ea9334c9d23e8566d2	COPY	`CONTAINER_LICENSE /opt/nim/LICENSE`	03/22/2025 2:57 AM UTC
sha256:92123511c048f3a3aa8a1a2871a7471eb0cb9c661a92822ad8faf929bf3d2bb8	COPY	`./NOTICES/* /opt/nim/`	03/22/2025 2:57 AM UTC
sha256:db1fc0c07cf19715642f5dfa0d79c11309f0960cff1b3a94961d8eb0df8c9a57	COPY	`banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	03/22/2025 2:57 AM UTC
sha256:ffb0c1da2342b330618b5b3578bc42f3cc70ceeedcf54a0065216ee65d1e5b2f	COPY	`MODEL_LICENSE /opt/nim/MODEL_LICENSE`	03/22/2025 2:57 AM UTC
sha256:384a7dfe96e1e40a774f098a327dae442a39d83adbe91039b5b50eb0cbec4015	COPY	`model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	03/22/2025 2:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	03/22/2025 2:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.3`	03/22/2025 2:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-L26U-IFIN`	03/22/2025 2:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-0JUQ-8PSN`	03/22/2025 2:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct`	03/22/2025 2:57 AM UTC