Llama-3.1-Nemotron-70B-Instruct | NVIDIA NGC

NVIDIA

Llama-3.1-Nemotron-70B-Instruct

Container

NVIDIA

Llama-3.1-Nemotron-70B-Instruct

NVIDIA NIM for GPU accelerated Llama-3.1-Nemotron-70B-Instruct inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:dc45fbbeed3fd7f4dcb217646c8e7b100ed33a7eb9d0838065596c16a4e496d3	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	11/15/2024 2:37 AM UTC
sha256:7fdf476ab4aecf20ff5a043df10cfff87eb3eaf7fb4d2e0910f9bdf167c0b191	COPY	`./notices/* /opt/nim/`	11/15/2024 2:37 AM UTC
sha256:00e4138739f229a9d336a017be4440b9078dcfc18d687b90d975d77d4d2d739e	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	11/15/2024 2:37 AM UTC
sha256:0ae6204eba8951a5d9460b4d207d8549542406fd7d3adb6ca1e3cc35a76498d5	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	11/15/2024 2:37 AM UTC
sha256:9c557631ce3c1e8e6585cf0f9daff698b9976b9d32d389f31adb217acd508387	COPY	`./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	11/15/2024 2:37 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	11/15/2024 2:37 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.2.3`	11/15/2024 2:37 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-K25U-C4Y5`	11/15/2024 2:37 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-UV9M-U6IJ`	11/15/2024 2:37 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=nvidia/llama-3.1-nemotron-70b-instruct`	11/15/2024 2:37 AM UTC