Mistral-Nemo-12B-Instruct | NVIDIA NGC

NVIDIA

Mistral-Nemo-12B-Instruct

Container

NVIDIA

Mistral-Nemo-12B-Instruct

NVIDIA NIM for GPU accelerated Mistral-NeMo-12B-Instruct inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:89ae4fc168c63a2f1c6a2140e0854304ff22bd8e61b76ebb96b2ec90c7f172fe	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	09/26/2024 12:18 AM UTC
sha256:a73d6284f646a625a0c5b746d7b8f1e197894b000da83496b3e73a33b3753719	COPY	`./notices/* /opt/nim/`	09/26/2024 12:18 AM UTC
sha256:91f5f82bbc6baab07ac137ab9f79befa3354752d5d486535e3f00efdbe57b23f	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	09/26/2024 12:18 AM UTC
sha256:872860e135313fbb014f782d43172476c70a9011dca759c10a75ccdb7a031e2b	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	09/26/2024 12:18 AM UTC
sha256:59cc0cb8f11d1bdc4cf5f78843bf1104867f9c239d498c29f2df040726cae66b	COPY	`./model_manifest.yaml /etc/nim/config/model_manifest.yaml`	09/26/2024 12:18 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	09/26/2024 12:18 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.2.2`	09/26/2024 12:18 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-4S80-N1A7`	09/26/2024 12:18 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-M3W8-KQNI`	09/26/2024 12:18 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=mistral-nemo-12b-instruct`	09/26/2024 12:18 AM UTC