Mistral-NeMo-Minitron-8B-Instruct | NVIDIA NGC

NVIDIA

Mistral-NeMo-Minitron-8B-Instruct

Container

NVIDIA

Mistral-NeMo-Minitron-8B-Instruct

NVIDIA NIM for GPU accelerated Mistral-NeMo-Minitron-8B-Instruct through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:0831f9a90c4835308e7ab7a2773224081fc4862b6822fced534c8d16d713f3fc	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	10/22/2024 5:36 PM UTC
sha256:2e73aadf3b62c0944ea727bd317b7f5d595d1627ded27d3fffaed80cd38af495	COPY	`./notices/* /opt/nim/`	10/22/2024 5:36 PM UTC
sha256:673279bb41f48c1ffbeb965e31525123230bdc8181303b176091bae7ed26b8b4	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	10/22/2024 5:36 PM UTC
sha256:5b1ce31caa553be5da9b8ae49cfdc278f4b825464bd98dd4908e0d0ebecb5389	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	10/22/2024 5:36 PM UTC
sha256:87b841a517011507205d36037128b9cccb0e64da6cba1d1b6b75b1efc02ab92d	COPY	`./model_manifest.yaml /etc/nim/config/model_manifest.yaml`	10/22/2024 5:36 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	10/22/2024 5:36 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.2.3`	10/22/2024 5:36 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-F82C-8NVS`	10/22/2024 5:36 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-OE7P-KPHM`	10/22/2024 5:36 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=nv-mistralai/mistral-nemo-minitron-8b-8k-instruct`	10/22/2024 5:36 PM UTC