Mistral-Nemo-12B-Instruct | NVIDIA NGC

NVIDIA

Mistral-Nemo-12B-Instruct

Container

NVIDIA

Mistral-Nemo-12B-Instruct

NVIDIA NIM for GPU accelerated Mistral-NeMo-12B-Instruct inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:35009ef2cc4e2fb7101cf93abfb83f4adde517f14b4cc4bf27c719f4f78c1ee8	COPY	`CONTAINER_LICENSE /opt/nim/LICENSE`	05/16/2025 7:17 PM UTC
sha256:3d2c649cea4ac482a71a0fe4a2f3eb69c605bf6a9626eb824e7a710af0ae013c	COPY	`./NOTICES/* /opt/nim/`	05/16/2025 7:17 PM UTC
sha256:ab3fe665677edb19a1392529711dc0e4c81c8773bfa40c1f56ac70f3f79bc68b	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	05/16/2025 7:17 PM UTC
sha256:31e0aedac0c04a38b093338c0cea5bebb8438dec7bca10e8b972935386f761a1	COPY	`./CONTAINER_COPYRIGHT /opt/nvidia/entrypoint.d/15-container-copyright.txt`	05/16/2025 7:17 PM UTC
sha256:02db4238e8311b3beb16910c584cbde6f7010a25c479a5e35fff123b6f440ded	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	05/16/2025 7:17 PM UTC
sha256:50c93a61fcaf156c3a3459b0e2ae4231ea8da0c3398f22f5555197b1197db2dc	COPY	`./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	05/16/2025 7:17 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	05/16/2025 7:17 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.4-rtx`	05/16/2025 7:17 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-4S80-N1A7`	05/16/2025 7:17 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-M3W8-KQNI`	05/16/2025 7:17 PM UTC