Phi-3-Mini-4K-Instruct | NVIDIA NGC

NVIDIA

Phi-3-Mini-4K-Instruct

Container

NVIDIA

Phi-3-Mini-4K-Instruct

NVIDIA NIM for GPU supported Phi-3-Mini-4K-Instruct inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:6e5b94d1325c07379a71f8cf97ca8aef5e48097f54b11af74b6a303a73294367	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	10/18/2024 1:29 AM UTC
sha256:389e070a116ab1e56e16143d92916e3985274417c608e934d70d8a66d854926b	COPY	`./notices/* /opt/nim/`	10/18/2024 1:29 AM UTC
sha256:43afb2f61afca4cebd089178e579735ffb59946451086f164046c3cf2c2b42ad	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	10/18/2024 1:29 AM UTC
sha256:c46d240fb3414c14b36eea61ea7a7c980ca93e8fd188890943e1a878752677b9	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	10/18/2024 1:29 AM UTC
sha256:3d70bb4dc7a15a8dfee4f338a9ee18a20526819640702738c20be1e02851bac2	COPY	`./model_manifest.yaml /etc/nim/config/model_manifest.yaml`	10/18/2024 1:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	10/18/2024 1:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.2.3`	10/18/2024 1:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-7S3F-QFG8`	10/18/2024 1:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-X37N-G0O5`	10/18/2024 1:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=microsoft/phi-3-mini-4k-instruct`	10/18/2024 1:29 AM UTC