nemotron-4-340b-instruct | NVIDIA NGC

NVIDIA

nemotron-4-340b-instruct

Container

NVIDIA

nemotron-4-340b-instruct

NVIDIA NIM for GPU accelerated Nemotron-4-340B-Instruct inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:33d29835f8127f37d53e3abe8c1fd272788477c6b28ccc6c90394432ee522d3b	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	08/22/2024 8:27 PM UTC
sha256:9ff8830da305145a426b463be47e6006f30a8534803160f1446dfda4459d70f5	COPY	`./notices/* /opt/nim/`	08/22/2024 8:27 PM UTC
sha256:a0cd623d6f5d70a61024689bafa437aa551600221b69d8caa743c8a578e626fe	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	08/22/2024 8:27 PM UTC
sha256:1bfc429f066a75691db861d34e161f5dba7bc436351cdce5289de7a2c0685b2d	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	08/22/2024 8:27 PM UTC
sha256:3a395232c9608c276c079e9d63363d5d46490c8b72fc19eb3bd3e7566b1a3927	COPY	`./model_manifest.yaml /etc/nim/config/model_manifest.yaml`	08/22/2024 8:27 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.1.2`	08/22/2024 8:27 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-TQGJ-6SM5`	08/22/2024 8:27 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-0BKP-31SV`	08/22/2024 8:27 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=nvidia/nemotron-4-340b-instruct`	08/22/2024 8:27 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NAME=nvidia/nemotron-4-340b-instruct`	08/22/2024 8:27 PM UTC