Gemma-2-2B-IT | NVIDIA NGC

NVIDIA

Gemma-2-2B-IT

Container

NVIDIA

Gemma-2-2B-IT

NVIDIA NIM for GPU accelerated Gemma-2-2B-IT inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:aa75b7a216d7c2b4c57de4f9cdcfa78d7ab05fb0f96d81b62b984c7e3e15cc9c	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	12/20/2024 3:20 AM UTC
sha256:90b29af04be176e2678d3b82272fdca72bfe835a4e98e2a6bbe5a77500417b43	COPY	`./NOTICES/* /opt/nim/`	12/20/2024 3:20 AM UTC
sha256:af6c91bd53f20a1c3b4113b9d20c59200e367df8dd722119422938f5b07421ca	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	12/20/2024 3:20 AM UTC
sha256:f6513fa6255b1bc5cfda1138577a14b8e29a94b38fced6c3672b60e2004c3b3a	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	12/20/2024 3:20 AM UTC
sha256:1f46662516ee8f96f383567dcedba0b3386cb37ca873a240f2ef37532fb88c0e	COPY	`./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	12/20/2024 3:20 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	12/20/2024 3:20 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.4.0-21687078`	12/20/2024 3:20 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-5SAV-46MA`	12/20/2024 3:20 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NAME=google/gemma-2-2b-instruct`	12/20/2024 3:20 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-KJW1-GJ9G`	12/20/2024 3:20 AM UTC