Llama 3.1 NemoGuard 8B Topic Control | NVIDIA NGC

NVIDIA

Llama 3.1 NemoGuard 8B Topic Control

Container

NVIDIA

Llama 3.1 NemoGuard 8B Topic Control

NVIDIA NIM for GPU accelerated Llama 3.1 NemoGuard 8B Topic Control inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:292e4370e58312c9da76a3e58c15fc03f368ce024e862a39338880cddeeffd4b	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	01/15/2025 2:04 AM UTC
sha256:8c64c6c1012a8056b54894dedb80b1a9f5026bdce1a78e610570259d35927858	COPY	`./notices/* /opt/nim/`	01/15/2025 2:04 AM UTC
sha256:465f7469edf251d3c9192c19302e2d918f3367d929a5b01a0ad6a84db610b891	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	01/15/2025 2:04 AM UTC
sha256:2cee07ea0a9993b6e332667c093f4b46d864d43654be1a62e279c433aba2343a	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	01/15/2025 2:04 AM UTC
sha256:c9bc9350a7db82d968499be738091bbc72e38381495c2cc0211859bc415b2cb9	COPY	`./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	01/15/2025 2:04 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	01/15/2025 2:04 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.3.0`	01/15/2025 2:04 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-2KSN-LBNL`	01/15/2025 2:04 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-JVBW-NXEI`	01/15/2025 2:04 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=nvidia/llama-3.1-nemoguard-8b-topic-control`	01/15/2025 2:04 AM UTC