llama-3.1-nemoguard-8b-content-safety
Llama 3.1 NemoGuard 8B Content Safety
Container
llama-3.1-nemoguard-8b-content-safety
Llama 3.1 NemoGuard 8B Content Safety

NVIDIA NIM for GPU accelerated Llama 3.1 NemoGuard 8B Content Safety inference through OpenAI compatible APIs

LayerLabelCreated
sha256:b073fe9d89687587e74c5ec7c7d57e98b3029b2896bc3c43daf5ce68b2a84ddfCOPY
./CONTAINER_LICENSE /opt/nim/LICENSE
01/15/2025 3:26 AM UTC
sha256:ffe01b1feca3af2b38eca55635adbcc69c33f5ada69d44d8900be290304657e8COPY
./notices/* /opt/nim/
01/15/2025 3:26 AM UTC
sha256:d91cc525573370e8d17547b22ef10a46fbeb8e33e5ddd0ddc85b37537e7ab6bbCOPY
./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
01/15/2025 3:26 AM UTC
sha256:53d1e3e84a352a12deddb37afe44b55cd3ddb823a9cb65c4ade1472f8c613e6cCOPY
./MODEL_LICENSE /opt/nim/MODEL_LICENSE
01/15/2025 3:26 AM UTC
sha256:6c1330ffcd0ce0773ac4b96c86af50571da7c598e2c8e0c7786bd35ac213cf97COPY
./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
01/15/2025 3:26 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_HTTP_API_PORT=8000
01/15/2025 3:26 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.3.0
01/15/2025 3:26 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NSPECT_ID=NSPECT-P4MZ-W9DC
01/15/2025 3:26 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_NSPECT_ID=NSPECT-GGJ6-2UDB
01/15/2025 3:26 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_SERVED_MODEL_NAME=nvidia/llama-3.1-nemoguard-8b-content-safety
01/15/2025 3:26 AM UTC
...