NVIDIA
NVIDIA
Llama 3.1 NemoGuard 8B Topic Control
Container
NVIDIA
NVIDIA
Llama 3.1 NemoGuard 8B Topic Control

NVIDIA NIM for GPU accelerated Llama 3.1 NemoGuard 8B Topic Control inference through OpenAI compatible APIs

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
model.manifest.yaml=H4sIAAAAAAAC/+2Z224jOQ6G7/MUvsuV05RInQIs9lEMSiIznvgQ2E7PYJ9+6RxmZ6c72Q2m475hwRd2VVmsX6LI70cdxy+y5dVXORzX+93t4jrewPXVw2Gv642sjrKRcbILq3FYn+Sw5tsFP572V9v9lM3tYrPhLS/xJix3st3fPfJhLmtfnvYP67Ec+93psN9cHWwQPsrtItwEuAmvgx9vr5aL9bTTs/QMpBWTFiotSO46KyFQ0QHAiUVBS2yJBlMd0jLWELRnRYV2tVic+M6GW9ihwqfVZn+wB71W3hzl+un0ZrNdye5uvbPHOMnuuD8c7LbN9uniw4PdHJ5vfDjIWD9PRdeQn86dztfr8/XT4XQeqz+uN5P7xoa7Ph0en6L8tj/cHx94yMuTPGtcPB02y+P++Lg93vQN3wu+nl8sHg/r28Xubtx++bJbb7/svq7nmr/8PxN7GyHSMoRlqMtf5bQcv9wft/88h/3HX8P9Ee31gql7fo6pZfQZsVIeNEpCZQZomWeyU20GrXyeeeiJUXvtsdpCQci5pl7LeNW33+n67ubXo03cJ0v7T6S3VY3cW2koIaUphRIi2K+mljnEVSlqK1OTMFEw7VNmaq0Ka5wEivQy8p3s5MDP+X8xgd8P+rbW2GKsg1sdFChXjEwl9RJrSjVkCJ1S7UVGqUElCteoMRQoyjiwlv4y8tOOXoIdYbnXpy90c2SV5+1y/GTV/yv82/qlaMqFMWfgmmKMY4BY+bDlLEQYsAfQIDimaAASk8ypz0YxdRpZvtEff67++EH9oUKI3NIc3XTGzJS6jt57hFJbKxJTEpMqEEfo0GOaE/NsaWijFuc3+vHn6scP6s8B2kxltDk4lMpcSdO0Pc2Mkq2UDWRLgzxqTBJKs+nCGUVmwMSs3+Y//Vz99EH9UCPAyC10y3GcGKc1yzQi9zmAIwshVp22DSb0GtAyBcKMvWJhyhP+rP/PEW/Wuym/X6LivRf6bd1UGQENGBJnaVHGtKUuBGNaHcg9YueZSamXVCCVDmw7PrQRyP71jA3n4/hgDZ83q9P+3oKvtvxwCclvRH1nl4Ogla6SAydrwDyLNbFuzbq0YnserKCjkVLGVFICtCJIpKGr9i6M9LrKT/HW/5LDJUT+d7B3dvDI1sGsFIUcURuqGN0NbIWG9axufS1NU66IZ1UwiURsqWcT+0DOf9V2wWb93ZjvrGKGjl2AMcFI1LQlnRqta6c4pxWwocUoq5eZEilIL1rFElk6piBp/KF0v1k9HuUl6OprvIzW70Z9hy0LTFMSbQUj5MlWda3hhqQQbOVCoYyYI8caSpbCJacYuPRKMc8inV/8ARbrbaBac7AMMLyxJOnSRK16WWGznmf7HLDjsIrfq5yj1hS4Nh0N5ryMP4juD9wfuD9wf+D+wP2B+wP3B+4P3B+4P7iAPyBtQFbhDV+y2YRoWJp6EolsO3pyqqNTtl5XuOVqnb4yNE1cpOZoGPRhf/D1Q74gOPo7+jv6O/o7+jv6O/o7+jv6O/o7+v8Y9Ld5otzBIKaJ9Szr93Gmce6USF0t08V2dVXzAqFHwhEYKnXAar3P0ipd5tUA+asB9wfuD9wfuD9wf+D+wP2B+wP3B+4PLuAPjFSIbZPXAedKFjKL5jDFulcpNmOTRy/Dyp31/ImGQW3Yl6gZmwJ1/NxXA9HR39Hf0d/R39Hf0d/R39Hf0d/R39H/x6A/D6SabCasw037l6FpNOqnSFWjGrOVYATLgCllwh6HBmowQaUUI9R4mVcDwV8NuD9wf+D+wP2B+wP3B+4P3B+4P3B/cAF/MCp1w/9cJWVOtoUhW56bHRDLCq112KdL4Iwjl1y1G8SxJQZb18/W7D/31QA5+jv6O/o7+jv6O/o7+jv6O/o7+jv6/xj0t0kysg80LQHmzDlggKSWD/Pc96HYYNinlUGMtVbr7RwVEiVubVqfj5+L/tXR39Hf0d/R39Hf0d/R39Hf0d/R39H/76L/vwEPgbaH6WAAAA==
08/06/2025 6:13 PM UTC
sha256:6d57e29643321f4f5785e7f164156c77920577e3a72d2c380c3d850b6075a786COPY
CONTAINER_LICENSE /opt/nim/LICENSE
08/06/2025 6:13 PM UTC
sha256:05e585bfb9ca86354f09f973b79874f29a970b018ee5f2c52ad6efdc0944fc35COPY
./notices/* /opt/nim/
08/06/2025 6:13 PM UTC
sha256:75f7b555a9d598b1a8ca0b6f09515bb4daf62ebba111e7a7463d42c6b43b491fCOPY
banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
08/06/2025 6:13 PM UTC
sha256:d074018730f220344a26d8393d41fe8f194047fa817457787d9251fb789ad9ffCOPY
MODEL_LICENSE /opt/nim/MODEL_LICENSE
08/06/2025 6:13 PM UTC
sha256:30ed123db758006c48f0bc8900ff55c7c87a7ecfe20f896757fecd9381c8e42aCOPY
model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
08/06/2025 6:13 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_HTTP_API_PORT=8000
07/15/2025 2:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_SERVED_MODEL_NAME=nvidia/llama-3.1-nemoguard-8b-topic-control
07/15/2025 2:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NAME=nvidia/llama-3.1-nemoguard-8b-topic-control
07/15/2025 2:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.10.1
07/15/2025 2:19 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.