ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Llama-3.1-8B-Instruct
Container
NVIDIA
NVIDIA
Llama-3.1-8B-Instruct

NVIDIA NIM for GPU accelerated Llama-3.1-8B-Instruct inference through OpenAI compatible APIs

NVIDIA AI Enterprise SupportedNVIDIA NIM
LayerLabelCreated
sha256:50b42eddb500de072c64750e0886925c12d77ccbc396a87d19e88aea3816d3f3COPY
./CONTAINER_LICENSE /opt/nim/LICENSE
08/13/2024 10:07 PM UTC
sha256:30a1e8a7ae038ad9cd1622a88e81333023d7fec0568777b7cc7f438b92db3988COPY
./notices/* /opt/nim/
08/13/2024 10:07 PM UTC
sha256:dd5066bd0b4a59cddb1a496a682c9f3e2e892ba2d4276cc5858dc0d7d82d74c4COPY
./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
08/13/2024 10:07 PM UTC
sha256:cf8a5f8c91c7334e8f4f84d9d188bc39e2273917214caa4b866201c827896709COPY
./MODEL_LICENSE /opt/nim/MODEL_LICENSE
08/13/2024 10:07 PM UTC
sha256:da91e163544aaa1d67e4e2c58a694cd5ea857f8b37351d5f69ddd09c828d47d9COPY
./model_manifest.yaml /etc/nim/config/model_manifest.yaml
08/13/2024 10:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.1.2
08/13/2024 10:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NSPECT_ID=NSPECT-0DQP-LNLV
08/13/2024 10:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_NSPECT_ID=NSPECT-ZP6P-5LPY
08/13/2024 10:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NAME=nim/meta/llama-3.1-8b-instruct
08/13/2024 10:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
1000
08/13/2024 10:07 PM UTC
...