ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Llama-3.1-8B-Instruct
Container
NVIDIA
NVIDIA
Llama-3.1-8B-Instruct

NVIDIA NIM for GPU accelerated Llama-3.1-8B-Instruct inference through OpenAI compatible APIs

NVIDIA AI Enterprise SupportedNVIDIA NIM
LayerLabelCreated
sha256:24f8e5e4c543b675b769c9f7449a4a6b7305a1867ef17e17a19805d2d0a21de2COPY
./CONTAINER_LICENSE /opt/nim/LICENSE
11/18/2024 10:51 PM UTC
sha256:72b9acb49e649adf89d89b247bfef34b4e6423ab8fd384a9cdb6b854af81e1e1COPY
./notices/* /opt/nim/
11/18/2024 10:51 PM UTC
sha256:6c406256fa0d5b9a8eb350ed64b6d1473c06a644e1c5b9246ef856875b270251COPY
./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
11/18/2024 10:51 PM UTC
sha256:2731a6084af1303445498ab25026b2d105a7d508d9c1d3774985a8ad4ada01bdCOPY
./MODEL_LICENSE /opt/nim/MODEL_LICENSE
11/18/2024 10:51 PM UTC
sha256:5928b0146d74e41bbf168acb8faa03dd1f7159f3ca643810992121d3be0f0b3eCOPY
./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
11/18/2024 10:51 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_HTTP_API_PORT=8000
11/18/2024 10:51 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.3.0
11/18/2024 10:51 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NSPECT_ID=NSPECT-0DQP-LNLV
11/18/2024 10:51 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_NSPECT_ID=NSPECT-ZP6P-5LPY
11/18/2024 10:51 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_SERVED_MODEL_NAME=meta/llama-3.1-8b-instruct
11/18/2024 10:51 PM UTC
...