ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Llama-3.1-70b-instruct
Container
NVIDIA
NVIDIA
Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise SupportedNVIDIA NIM
LayerLabelCreated
sha256:997de7abac9520994b002ad719e49f2e77cde7462f57ba2513b1def71695ffe4COPY
./CONTAINER_LICENSE /opt/nim/LICENSE
08/13/2024 10:07 PM UTC
sha256:0d2c0de87d6ebba7aef29092b55df0d98a92756316a20b865d4869570082e90cCOPY
./notices/* /opt/nim/
08/13/2024 10:07 PM UTC
sha256:ee22616aab78e0b46bbcf321f7b1edc7adac6c7e3865e78d3db7ffe041c13c46COPY
./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
08/13/2024 10:07 PM UTC
sha256:66d3f1c479f81040b7701d52487a35e0e7692d4483f9be164b17d0f6dddd0364COPY
./MODEL_LICENSE /opt/nim/MODEL_LICENSE
08/13/2024 10:07 PM UTC
sha256:4ded0260a86be26737ae5175bb2657d3f13e82efc39f6e00a21e83d398483b72COPY
./model_manifest.yaml /etc/nim/config/model_manifest.yaml
08/13/2024 10:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.1.2
08/13/2024 10:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NSPECT_ID=NSPECT-7S3F-QFG8
08/13/2024 10:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_NSPECT_ID=NSPECT-X37N-G0O5
08/13/2024 10:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NAME=nim/meta/llama-3.1-70b-instruct
08/13/2024 10:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
1000
08/13/2024 10:07 PM UTC
...