ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Llama-3.1-70b-instruct
Container
NVIDIA
NVIDIA
Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise SupportedNVIDIA NIM
LayerLabelCreated
1a0f21872631f92fa49daf19a3eed9eb851beced1d9c78fa1083700da561f274CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
09/19/2024 2:06 AM UTC
4864cbdd6650135f1ad0b108430fad158cce155fcf6ac4d14bfa23e495bdef8cCOPY
./notices/* /opt/nim/
09/19/2024 2:06 AM UTC
d44319ac51c337b8e1b7df5975765526c11b1aa7523492075ff50c1d05973787COPY
./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
09/19/2024 2:06 AM UTC
00ba1159e7fd8ea33e258a89108260e27ddb2042ff0c9eaacea785ce849b36c4COPY
./MODEL_LICENSE /opt/nim/MODEL_LICENSE
09/19/2024 2:06 AM UTC
ac45fb3d7a7d1d8904c2e969718f68bc1c17e8e570426ac510479c0bcfe2a63bCOPY
./model_manifest.yaml /etc/nim/config/model_manifest.yaml
09/19/2024 2:06 AM UTC
e60e7c07d8621116899d505e9146197c258c0be9df87bc44b8a9b7663444ac95ENV
NIM_HTTP_API_PORT=8000
09/19/2024 2:06 AM UTC
6094c63f14285be54e6b51a6563111de3624aaf4fad2c617d9ac5d7fd186b3abENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.2.0
09/19/2024 2:06 AM UTC
4d690a0eff1176863e4b0b881cb140930ef8ae866aed490c4e35790bcb6bc410ENV
NIM_MODEL_NSPECT_ID=NSPECT-7S3F-QFG8
09/19/2024 2:06 AM UTC
28add0444cbf108397bb106d8c79238d8f79f5e89fb017222a4473506e0841e9ENV
NIM_NSPECT_ID=NSPECT-X37N-G0O5
09/19/2024 2:06 AM UTC
3d62c753a25e8072a45d826c380593b61b12acf1894097cba66e20bee843856fENV
NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct
09/19/2024 2:06 AM UTC
...