ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Llama-3.1-70b-instruct
Container
NVIDIA
NVIDIA
Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise SupportedNVIDIA NIM
LayerLabelCreated
8516248c9755d067a350d33ba23a3cf35fe382b076f82a76a3fa406055313e7dCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /
12/12/2024 7:15 PM UTC
a6294642a6603c306503300980d86a92e4baa0f803cca92a7e3260223418f121COPY
./notices/* /opt/nim/
12/12/2024 7:15 PM UTC
1a6bd61612c854aeeaa6c01cf83349ecd15ec292e5512a9569d0bd2c7c78b5f7COPY
./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
12/12/2024 7:15 PM UTC
3c78d9b52748aed82da7a5645e2a84631a77342dc95e367ccabeee41db361c65COPY
./MODEL_LICENSE /opt/nim/MODEL_LICENSE
12/12/2024 7:15 PM UTC
9ddc7160edbf2cc2ed66fee1f502eb666624d88912ca80e2b1bed7cf7d54ae3fCOPY
./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
12/12/2024 7:15 PM UTC
f3da99e2716210cdbf4f1740a71d89a6d9e2f55aac3a859a14f6542c5b922f83ENV
NIM_HTTP_API_PORT=8000
12/12/2024 7:15 PM UTC
e9ceefefb3e61d9562f5dd15caa364b5cc1e0b9054901599f973a6f2732f91cfENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.3.3
12/12/2024 7:15 PM UTC
45c35ef46715debd68e454b5e284376c41bee619fe01305c20159d797bd800feENV
NIM_MODEL_NSPECT_ID=NSPECT-7S3F-QFG8
12/12/2024 7:15 PM UTC
98cff9b7eea78bfdb62c876e96fdf040eacdd39e13dfc2d37c6f03f85ea77f65ENV
NIM_NSPECT_ID=NSPECT-X37N-G0O5
12/12/2024 7:15 PM UTC
fa7bf24c61336527e9a5b4724e5ba39305cb81473442103ce9dd4c2415e4987eENV
NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct
12/12/2024 7:15 PM UTC
...