ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Llama-3.1-70b-instruct
Container
NVIDIA
NVIDIA
Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise SupportedNVIDIA NIM
LayerLabelCreated
6153dc4cfab23fc8c7776e6ccb88e2199faab35f479e0030aac59c5fd7f7287dCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /
04/17/2025 1:31 AM UTC
2d17380da6bd32a06e354a04af4e48464fd36b16d821b57473e8dc6c8398c730COPY
./NOTICES/* /opt/nim/
04/17/2025 1:31 AM UTC
59ed4f632e11710b637c6bf5cf5b754cb378666e9d7317df062e344544b2339bCOPY
banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
04/17/2025 1:31 AM UTC
fed153a9edbc1de1032ce8ce3429cbdbcc7f1bcb53f132d57139fce507f97242COPY
MODEL_LICENSE /opt/nim/MODEL_LICENSE
04/17/2025 1:31 AM UTC
0d08d24f3c6ffc64e2e05c91d41fcfaf214329a67b7d95b6dccd4a5b69c931fbCOPY
model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
04/17/2025 1:31 AM UTC
c4e984de44f76bbafc479d751c304fa06fdebdb4fd6c4ad6f0687bedd801109aENV
NIM_HTTP_API_PORT=8000
04/17/2025 1:31 AM UTC
bb96bf980c0ee04f7e7be44aefec9dbce0cbd4c6e0557d45ee918ee54767e13cENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.3
04/17/2025 1:31 AM UTC
20f06637604e815aa5fb236b351cce5af6548dc964f1f321a61eff66fee7ba10ENV
NIM_MODEL_NSPECT_ID=NSPECT-7S3F-QFG8
04/17/2025 1:31 AM UTC
e5468e8708fa2bc05c477ec06df007b389e7693577061c50e36f970cd7fd2206ENV
NIM_NSPECT_ID=NSPECT-X37N-G0O5
04/17/2025 1:31 AM UTC
68287fecac3191f5b36377b11ac573046d7c1118daaf021a47177f6bbd97d46fENV
NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct
04/17/2025 1:31 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.