ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Llama-3.1-70b-instruct
Container
NVIDIA
NVIDIA
Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise SupportedNVIDIA NIM
LayerLabelCreated
9ddce348b8d88e6e868da18091dd0b6f4bb5ece3188bc7b5a97c468c84de4e36CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /
04/30/2025 7:17 PM UTC
c095ff7865f22f80db88eb709d07d7790dea039f23ab204a2fc14edad6be5141COPY
./NOTICES/* /opt/nim/
04/30/2025 7:17 PM UTC
7538772fbc1dbe761899b858b773280855ccacb7f9e577cc06ac5a66d88a26f2COPY
banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
04/30/2025 7:17 PM UTC
5b33d8e5c5cf0315fc6ba2749d666eec2b1785fe2d5d84ef8400ab5c66319ef9COPY
MODEL_LICENSE /opt/nim/MODEL_LICENSE
04/30/2025 7:17 PM UTC
73dcc5aaad0e7b85af029b367d05ffdf4e836414a9504a150942afd9086a3d99COPY
model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
04/30/2025 7:17 PM UTC
e17c206cba91e7a3ac8d8a78014ab8342796e423fa117692259895d8f21f4a2fENV
NIM_HTTP_API_PORT=8000
04/30/2025 7:17 PM UTC
23a246cdc38c06704ac4949e6a290e6ec3a598dfb84456b4e0959c2f52de1a30ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.4
04/30/2025 7:17 PM UTC
dca33f41f577513e2117983870de7fb3cc965d179fda37e14c4e7f8989bcd4acENV
NIM_MODEL_NSPECT_ID=NSPECT-7S3F-QFG8
04/30/2025 7:17 PM UTC
8b38f72e7a32765a0581bcd90e27dd0068d8e7179702f51f76093340deaf8247ENV
NIM_NSPECT_ID=NSPECT-X37N-G0O5
04/30/2025 7:17 PM UTC
99fe9c11dfad787b037ed77ae9c7b19669469accee70a3cc9f728581db933f37ENV
NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct
04/30/2025 7:17 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.