ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Llama-3.1-70b-instruct
Container
NVIDIA
NVIDIA
Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise SupportedNVIDIA NIM
LayerLabelCreated
5ee2776f9d6b81d058de248be1fb6e37ab07231562ef00a74574a9453f3ab064CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /
06/26/2025 7:07 PM UTC
8c96c42ddb99254ba93178e6c1825e3dbd20605d000d2aa1ed9e840cbd34e743COPY
CONTAINER_LICENSE /opt/nim/LICENSE
06/26/2025 7:07 PM UTC
0a4ed9bfc19aa345f76cc49d9a82720fef9053b1bf44d760651ecebf6ab76a45COPY
./notices/* /opt/nim/
06/26/2025 7:07 PM UTC
7dd36d04561b9732c28df6fc06ab442220fb16d026e4d8195f37a8816daabc1eCOPY
banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
06/26/2025 7:07 PM UTC
0ad916fa17f7c9331ad29c07bdf76ed5d6302c14509392de8d582860046c4addCOPY
MODEL_LICENSE /opt/nim/MODEL_LICENSE
06/26/2025 7:07 PM UTC
66d5fac753d18dd92157d219ee38fdc4b741b97340a068169ee5782d5a5f3528COPY
model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
06/26/2025 7:07 PM UTC
1ebc68af334d6015b42740699c5ff1e072382d6149a06403e3381843f8e9cd12ENV
NIM_HTTP_API_PORT=8000
06/26/2025 7:07 PM UTC
76a1a5f8b331ae867e50a3c6764951f9dd7bd762db0627c64e2e1f1585b374d7ENV
NIM_MODEL_NSPECT_ID=NSPECT-7S3F-QFG8
06/26/2025 7:07 PM UTC
e0defac9c9de6afd31ed3a13d57eeeaef6d752b4047dc9916fed81591aafa02bENV
NIM_NSPECT_ID=NSPECT-X37N-G0O5
06/26/2025 7:07 PM UTC
753187b7f80ee6247910dbce75c26051850e92f55ebe94891983d9fbd1a1904cENV
NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct
06/26/2025 7:07 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.