ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    Llama-3.1-70b-instruct
    Container
    NVIDIA
    Llama-3.1-70b-instruct

    This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

  • LayerLabelCreated
    sha256:9f2e637704171fd3be99443d5a636ee507afb6829d3967444f52b2d29f43c9b3COPY
    ./CONTAINER_LICENSE /opt/nim/LICENSE
    		09/19/2024 2:06 AM UTC
    sha256:23206310d60add44e8c7c9ce16d64ba3054bf4438efd14659680e8cb613029a3COPY
    ./notices/* /opt/nim/
    		09/19/2024 2:06 AM UTC
    sha256:bb19df910a21700cddb4e6e22d3c3868a74c562ab80f0bfd640c73aa6138480eCOPY
    ./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
    		09/19/2024 2:06 AM UTC
    sha256:262746fb9146fb51169d6d44a7d92b10abbb7034e7e4938c796cb8a93f3c6183COPY
    ./MODEL_LICENSE /opt/nim/MODEL_LICENSE
    		09/19/2024 2:06 AM UTC
    sha256:eecda1af886b1175b443aae91401d0d91a48f9822df16e9a41eb14c96c0ec8c8COPY
    ./model_manifest.yaml /etc/nim/config/model_manifest.yaml
    		09/19/2024 2:06 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    		09/19/2024 2:06 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.2.0
    		09/19/2024 2:06 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_MODEL_NSPECT_ID=NSPECT-7S3F-QFG8
    		09/19/2024 2:06 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_NSPECT_ID=NSPECT-X37N-G0O5
    		09/19/2024 2:06 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct
    		09/19/2024 2:06 AM UTC
    ...