ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    Llama-3.1-Nemotron-70B-Instruct
    Container
    NVIDIA
    Llama-3.1-Nemotron-70B-Instruct

    NVIDIA NIM for GPU accelerated Llama-3.1-Nemotron-70B-Instruct inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:dc45fbbeed3fd7f4dcb217646c8e7b100ed33a7eb9d0838065596c16a4e496d3COPY
    ./CONTAINER_LICENSE /opt/nim/LICENSE
    		11/15/2024 2:37 AM UTC
    sha256:7fdf476ab4aecf20ff5a043df10cfff87eb3eaf7fb4d2e0910f9bdf167c0b191COPY
    ./notices/* /opt/nim/
    		11/15/2024 2:37 AM UTC
    sha256:00e4138739f229a9d336a017be4440b9078dcfc18d687b90d975d77d4d2d739eCOPY
    ./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
    		11/15/2024 2:37 AM UTC
    sha256:0ae6204eba8951a5d9460b4d207d8549542406fd7d3adb6ca1e3cc35a76498d5COPY
    ./MODEL_LICENSE /opt/nim/MODEL_LICENSE
    		11/15/2024 2:37 AM UTC
    sha256:9c557631ce3c1e8e6585cf0f9daff698b9976b9d32d389f31adb217acd508387COPY
    ./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    		11/15/2024 2:37 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    		11/15/2024 2:37 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.2.3
    		11/15/2024 2:37 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_MODEL_NSPECT_ID=NSPECT-K25U-C4Y5
    		11/15/2024 2:37 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_NSPECT_ID=NSPECT-UV9M-U6IJ
    		11/15/2024 2:37 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=nvidia/llama-3.1-nemotron-70b-instruct
    		11/15/2024 2:37 AM UTC
    ...