ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    meta-llama-2-70b-chat
    Container
    NVIDIA
    meta-llama-2-70b-chat

    NVIDIA NIM for GPU accelerated Llama 2 70B inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:0c88b4680503b2352db5df6436a7d93bf3e2c6c945d8232fbe369d9a751b8266COPY
    ./CONTAINER_LICENSE /opt/nim/LICENSE
    		08/09/2024 3:26 PM UTC
    sha256:8171a51f9d331f5e82ec9ea703de187ba487cb9d7efa8bde70f714549019fc85COPY
    ./notices/* /opt/nim/
    		08/09/2024 3:26 PM UTC
    sha256:e2edd547228f47fad029a5bf5821cdc2f334427e7171e87697c79f7a878bade3COPY
    ./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
    		08/09/2024 3:26 PM UTC
    sha256:0ca8f9a4dff0cecdf05204a29e9afad07664fc993df2a9bd1716e566745e1d5bCOPY
    ./MODEL_LICENSE /opt/nim/MODEL_LICENSE
    		08/09/2024 3:26 PM UTC
    sha256:155e2b17d3245ed335895b678e5bfc0ce8ab813321d66912830cb66781d32a1fCOPY
    ./model_manifest.yaml /etc/nim/config/model_manifest.yaml
    		08/09/2024 3:26 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.0.3
    		08/09/2024 3:26 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_MODEL_NSPECT_ID=NSPECT-BI9O-PL8E
    		08/09/2024 3:26 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_NSPECT_ID=NSPECT-N4LQ-CZ77
    		08/09/2024 3:26 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_MODEL_NAME=meta/llama-2-70b-chat
    		08/09/2024 3:26 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    1000
    		08/09/2024 3:26 PM UTC
    ...