ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    Meta/Llama3-70b-instruct
    Container
    NVIDIA
    Meta/Llama3-70b-instruct

    NVIDIA NIM for GPU accelerated Llama 3 70B inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:f721f9a05e8880a6bd188623be1e15b51a8e0e0b38b8d0a50770f1ee86bf6095COPY
    file:77d3791b576d75c3ffc896ab5a7139e587d2ebc230550674c9f365b6186d75be in /opt/nim/LICENSE
    		07/20/2024 4:26 PM UTC
    sha256:86126fe13b390b2aa81a6bb61179676df751956d947ea67061519f51481c7e55COPY
    file:0f6908d217e61234c0b9348b98aca1160eddc05e06d35825d961d6f09a4bf8e7 in /opt/nim/
    		07/20/2024 4:26 PM UTC
    sha256:21a7a4327628602ffd545884afc324a4e8d82ee156a52623ecd9fab9971e905dCOPY
    file:56423af901722f43fab2a90e8f1090883cfbdce03b7f5851381107d32820d2d1 in /opt/nvidia/entrypoint.d/31-model-license.txt
    		07/20/2024 4:26 PM UTC
    sha256:33bdafd997dcb4d3f4fc52059eb9e66be84731cf4ef076a7ff93241639630d88COPY
    file:4542d800434a3158aaec31588492554010553b6206e1ecb47e122c3fb19b64e4 in /opt/nim/MODEL_LICENSE
    		07/20/2024 4:26 PM UTC
    sha256:4002605908ca1fbf06b03e978a44931db84b24f2319152c32537b8946ffbc977COPY
    file:cc601f1fa2911468631a72fd8583cd75cac4098bb775310becfb4b1e08db5821 in /etc/nim/config/model_manifest.yaml
    		07/20/2024 4:26 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_MODEL_NSPECT_ID=NSPECT-8JJD-ZCD1
    		07/20/2024 4:26 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_NSPECT_ID=NSPECT-MB5F-LVUL
    		07/20/2024 4:26 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_MODEL_NAME=nim/meta/llama3-70b-instruct
    		07/20/2024 4:26 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    1000
    		07/20/2024 4:26 PM UTC
    sha256:b7856f70275d66ea20d5186c695856ccca171147084347e1836dc07632ae9800RUN
    NIM_CONTAINER_NSPECT_ID=NSPECT-MB5F-LVUL NIM_MODEL_NAME=meta/llama3-70b-instruct NIM_MODEL_NAME_ENV=nim/meta/llama3-70b-instruct NIM_MODEL_NSPECT_ID=NSPECT-8JJD-ZCD1 NIM_TYPE=llm NIM_USER_ID=1000 NIM_VERSION=1.0.1 chown ${NIM_USER_ID}:${NIM_USER_ID} /.triton
    		07/20/2024 4:26 PM UTC
    ...