ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    Mixtral-8x22B-Instruct-v0.1
    Container
    NVIDIA
    Mixtral-8x22B-Instruct-v0.1

    NVIDIA NIM for GPU accelerated Mixtral-8x22B-Instruct-v0.1 inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:76d80bc18340367a8a64828cbdd6bc4aa3c1b54c65451828966fb0974e1c3d30COPY
    file:00936f17cd3d26500fc891cf3103bf474d605df8beb601e92237841f230c1df6 in /opt/nim/LICENSE
    		07/14/2024 6:00 PM UTC
    sha256:1c173f7e199a44b179da7856ff22155a8d37f8ce775fb948eecb814d0cd5d7c0COPY
    file:c2b3750e1481e920bd859c440a31bed7737f4dbd4c20de387881036f675b90a6 in /opt/nim/
    		07/14/2024 6:00 PM UTC
    sha256:2ad43301a385a35ebd3db8dc282cec0bd8a3c2e01592b3225376741dafafb32eCOPY
    file:4eb98c9f6e0b8a2df47fca7705b2d3235ec0e6288fca1a0ae075b90ddcc76d9c in /opt/nvidia/entrypoint.d/31-model-license.txt
    		07/14/2024 6:00 PM UTC
    sha256:3e5c7b4d79a9b8552a6f2ce5710d84a23e75cfc2a2f70d5e9e6ae0c446c48ce8COPY
    file:b1a94a899bd2619a12854c704ddafc6ed38e6b21814b6b5f7d6dd68449d8b80b in /opt/nim/MODEL_LICENSE
    		07/14/2024 6:00 PM UTC
    sha256:eaccfb18e5299da2aad94e9e9bda9d2f25ef34b85d780244a773749b1a0646bbCOPY
    file:3bee21e32bd6259c7e051d9ae760dec82be5cff33c7b362c2f15e7d7f45c06d2 in /etc/nim/config/model_manifest.yaml
    		07/14/2024 6:00 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_MODEL_NSPECT_ID=NSPECT-XQ2Z-Q0R7
    		07/03/2024 6:37 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_NSPECT_ID=NSPECT-2TVL-X3EK
    		07/03/2024 6:37 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_MODEL_NAME=nim/mistralai/mixtral-8x22b-instruct-v0.1
    		07/03/2024 6:37 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    1000
    		07/03/2024 6:37 PM UTC
    sha256:b82383c0a5f432706605b426c6df34f51177db6057544ad71100c6c705797031RUN
    NIM_CONTAINER_NSPECT_ID=NSPECT-2TVL-X3EK NIM_MODEL_NAME=mistralai/mixtral-8x22b-instruct-v0.1 NIM_MODEL_NAME_ENV=nim/mistralai/mixtral-8x22b-instruct-v0.1 NIM_MODEL_NSPECT_ID=NSPECT-XQ2Z-Q0R7 NIM_USER_ID=1000 NIM_VERSION=1.0.0 chown ${NIM_USER_ID}:${NIM_USER_ID} /.triton
    		07/03/2024 6:37 PM UTC
    ...

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.