ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    Granite-3.3-8b-instruct
    Container
    NVIDIA
    Granite-3.3-8b-instruct

    NVIDIA NIM for GPU accelerated Granite-3.3-8B-Instruct inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    model.manifest.yaml=H4sIAAAAAAAC/+1Xy24jRwy8+yt080lyvx8CgiBA9phLfsAgm2ytYj2MGXmzyNenZEv7cuTsHoS9jGBDo5GG7GqyWVVje69buv+gw7je75azW7cwtzePw76vN3o/6kbbAV/ct2F90GFNyxk9HfY3273oZjlbDbTD/blf+Hnh+Xo3HoandrgZ8ByNupzZRVmEc7hxeTOfrWU5C72aIDHbrsn07kKqkaOqIwpOKJbGIZlcMtVUutVCpvZIWUty2RW5mc0OtEK4GV5d6XC/2Q9Y2m2nzai3z7c3m+297lbrHVbxAR+ebz4+4kf25QePg7b1C2juNj3fO3z6/u/98DA+UtNTkpflz55ff7777fc/3i22cr4xmz0N6+Vst2rLu7vdenu35u38tDd3F/Zo+b7PoxUJ3OZ4ZH5cw6/HNL98Cv8pOmrUHsanLVa6oQf1y9KTpIhtVNc9+26irVGdx7tvvVDsBTsXupOizNFEtZ2qi1qsc0n0FJlEVO4P+wfdjYu/RmzFVQC9SnMZmORiTVbDniQHFhLt1nhgrCa2ZLlG01oNvphIXXojPu5EZ3KOsk83X8cdF6e4V8H1bZbLsCzlmphaqZ1bJe+x4JpdD+ojk1HJpnusn73VVJLNreYUY+sZl9T7GdZ+19erK1bqiwSXwRiJysWGmHL1hTsqlZzJptjkvG9qQxIv4mzLmcRzj4VtLo685qbkTpFXutOBXobLtXH9d67LECs6UBQnhQkzSixmU2OW6lKxglHklBqJUXScR52cAq7Jlk1qxtdiT5G3Oqx0XBw+Hq4D63P8N0ZFE8GZSqRsYq6uo8csFl60ctKgaoIJx3nrKIothaOYamPCGAbskM9QjgN/bvCy831/vgiLkboecKj3w3glgP+T9Q3YJbVQK2Mw5KrR5VRYPBimNnFNXYzGBmouglJ6i54KF1zUXDRlENIr2O6nwHY/CDsocKkkQaXRorlbbzJ7LtWQZmIimwphunK1ElxxjBEaxLcSwLKVXsH2PwW2/0HYZDVGFBx0UIIH7TUbmgMPWolkCQRhvPps2DZqEvGZWvYOZJKDJ9dfwQ4/BXb4Qdhas0bOKTcQZQS7e5cyodupSlXOAZKAQzcu+1xiTVKCBfN4qZa5tfIl7C8zLtY70Y9XnMdvZXzjTFsLPUBoVgCSyKBRw8V0tDt0DWdWkzHDurA3tlQt4JzUba/leML5XOXxEcKPNidBcr+lxysivZDsMkhXJeHxSihk78kwpF6GCE7FOSi+5Jrt1qXEnGukYhtw4l891B/lcD7Bz/nW/+hwRWxf57gMKTtM4NiqKeJ7PGpT8pg90KmoINROSRjK9lgp9DDURbO2Jw91V0INkEzfQrq+XvjPVJcBcmPBWAnCBtSCvkTpqukZPQnhI42rsQLmbS1qqigqQSpEccFm50M8y/EPe8yvK6L6HP8N5cNZj92HssBZSIav8MIWvAIyMQq1U7IQZeOamCzdu2KEmB1shgDmyeHlToEipQI95I/dix1JVrSGClHYulBjKFvGREJTFFB1w4VD2Ws3gf11HZ6bHN7k8CaHNzm8yeFNDm9yeJPDmxze5PAmhzc5vMnhfbfDA5+wI5OKxkQR7sSkmLzxEVI391Ia/lgxmX1LoObOTgJBdVGHAM5M13V4YXJ4k8ObHN7k8CaHNzm8yeFNDm9yeJPDmxze5PAmh/cdDu9f/srLmBUqAAA=
    		06/12/2025 4:15 PM UTC
    sha256:b2730359db1c4793997f17b7a8e3b3bbfdeebb26bdc7aca1ac95076c6b94e2b2COPY
    CONTAINER_LICENSE /opt/nim/LICENSE
    		06/12/2025 4:15 PM UTC
    sha256:bfc27a2c0b1d01bb59185c540494971d51779b5d3e47486048113c31c2481c8fCOPY
    ./notices/* /opt/nim/
    		06/12/2025 4:15 PM UTC
    sha256:62c5d78aba9cac074e72fe8e05c789db231f0b8477030ce52bc3476449943d56COPY
    banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
    		06/12/2025 4:15 PM UTC
    sha256:381de4bb9c42db10f2729f422b5e65b4ea979f55bfc891a4d04c789a7bad43e3COPY
    MODEL_LICENSE /opt/nim/MODEL_LICENSE
    		06/12/2025 4:15 PM UTC
    sha256:b6ab99795d0d6d79267560a04f522b3623b3e84c821c7dbbb324ea457bd4f925COPY
    model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    		06/12/2025 4:15 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    TRTLLM_DISABLE_UNIFIED_CONVERTER=1
    		06/11/2025 5:56 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    		06/11/2025 5:56 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.4
    		06/11/2025 5:56 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_MODEL_NSPECT_ID=NSPECT-ZXZL-CJ7V
    		06/11/2025 5:56 AM UTC
    ...