NVIDIA
kanana-1.5-8b-instruct-2505
Container
NVIDIA
kanana-1.5-8b-instruct-2505

NVIDIA NIM for GPU accelerated kanana-1.5-8b-instruct-2505 inference through OpenAI compatible APIs

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
model.manifest.yaml=H4sIAAAAAAAC/+2a224byRGG7/0UvAl0RanPBwFBsEgcIECSi+QBiOruKi1XFEkMKSebp89PSvLKXlO7urBB20UJ0Igz0139T3UdPsyu/8h3tHjH0265WV/PLtyluXiznTayXPFixyvue5xY9Gm552lJ1zO632/e3G0Gr65nt7TGz9xexnlp8+V6t5/u+37uoolvJtxLO76e2UtrLu3TmLvrN/PZcuDrkVsyQYqPkkOullOTUYI3IUs3hiKxGMmuxtAplM41+WKttCReTH0zm+3pBsPN8BGm/WK1mWDfhdBqxxfHr1eruwWvb5ZrmLHn9W4zTbhsdXc8ud3iYvtw4XbivnxQoIlNx+/2h/Pl4fx+2h/GavfL1aC2wnAXWOpxlv9sptvdljo/WvKwxtnx8/e//fntP//99unf2ex+Wl7P1jf9+upqvby7uqVb2vTNtL16QcnrH2XesXaKEiSFmnoOVWowKZAzzXvjSjOjVbF1jlHn+81m1Wm1mm9X91j7nw4m/fHRlPeW4Ln32939HRa8olv212xyToPI2WwhPLVmmw29uM5cIluhkXz3TD4kMq2Q7y0OLwkPqHMMjyP/6+0Pf/nH28u7cQ6Lfm/M6WVTiaaFxNbTsCEUYx2HdHDKOpp3g2TkwsPnSkVyDT30WClAhF6Nr/Q4Mu12vN9drTY3m6dlHY4vt+ubcxDiwbw/uL8ejMKfj0w8LU8MLkmPo1IMVHMg70I0korxJddBKblkxVjs12CoR4gyBtmciKnR8B/Ks+VJNtMdrTs/X/NEgyas/OzUembvL6J9bPELvhUi0ZDka7S5+25qcqGlJMNlgkPhREvWhwrbfBjD5JiqDM6NTMQNv1+8r0y5l2UztcYRY+NmnOdgMhVLxhSCV/kUfU6WcRxLO4QjE5y30aSEOFWd994+jtw3a1neXP60Q1Q/A2memXN66YWk1e5Ny9ICSUrBjjJKcqM2xKAi1lUXSjKtD+ca9mTq2Ge5imQKlB9HvuE1T/SQuM9LhU9bdlqQjhBTEtlSGkdXRnS2xJCNkeBzbDUg9gTLDTsHNjWL3TZCE2nkIo32lJWO9crc4GPnGzkehMsdCT9UBbtzkOa3bDwt0sjGWSMFf6iMUbIlG1NLdZjODkk7UQodeQw+VRNFh+SeRoORlOBkvxbJfQUiuVeKVDyxN54wS4Q79WjZo+6ESWVgNGuxjSRHE6zrMSZBJO4+dxHjJcT3mewXA/xXIJJ/pUgVc6OkK4dc5StqPM8pwa+G+JRids6EgUq9ITrD3DJsHFSIrLdVfE3tVyKFr0Ck8EqRAmcUP8OmGqBCcsWGEVjiQA3EpicaxTSIOAajRO4RezJ7dDLVdvG+fOBJz2e8XK4H//dsQvVL9r2QvKOlkpCIDbo0sb56uEhlCbWHUEs1NWdG92ApIs9llIs4n7IpwUnFrnscebdFQ0arxX5zi8kXd7Q9G11OmHZaEpuRzpGcDBol54pBPkeGQnAuOblueuSY0W1l162FAsnHeog6Sax0Ke4pPB/nW/6Pp7NR4kOLTgvgYkWwMN16jw7BiqDb8myPKQmRGJ1DQWyu6L66mE6UjG3ITrhu5CYhfSzAuRU1nzTstBwNhSoj/fYUkx8oZLvDpumHfYCCt6PGaSnk5vMY1ozKqHBMQNZKhi0O/Hs5NqvFwZbl+maxpWmH+R+supL79RHb0PTz4p1frFZ0RwtvF8dbHi693P58HtKdWgTaht+3jBeKx0PTEATNg0TnAiM4W3GpF28q+nwJjpDoshUfLBpZtBeuiOcBizvXPJ4Lfb/jx6e7eOfOyPM+adppScSXhPmQ0VNEsEFTWlD0jNwzp4y+3RtGPnfZoKswo6PD9wOW+U5CjiU/wjvU3qMbkZIOe9oRejBpfAjzaRSBgG6kYHzDfeRbYcyXyyEzoKg6EIIvA++cwjuFdwrvFN4pvFN4p/BO4Z3CO4V3Cu8U3im8U3in8E7hncI7hXffH7wLUlEJREjHyYi4kGpskdkRBTcolt5CMrlk1JtoWjCmqRIpM1qZjDL+tfDu3augnVUup1xOuZxyOeVyyuWUyymXUy6nXE65nHI55XLK5ZTLKZdTLqdc7pvkcjHUkJopLVfuUjmLG7EfqjKP6tv1zpCwCLOzzeFuPIISmvGlZi69xi/zUl3Ql+oU3im8U3in8E7hncI7hXcK7xTeKbxTeKfwTuGdwjuFdwrvFN59f/AuC7qNiNK8G2Q0sWj3JdnBNSC8U5dBHf5NbZRQhi/9EP3LcIdWWExo/vO+VOeUyymXUy6nXE65nHI55XLK5ZTLKZdTLqdcTrmccjnlcsrllMspl/smuRx1H0rMUkZvw+ZAcNpQc0BvIk5IXLZtODIelVTwzXWxAaHeCOdccndf5qU6qy/VKbxTeKfwTuGdwjuFdwrvFN4pvFN4p/BO4Z3CO4V3Cu8U3im8+/7gXS9IfWRS4Yh6MtpqDr5sfMSOzYI9jd/GFh1uTzkVaW6g9GRDYjFPo8/7Ul1QLqdcTrmccjnlcsrllMspl1Mup1xOuZxyOeVyyuWUyymXUy6nXO6b5HJS0Z5Z5D0ktDESmlhromR0thHDQFIeviHAOe+wwymiHBcT0Q7XOtqo7vNyuaJcTrmccjnlcsrllMspl1Mup1xOuZxyOeVyyuWUyymXUy6nXE653DfG5f4P3VNY6sidAAA=
07/23/2025 4:21 AM UTC
sha256:799431b15b7c8c702c8f718083ce9a41b3f423801e7ea6109f73129bfa350fffCOPY
CONTAINER_LICENSE /opt/nim/LICENSE
07/23/2025 4:21 AM UTC
sha256:bc69c17b98ddf18c79b0e8dfca4580afa16ffc8ce4ba26d2918fdbc9332db9c3COPY
./notices/* /opt/nim/
07/23/2025 4:21 AM UTC
sha256:d196f406eff8343dd3dec7adb7f1298e4787efffa13158a95bea2b536e3b113aCOPY
banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
07/23/2025 4:21 AM UTC
sha256:ed603a359e4f93b8208d5626770b03bab1005c4aa9cac328094d1d305b2cb8baCOPY
MODEL_LICENSE /opt/nim/MODEL_LICENSE
07/23/2025 4:21 AM UTC
sha256:7e2dabf3e745b3acd2b4c077c3f1f2ae56a89e867492ca0e66f685a689869e17COPY
model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
07/23/2025 4:21 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_HTTP_API_PORT=8000
07/18/2025 6:08 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_SERVED_MODEL_NAME=kakaocorp/kanana-1.5-8b-instruct-2505
07/18/2025 6:08 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NAME=kakaocorp/kanana-1.5-8b-instruct-2505
07/18/2025 6:08 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.10.1
07/18/2025 6:08 AM UTC
...