kakaocorp/kanana-1.5-15.7b-a3b-instruct

#1207
by mingyi456 - opened

https://huggingface.co/kakaocorp/kanana-1.5-15.7b-a3b-instruct

I am interested in testing moe models that are smaller than the qwen 3 30b-a3b model, due to the possibility of fitting into cpu-only setups with limited amounts of ram, or even on phones after a more aggressive quant.

It's queued! :D

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#kanana-1.5-15.7b-a3b-instruct-GGUF for quants to appear.

Sign up or log in to comment