looks like lama.cpp is not ready for it yet?
#1
by
kweg
- opened
I've runned q8 and it produces complete garbage.
Sorry to hear .
I’ve tested the q3 that worked fine. Will retest
Thanks for letting me know
Tested with latest LMStudio seems working for me.
Maybe try the latest llama.cpp and rebuild it.
