IQ4_KSS
#9
by
antolucib
- opened
Following up on the reddit discussion, any chance the IQ4_KSS quant could be made for the non thinking model as well?
Great, thanks for putting this here which makes it easier for me to find, I'll start cooking it and update the repo this morning before getting too busy!
Okay, the IQ4_KSS is uploading and also decided to upload the IQ3_KS as well which is a bit smaller but still pretty smort. Perplexity graph and README is updated, files will complete uploading shortly!