Any Plan for imatrix release of Kimi-K2-Instruct-GGUF
Hi there, I would like to inquire if you have any future plans for imatrix release for this new kimi model
shimmyshimmerWait I misspoke - the quants are in fact all imatrix calibrated already!
I'm assuming you want the imatrix.dat file which is used for calibration purposes - I'll be uploading them as well in a while!
Wait I misspoke - the quants are in fact all imatrix calibrated already!
I'm assuming you want the imatrix.dat file which is used for calibration purposes - I'll be uploading them as well in a while!
Wait I misspoke - the quants are in fact all imatrix calibrated already!
I'm assuming you want the imatrix.dat file which is used for calibration purposes - I'll be uploading them as well in a while!
Yeap, many thanks!
Wait I misspoke - the quants are in fact all imatrix calibrated already!
I'm assuming you want the imatrix.dat file which is used for calibration purposes - I'll be uploading them as well in a while!
Hi sorry is IQ4_XS something that might happen in nonUD quant? Will nonUD quants be uploaded with unsloth?