Q4_0, Q4_1, Q5_0, Q5_1 can be dropped?
#1
by
CHNtentes
- opened
Since we already have the K quants, I don't think there's much benefit to keep the "traditional" quants, and they might cause confusion.
I think they're still good to have for testing things since they're simpler than the K quants. Q4_0 is also faster so it still has it's uses. The _1 quants are less useful I guess but might as well keep them at that point.
I want to update the readme for all of these at some point so it has the model sizes and maybe an example image for each quant but yeah, idk when I'll get the time for that.