So qat-Q4_0.gguf supposed to be good?
I wish someone could explain how this is better. I have bunch of test questions and compared qat Q4_0.gguf to previous non qat gguf, just original gemma-3-27b-it-Q4_K_S.gguf. On some questions qat Q4_O fails 30-50% of time. For example the question i'm about to share, Q4_K_S always 100% answers correctly, while qat Q4_0 only sometimes...
"I have 10 apples. I find 3 gold coins in the bottom of a river. The river runs near a big city that has something to do with what I can spend the coins on. I then lose 4 apples but gain a gold coin. Three birds run into my path and drop 6 apples each. I play an online game and win 6 gold coins but I have to share them equally with my 2 teammates. I buy apples for all the coins I have. The price of an apple is 0.5 coins. How many apples do I have? And where is the river?"
It should be 36, Q4_K_S never fails.