Bad numbers in the “gzip beats BERT” paper?
Can anyone explain to me how a compression algorithm can beat an LLM at anything? Isn’t that like saying horses are better than graffiti?I’m sure the answer is in there somewhere but I’m not well versed in AI and I simply can’t figure it out.