Natural language benchmarks don’t measure AI models’ general knowledge well
I&#x27;m always amazed that some people think performing statistical analysis (training neural networks) on text can lead to actual intelligence and knowledge about the world, if only we increase the number of model parameters by a few more orders of magnitude (GPT-3 and the likely strategy for GPT-4).<p>Of course, all this without any model of how likely it is that the knowledge is embedded in the text, such as trying to train simple models on descriptions of a simple world. I think it&#x27;s very likely a model couldn&#x27;t even learn simple arithmetic (addition, subtraction multiplication, division on the rational numbers, let&#x27;s say) given all of human writing on arithmetic, nevermind being able to reason about the entire world.