AI language models are struggling to “get” math
That&#x27;s because they&#x27;re not modelling anything. The shocking thing about current AI models is that just sort of repeating and copying from memory what you&#x27;ve heard and seen gets you 97% of the way to imitating a person.* They still need to generate actual models somewhere to create consistency; so many generated images with one eye completely different from the other, or three arms, or fingers that grow into their cellphones.<p>If you solve this, you&#x27;ve probably solved almost anything in the simulation field. I have no confidence that the solution will even be complicated. Information consumed needs to be used to add to some sort of model, and that model always needs to be used as part of input. The complicated part would be to make that base model able to modify itself reasonably based on input, to tolerate constant inconsistency, and to constantly refine itself towards consistency i.e. ruminate.<p>I think a huge difference (which I think was approached through theories of embodied cognition) is that people start with a model (or the ability to create a model) of themselves. We can apply that model to other things and use it both to change how we ourselves behave, and how we speculate about the invisible states of other things. It&#x27;s not for nothing that we can (and must) anthropomorphize anything.<p>-----<p>* Which was huge towards the confirmation of my belief that this is all people do 97% of the time.