LLMs can't self-correct in reasoning tasks, DeepMind study finds
LLMs have no real understanding, so of course they cannot self-correct. They can&#x27;t even correct on command.<p>I had an example just today: I wanted an example of a piece of code using framework X to do task Y. I didn&#x27;t realize that what I wanted is not possible.<p>The LLM I was using gave me code that worked, but did not do what I wanted. I pointed this out, so I then got code that syntactically did what I wanted, but could never work. This went back and forth twice, before I gave up.<p>The LLM was incapable of recognizing the falsity of its answers. It certainly wasn&#x27;t capable of suggesting a different approach that would work (and yes, there was one, I found after a bit more research).