Avoiding hallucinations in LLM-powered applications
I think a better way to think about it is that LLMs can only &quot;hallucinate&quot;, that is they create output statistically from input.  That the output can sometimes, when the words are read and modeled mentally by a human, correspond with fact, is really the exception and just luck.  The LLM literally has no clue about anything, and by design, never will.