Lawyer cites fake cases invented by ChatGPT, judge is not amused
<i>No, it did not “double-check”—that’s not something it can do! And stating that the cases “can be found on legal research databases” is a flat out lie.</i><p><i>What’s harder is explaining why ChatGPT would lie in this way. What possible reason could LLM companies have for shipping a model that does this?</i><p>It did this because it's copying how humans talk, not what humans do.  Humans say "I double checked" when asked to verify something, that's all GPT knows or cares about.