Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”
I asked ChatGPT to tell me a riddle.<p>It was “What is always hungry, needs to be fed, and makes your hands red?” (Or something like that)<p>I asked for a hint about 5 times and it kept giving more legitimate sounding hints.<p>Finally I gave up and asked for the answer to the riddle, and it spit out a random fruit which made no sense as the answer to the riddle.<p>I then repeated the riddle and asked ChatGPT what the answer was, and it gave me the answer (“Fire”) which makes sense as the answer to the riddle.<p>But it was giving extremely bad hints, like “it starts with the letter P” and “it’s a fruit”.<p>That was a great way to show my non-tech family members the limitations of AI and why they shouldn’t trust it.<p>Playing “20 questions” with ChatGPT is another great way to expose its limitations. It knows the game and tries to play, but is terrible at asking questions to narrow down possible answers.<p>There really needs to be some confidence or accuracy score/estimation displayed alongside its output.<p>Or, learn how to say “I don’t know”