Open Challenges in LLM Research
Looking back in 25 years, the "Hallucination Problem" will sound a lot like the "Frame Problem" of the 1970s.Looking back, it's a bit absurd to say that GOFAI would've got to AGI if only the Frame Problem could be solved. But the important point is why that sounds so absurd.It doesn't sound absurd because we found out that the frame problem can't be solved; that's beside the point.It also doesn't sound absurd because we found out that solving the frame problem isn't the key to GOFAI-based AGI. That's also beside the point.It sounds absurd because the conjecture itself is... just funny. It's almost goofy, looking back, how people thought about AGI.Hallucination is the Frame Problem of the 2023 AI Summer. Looking back from the other side of the next Winter, the whole thing will seem a bit goofy.