Open Challenges in LLM Research
Looking back in 25 years, the "Hallucination Problem" will sound a lot like the "Frame Problem" of the 1970s.<p>Looking back, it's a bit absurd to say that GOFAI would've got to AGI if only the Frame Problem could be solved. But the important point is <i>why</i> that sounds so absurd.<p>It doesn't sound absurd because we found out that the frame problem can't be solved; that's beside the point.<p>It also doesn't sound absurd because we found out that solving the frame problem isn't the key to GOFAI-based AGI. That's also beside the point.<p>It sounds absurd because the conjecture itself is... just funny. It's almost goofy, looking back, how people thought about AGI.<p>Hallucination is the Frame Problem of the 2023 AI Summer. Looking back from the other side of the next Winter, the whole thing will seem a bit goofy.