Despite their impressive capabilities, we should note that there are limitations to the use of LLMs.
There is a continued need for ongoing research and development on “hallucinations” generated by
LLMs to ensure that model outputs are more reliable and verifiable. LLMs also struggle with tasks
requiring high-level reasoning abilities like causal understanding, logical deduction, and counterfactual
reasoning even though they achieve impressive performance on exam benchmarks. This underscores
the need for more challenging and robust evaluations to measure their true understanding as the
current state-of-the-art LLMs saturate many benchmarks.
gemini_1_report