7 GRAND CHALLENGES AND OPPORTUNITIES FOR FUTURE RESEARCH
Evaluation as a new discipline: Our summarization inspires us to redesign a wide spectrum of
aspects related to evaluation in the era of LLMs. In this section, we present several grand challenges.
Our key point is that evaluation should be treated as an essential discipline to drive the
success of LLMs and other AI models. Existing protocols are not enough to thoroughly evaluate
the true capabilities of LLMs, which poses grand challenges and triggers new opportunities for
future research on LLMs evaluation.
ASurveyonEvaluationofLargeLanguageModels