3.1.4 Multilingual tasks. While English is the predominant language, many LLMs are trained on
mixed-language training data. The combination of multilingual data indeed helps LLMs gain the
ability to process inputs and generate responses in different languages, making them widely adopted
and accepted across the globe. However, due to the relatively recent emergence of this technology,
LLMs are primarily evaluated on English data, leading to a potential oversight of evaluating their
multilingual performance. To address this, several articles have provided comprehensive, open,
and independent evaluations of LLMs’ performance on various NLP tasks in different non-English
languages. These evaluations offer valuable insights and perspectives for future research and
applications.
ASurveyonEvaluationofLargeLanguageModels