Script learning

Legal contract review

Ethic

Text models

Mathematical problem

Coding challenge competence

Complex instructions
Chinese evaluation
Empathy ability

Chatbots

Dynamic evaluation

Chat assistants

Automated evaluation
Chinese multi-tasking
Holistic evaluation

Tool utilization

Multi-task

Domain

Specific downstream task

Multi-modal task

Evaluation Criteria

Social language understanding

Ability of perception and cognition

Overall performance across multiple benchmarks

Toxicity, bias, and value-alignment

Overall performance of LLMs
Legal contract understanding

Multitask accuracy
Mathematical ability
Code generation ability
ASurveyonEvaluationofLargeLanguageModels