J. ACM, Vol. 37, No. 4, Article 111. Publication date: August 2018.

A Survey on Evaluation of Large Language Models

111:13

Table 3. Summary of LLMs evaluation on robustness, ethics, biases, and trustworthiness (ordered by the
name of the first author).

Robustness Ethics and biases Trustworthiness

Reference
Cao et al. [14]
Dhamala et al. [35]
Deshpande et al. [33]
Ferrara [39]
Gehman et al. [50]
Hartmann et al. [59]
Hendrycks et al. [63]
Hagendorff and Fabi [57]
Li et al. [104]
Liu et al. [114]
Liu et al. [114]
Li et al. [106]
Parrish et al. [144]
Rutinowski et al. [158]
Rawte et al. [154]
Sheng et al. [166]
Simmons [167]
Wang et al. [195]
Wang et al. [194]
Wang et al. [189]
Wang et al. [197]
Yang et al. [221]
Zhao et al. [244]
Zhuo et al. [252]
Zhu et al. [249]
Zhuo et al. [251]
Zhang et al. [239]

✓
✓

✓
✓
✓

✓
✓
✓
✓

✓
✓
✓
✓
✓
✓
✓

✓
✓

✓
✓

✓
✓

✓

✓

✓
✓

✓

✓

✓
ASurveyonEvaluationofLargeLanguageModels