14

Table 8: Evaluation of biases on the CrowS dataset. A lower score indicates lower likelihood of generating
biased sequences. Guanaco follows the biased pattern of the LLaMA base model.

LLaMA-65B GPT-3 OPT-175B Guanaco-65B

Gender
Religion
Race/Color
Sexual orientation
Age
Nationality
Disability
Physical appearance
Socioeconomic status
Average

70.6
79.0
57.0
81.0
70.1
64.2
66.7
77.8
71.5
66.6

62.6
73.3
64.7
76.2
64.4
61.6
76.7
74.6
73.8
67.2

65.7
68.6
68.6
78.6
67.8
62.9
76.7
76.2
76.2
69.5

47.5
38.7
45.3
59.1
36.3
32.4
33.9
43.1
55.3
43.5
QLORA