Cotterell. 2019. Counterfactual data augmentation
for mitigating gender stereotypes in languages with
rich morphology. In Proceedings of the Association
for Computational Linguistics (ACL) , pages 1651–
1661, Florence, Italy.
A Appendix
In Table 3, we provide examples of the papers’ motivations and techniques across several NLP tasks.
A.1 Categorization details
In this section, we provide some additional details
about our method—speciﬁcally, our categorization.
What counts as being covered by an NLP task?
We considered a paper to cover a given NLP task if
it analyzed “bias” with respect to that task, but not
if it only evaluated overall performance on that task.
For example, a paper examining the impact of mitigating “bias” in word embeddings on “bias” in sentiment analysis would be counted as covering both
NLP tasks. In contrast, a paper assessing whether
performance on sentiment analysis degraded after
mitigating “bias” in word embeddings would be
counted only as focusing on embeddings.
What counts as a motivation? We considered a
motivation to include any description of the problem that motivated the paper or proposed quantitative technique, including any normative reasoning.
We survey 146 papers analyzing "bias" in NLP systems, finding that their
motivations are often vague, inconsistent, and lacking in normative reasoning,
despite the fact that analyzing "bias" is an inherently normative process. We
further find that these papers' proposed quantitative techniques for measuring
or mitigating "bias" are poorly matched to their motivations and do not engage
with the relevant literature outside of NLP. Based on these findings, we
describe the beginnings of a path forward by proposing three recommendations
that should guide work analyzing "bias" in NLP systems. These recommendations
rest on a greater recognition of the relationships between language and social
hierarchies, encouraging researchers and practitioners to articulate their
conceptualizations of "bias"---i.e., what kinds of system behaviors are
harmful, in what ways, to whom, and why, as well as the normative reasoning
underlying these statements---and to center work around the lived experiences
of members of communities affected by NLP systems, while interrogating and
reimagining the power relations between technologists and such communities.
Su Lin Blodgett Solon Barocas Hal Daumé III Hanna Wallach