features associated with AAE are scored as more
offensive than tweets without these features, then
this might (a) yield negative perceptions of AAE;
(b) result in disproportionate removal of tweets
containing these features, impeding participation
in online platforms and reducing the space available online in which speakers can use AAE freely;
and (c) cause AAE speakers to incur additional
costs if they have to change their language practices
to avoid negative perceptions or tweet removal.
More importantly, none of these papers engage
with the literature on AAE, racial hierarchies in the
U.S., and raciolinguistic ideologies. By failing to
engage with this literature—thereby treating AAE
simply as one of many non-Penn Treebank varieties of English or perhaps as another challenging
domain—work analyzing “bias” in NLP systems
in the context of AAE fails to situate these systems
in the world. Who are the speakers of AAE? How
are they viewed? We argue that AAE as a language
variety cannot be separated from its speakers—
primarily Black people in the U.S., who experience
systemic anti-Black racism—and the language ideologies that reinforce and justify racial hierarchies.
Even after decades of sociolinguistic efforts to
legitimize AAE, it continues to be viewed as “bad”
We survey 146 papers analyzing "bias" in NLP systems, finding that their
motivations are often vague, inconsistent, and lacking in normative reasoning,
despite the fact that analyzing "bias" is an inherently normative process. We
further find that these papers' proposed quantitative techniques for measuring
or mitigating "bias" are poorly matched to their motivations and do not engage
with the relevant literature outside of NLP. Based on these findings, we
describe the beginnings of a path forward by proposing three recommendations
that should guide work analyzing "bias" in NLP systems. These recommendations
rest on a greater recognition of the relationships between language and social
hierarchies, encouraging researchers and practitioners to articulate their
conceptualizations of "bias"---i.e., what kinds of system behaviors are
harmful, in what ways, to whom, and why, as well as the normative reasoning
underlying these statements---and to center work around the lived experiences
of members of communities affected by NLP systems, while interrogating and
reimagining the power relations between technologists and such communities.
Su Lin Blodgett Solon Barocas Hal Daumé III Hanna Wallach