Translation using Perturbations. arXiv preprint
arXiv:2004.14065 .
Ben Green. 2019. “Good” isn’t good enough. In Proceedings of the AI for Social Good Workshop , Vancouver, Canada.
Lisa J. Green. 2002. African American English: A Linguistic Introduction . Cambridge University Press.
Anthony G. Greenwald, Debbie E. McGhee, and Jordan L.K. Schwartz. 1998. Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology, 74(6):1464–1480.Enoch Opanin Gyamﬁ, Yunbo Rao, Miao Gou, and
Yanhua Shao. 2020. deb2viz: Debiasing gender in
word embedding data using subspace visualization.
InProceedings of the International Conference on
Graphics and Image Processing .
Foad Hamidi, Morgan Klaus Scheuerman, and Stacy M.
Branham. 2018. Gender Recognition or Gender Reductionism? The Social Implications of Automatic
Gender Recognition Systems. In Proceedings of the
Conference on Human Factors in Computing Systems (CHI) , Montréal, Canada.
Alex Hanna, Emily Denton, Andrew Smart, and Jamila
Smith-Loud. 2020. Towards a Critical Race Methodology in Algorithmic Fairness. In Proceedings of the
We survey 146 papers analyzing "bias" in NLP systems, finding that their
motivations are often vague, inconsistent, and lacking in normative reasoning,
despite the fact that analyzing "bias" is an inherently normative process. We
further find that these papers' proposed quantitative techniques for measuring
or mitigating "bias" are poorly matched to their motivations and do not engage
with the relevant literature outside of NLP. Based on these findings, we
describe the beginnings of a path forward by proposing three recommendations
that should guide work analyzing "bias" in NLP systems. These recommendations
rest on a greater recognition of the relationships between language and social
hierarchies, encouraging researchers and practitioners to articulate their
conceptualizations of "bias"---i.e., what kinds of system behaviors are
harmful, in what ways, to whom, and why, as well as the normative reasoning
underlying these statements---and to center work around the lived experiences
of members of communities affected by NLP systems, while interrogating and
reimagining the power relations between technologists and such communities.
Su Lin Blodgett Solon Barocas Hal Daumé III Hanna Wallach