Text Embedding Models Contain Bias
This is a genuine, difficult problem. It&#x27;s so easy to join up on your political team of choice and scream about it, and all this makes any real attempt to solve it so much harder to talk about in public or collaborate on. In fact, there&#x27;s practically guaranteed to be some greyed out text in the discussion here.<p>So some of these associations simply reflect the way-the-world-was or the way-the-world-is - like associating &quot;woman&quot; with &quot;housewife&quot;. That&#x27;s a whole debate in itself.<p>But some of these can be accidental. Suppose a runaway success novel&#x2F;tv&#x2F;film franchise has &quot;Bob&quot; as the evil bad guy. Reams of fanfictions are written with &quot;Bob&quot; doing horrible things. People endlessly talk about how bad &quot;Bob&quot; is on twitter. Even the New York times writes about Bob latest depredations, when he plays off current events.<p>Your name is Bob. Suddenly all the AI&#x27;s in the world associate your name with evil, death, killing, lying, stealing, fraud, and incest. AI&#x27;s silently, slightly ding your essays, loan applications, uber driver applications, and everything you write online. And no one believes it&#x27;s really happening. Or the powers that be think it&#x27;s just a little accidental damage because the AI overall is still, overall doing a great job of sentiment analysis and fraud detection.