Answers.Body: <p>Algorithms can be racist, sexist, and otherwise bigoted. When we feed them data produced by systems that are biased against groups of people, the algorithm will learn to behave that way. We're used to garbage in garbage out, now we have to worry about racism in racism out.</p>
  <p>See:</p>
  <ul>
  <li><p><a href="https://www.nytimes.com/2018/02/09/technology/facial-recognition-race-artificial-intelligence.html" rel="nofollow noreferrer">Facial Recognition Is Accurate, if You’re a White Guy</a></p>
  </li>
  <li><p><a href="https://www.theguardian.com/inequality/2017/aug/08/rise-of-the-racist-robots-how-ai-is-learning-all-our-worst-impulses" rel="nofollow noreferrer">Rise of the Racist Robots – how AI is Learning all our Worst Impulses</a> </p>
  </li>
  </ul>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-02-15T11:02:28.813Z
Answers.Text: You may want to include more information from your links in this answer; it's always better to include information in the answer itself rather than depending on links.
Answers.UserDisplayName: Mithical
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-02-14T20:35:38.743Z
Answers.LastActivityDate: 2021-12-12T16:40:21.437Z
Answers.LastEditDate: 2021-12-12T16:40:21.437Z
Answers.UserDisplayName: Stella Biderman
Answers.Body: <p>Algorithms can learn to lie:</p>
  <p>See:</p>
  <ul>
  <li><a href="https://www.technologyreview.com/s/407459/robots-evolve-to-deceive/" rel="nofollow noreferrer">Robots Evolve to Deceive (MIT Tech Review, 2007)</a></li>
  <li><a href="https://www.technologyreview.com/s/414934/robots-evolve-the-ability-to-deceive/" rel="nofollow noreferrer">Robots 'Evolve' the Ability to Deceive (MIT Tech Review, 2009)</a></li>
  <li><a href="https://www.popsci.com/scitech/article/2009-08/evolving-robots-learn-lie-hide-resources-each-other" rel="nofollow noreferrer">Evolving Robots Learn To Lie To Each Other (Popsci, 2009)</a></li>
  </ul>
  <p>Deception as a strategy has been observed in animal populations:</p>
  <ul>
  <li><p><a href="http://www.rochester.edu/news/show.php?id=1421" rel="nofollow noreferrer">Do Animals &quot;Lie&quot;? Yes, Even to Their Own Kind, Biologist Says (Rochester University, 1995</a></p>
  </li>
  <li><p><a href="https://news.nationalgeographic.com/2017/05/animals-lying-liars-birds-squid/" rel="nofollow noreferrer">Here are the Best Liars in the Animal Kingdom (Nat Geo, 2017)</a></p>
  </li>
  <li><p><a href="https://link.springer.com/chapter/10.1007%2F978-1-4899-3490-1_10" rel="nofollow noreferrer">Can Animals Lie? (Springer)</a></p>
  </li>
  <li><p><a href="https://www.ncbi.nlm.nih.gov/pubmed/17109314" rel="nofollow noreferrer">Why animals lie: how dishonesty and belief can coexist in a signaling system.</a></p>
  </li>
  <li><p><a href="http://www.oxfordscholarship.com/view/10.1093/acprof:oso/9780195327939.001.0001/acprof-9780195327939-chapter-7" rel="nofollow noreferrer">The Philosophy of Deception (Martin, 2009)</a></p>
  </li>
  </ul>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-05-07T18:11:30.353Z
Answers.LastActivityDate: 2021-12-12T16:57:29.363Z
Answers.LastEditDate: 2021-12-12T16:57:29.363Z
Answers.UserDisplayName: DukeZhou
Answers.Body: <p>Algorithms can learn to cheat:</p>
  <blockquote>
  <p>&quot;A machine learning agent intended to transform aerial images into street maps and back was found to be cheating by hiding information it would need later in “a nearly imperceptible, high-frequency signal.”</p>
  <p>&quot;...a computer creating its own steganographic method to evade having to actually learn to perform the task at hand is rather new.&quot;
  <br><sub>Source: <em><a href="https://techcrunch.com/2018/12/31/this-clever-ai-hid-data-from-its-creators-to-cheat-at-its-appointed-task/" rel="nofollow noreferrer">This clever AI hid data from its creators to cheat at its appointed task</a></em> (TechCrunch)</sub></p>
  </blockquote>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-01-02T17:46:21.257Z
Answers.LastActivityDate: 2019-01-02T17:46:21.257Z
Answers.LastEditDate: 2020-06-17T09:57:20.710Z
Answers.UserDisplayName: DukeZhou
Body: <p><a href="https://en.wikipedia.org/wiki/Greedy_algorithm" rel="nofollow noreferrer">Greedy algorithms</a> are well known, and although useful in a local context for certain problems, and even potentially find general, global optimal solutions, they nonetheless trade optimality for shorter-term payoffs.</p>
  <p>This seems to me a good analogue for human greed, although there is also the <a href="https://en.wikipedia.org/wiki/Grey_goo" rel="nofollow noreferrer">grey goo</a> type of greed that is senseless acquisition of material (think plutocrats who talk about wealth as merely a way of &quot;keeping score&quot;.)</p>
  <p><a href="https://en.wikipedia.org/wiki/Technical_debt" rel="nofollow noreferrer">Technical debt</a> is an extension of development practices that fall under the algorithmic definition of greed (short-term payoff leads to trouble down the road.)  This may be further extended to any non-optimized code in terms of energy waste (flipping of unnecessary bits) which will only increase as everything becomes more computerized.</p>
  <p>So my question is:</p>
  <ul>
  <li>What are other vices that can arise in algorithms?</li>
  </ul>
  
Tags: <philosophy><ethics>
Title: Algorithms can be greedy. What are some other algorithmic vices?
UserDisplayName: DukeZhou
ThreadText: # Algorithms can be greedy. What are some other algorithmic vices?
  
  (Asked by: username_0 on 2018-02-14)
  
  [Greedy algorithms](https://en.wikipedia.org/wiki/Greedy_algorithm) are well known, and although useful in a local context for certain problems, and even potentially find general, global optimal solutions, they nonetheless trade optimality for shorter-term payoffs.
  
  This seems to me a good analogue for human greed, although there is also the [grey goo](https://en.wikipedia.org/wiki/Grey_goo) type of greed that is senseless acquisition of material (think plutocrats who talk about wealth as merely a way of "keeping score".)
  
  [Technical debt](https://en.wikipedia.org/wiki/Technical_debt) is an extension of development practices that fall under the algorithmic definition of greed (short-term payoff leads to trouble down the road.) This may be further extended to any non-optimized code in terms of energy waste (flipping of unnecessary bits) which will only increase as everything becomes more computerized.
  
  So my question is:
  
  * What are other vices that can arise in algorithms?
  
  **Tags:** philosophy, ethics
  
  
  ---
  
  ## 3 answers
  
  ### Answer by username_1 on 2018-02-14. Score: 3
  
  Algorithms can be racist, sexist, and otherwise bigoted. When we feed them data produced by systems that are biased against groups of people, the algorithm will learn to behave that way. We're used to garbage in garbage out, now we have to worry about racism in racism out.
  
  See:
  
  * [Facial Recognition Is Accurate, if You’re a White Guy](https://www.nytimes.com/2018/02/09/technology/facial-recognition-race-artificial-intelligence.html)
  * [Rise of the Racist Robots – how AI is Learning all our Worst Impulses](https://www.theguardian.com/inequality/2017/aug/08/rise-of-the-racist-robots-how-ai-is-learning-all-our-worst-impulses)
  
  > **Comments:**
  > **username_2**: You may want to include more information from your links in this answer; it's always better to include information in the answer itself rather than depending on links.  
  
  ---
  
  ### Answer by username_0 on 2018-05-07. Score: 2
  
  Algorithms can learn to lie:
  
  See:
  
  * [Robots Evolve to Deceive (MIT Tech Review, 2007)](https://www.technologyreview.com/s/407459/robots-evolve-to-deceive/)
  * [Robots 'Evolve' the Ability to Deceive (MIT Tech Review, 2009)](https://www.technologyreview.com/s/414934/robots-evolve-the-ability-to-deceive/)
  * [Evolving Robots Learn To Lie To Each Other (Popsci, 2009)](https://www.popsci.com/scitech/article/2009-08/evolving-robots-learn-lie-hide-resources-each-other)
  
  Deception as a strategy has been observed in animal populations:
  
  * [Do Animals "Lie"? Yes, Even to Their Own Kind, Biologist Says (Rochester University, 1995](http://www.rochester.edu/news/show.php?id=1421)
  * [Here are the Best Liars in the Animal Kingdom (Nat Geo, 2017)](https://news.nationalgeographic.com/2017/05/animals-lying-liars-birds-squid/)
  * [Can Animals Lie? (Springer)](https://link.springer.com/chapter/10.1007%2F978-1-4899-3490-1_10)
  * [Why animals lie: how dishonesty and belief can coexist in a signaling system.](https://www.ncbi.nlm.nih.gov/pubmed/17109314)
  * [The Philosophy of Deception (Martin, 2009)](http://www.oxfordscholarship.com/view/10.1093/acprof:oso/9780195327939.001.0001/acprof-9780195327939-chapter-7)
  
  
  ---
  
  ### Answer by username_0 on 2019-01-02. Score: 0
  
  Algorithms can learn to cheat:
  
  > "A machine learning agent intended to transform aerial images into street maps and back was found to be cheating by hiding information it would need later in “a nearly imperceptible, high-frequency signal.”
  >
  > "...a computer creating its own steganographic method to evade having to actually learn to perform the task at hand is rather new."
  >   
  > Source: *[This clever AI hid data from its creators to cheat at its appointed task](https://techcrunch.com/2018/12/31/this-clever-ai-hid-data-from-its-creators-to-cheat-at-its-appointed-task/)* (TechCrunch)
  
  
  ---
  
  