Answers.Body: <p>As the name implies, algorithmic bias is related with the used algorithm. Due to the way it was programmed or devised, the algorithm will be biased in some of its samples.</p>
  
  <p>From <a href="https://cacm.acm.org/magazines/2016/10/207759-battling-algorithmic-bias/fulltext" rel="nofollow noreferrer">Communications of the ACM</a>:</p>
  
  <blockquote>
    <p>[Algorithms] often inadvertently pick up the human biases that are incorporated when the algorithm is programmed, or when humans interact with that algorithm.</p>
  </blockquote>
  
  <p>A machine learning model can be biased if the wrong data-set is used, of course. That is usually only referred to as <em>bias</em>, and often associated with the <a href="https://en.wikipedia.org/wiki/Bias%E2%80%93variance_tradeoff" rel="nofollow noreferrer">bias-variance tradeoff</a>. </p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-06-05T10:03:06.873Z
Answers.LastActivityDate: 2017-06-05T10:03:06.873Z
Answers.UserDisplayName: BlueMoon93
Answers.Body: <p>Just to add to what has already been said in @BlueMoon93's <a href="https://ai.stackexchange.com/a/3434/7550">answer</a>: </p>
  
  <p>Algorithmic bias is the bias built into the algorithm. Now for the long answer: </p>
  
  <p>As stated by the so called <a href="https://en.wikipedia.org/wiki/No_free_lunch_theorem" rel="nofollow noreferrer">No free lunch theorem</a>: regardless of the algorithm you use, you cant get learning "for free"(i.e by just looking at the training examples). The reason for this is that the only thing you know about the data is based on the limited examples you have seen in the training set. To <a href="https://en.wikipedia.org/wiki/Generalization_error" rel="nofollow noreferrer">generalize</a>, your algorithm has to make some sort of assumptions about the underlying nature of the dataset and the manner in which it can be represented/interpreted. </p>
  
  <p>Built into every algorithm is a set of assumptions about the dataset, for example, built into the <a href="https://en.wikipedia.org/wiki/Convolutional_neural_network" rel="nofollow noreferrer">convolution neural network</a> is the assumption that the dataset(e.g images you are using to train your Convolution neural network) can be understood by mimicking how the human eye is <a href="https://www.youtube.com/watch?v=Cw5PKV9Rj3o" rel="nofollow noreferrer">known to work</a>(i.e a bias). Some algorithms may have such strong biases such that they are incapable of learning certain kinds of functions. For example, linear models assumes that the underlying data is linear(a bias), note this might not be the case for the dataset at hand in which case the bias built into the model was bad for the dataset at hand. </p>
  
  <p>As pointed out by @BlueMoon93, there is another form of bias, commonly referred to simply as <a href="http://scott.fortmann-roe.com/docs/BiasVariance.html" rel="nofollow noreferrer">"bias"</a> which is introduced by the dataset used. </p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-06-06T11:27:08.130Z
Answers.LastActivityDate: 2017-06-07T14:29:57.697Z
Answers.LastEditDate: 2017-06-07T14:29:57.697Z
Answers.UserDisplayName: Tshilidzi Mudau
Body: <p>I recently read about algorithmic bias in facial recognition. </p>
  
  <p>Is algorithmic bias due to the training dataset used, or is it due to something else?</p>
  
Tags: <machine-learning><image-recognition><facial-recognition><algorithmic-bias>
Title: Is algorithmic bias due to the training dataset used?
UserDisplayName: Karan Nadagoudar
ThreadText: # Is algorithmic bias due to the training dataset used?
  
  (Asked by: username_0 on 2017-06-05)
  
  I recently read about algorithmic bias in facial recognition.
  
  Is algorithmic bias due to the training dataset used, or is it due to something else?
  
  **Tags:** machine-learning, image-recognition, facial-recognition, algorithmic-bias
  
  ---
  
  ## 2 answers
  
  ### Answer by username_1 on 2017-06-05. Score: 4
  
  As the name implies, algorithmic bias is related with the used algorithm. Due to the way it was programmed or devised, the algorithm will be biased in some of its samples.
  
  From [Communications of the ACM](https://cacm.acm.org/magazines/2016/10/207759-battling-algorithmic-bias/fulltext):
  
  > [Algorithms] often inadvertently pick up the human biases that are incorporated when the algorithm is programmed, or when humans interact with that algorithm.
  
  A machine learning model can be biased if the wrong data-set is used, of course. That is usually only referred to as *bias*, and often associated with the [bias-variance tradeoff](https://en.wikipedia.org/wiki/Bias%E2%80%93variance_tradeoff).
  
  
  ---
  
  ### Answer by username_2 on 2017-06-06. Score: 4
  
  Just to add to what has already been said in @BlueMoon93's [answer](https://ai.stackexchange.com/a/3434/7550):
  
  Algorithmic bias is the bias built into the algorithm. Now for the long answer:
  
  As stated by the so called [No free lunch theorem](https://en.wikipedia.org/wiki/No_free_lunch_theorem): regardless of the algorithm you use, you cant get learning "for free"(i.e by just looking at the training examples). The reason for this is that the only thing you know about the data is based on the limited examples you have seen in the training set. To [generalize](https://en.wikipedia.org/wiki/Generalization_error), your algorithm has to make some sort of assumptions about the underlying nature of the dataset and the manner in which it can be represented/interpreted.
  
  Built into every algorithm is a set of assumptions about the dataset, for example, built into the [convolution neural network](https://en.wikipedia.org/wiki/Convolutional_neural_network) is the assumption that the dataset(e.g images you are using to train your Convolution neural network) can be understood by mimicking how the human eye is [known to work](https://www.youtube.com/watch?v=Cw5PKV9Rj3o)(i.e a bias). Some algorithms may have such strong biases such that they are incapable of learning certain kinds of functions. For example, linear models assumes that the underlying data is linear(a bias), note this might not be the case for the dataset at hand in which case the bias built into the model was bad for the dataset at hand.
  
  As pointed out by @BlueMoon93, there is another form of bias, commonly referred to simply as ["bias"](http://scott.fortmann-roe.com/docs/BiasVariance.html) which is introduced by the dataset used.
  
  
  ---
  
  