Answers.Body: <p>Anything that is not linearly separable cant be solved perceptrons, unless you use feature maps on data to map them to a higher dimension in which it is linearly separable. </p>
  
  <p>As a simple, concrete example, perceptron cant learn the XOR function.</p>
  
  <p>This <a href="https://www.computing.dcu.ie/~humphrys/Notes/Neural/single.neural.html" rel="nofollow noreferrer">page</a> might help you further.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-22T20:33:58.680Z
Answers.Text: Someone had already provided an answer to this question in the past, but it was deleted by the author after I commented saying that they were not addressing this part "_but it can be solved by the same network if the activation function is swapped out to a differentiable activation function (e.g. sigmoid, tanh)?_". Maybe you should address this part too.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-22T21:15:25.163Z
Answers.Text: I am not saying changing the activation function changes or not the set of problems that the perceptron can solve. I am just asking you to explain why.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-22T20:26:47.973Z
Answers.LastActivityDate: 2020-03-22T20:26:47.973Z
Answers.UserDisplayName: SpiderRico
Body: <p>What is the simplest <strong>classification</strong> problem which cannot be solved by a perceptron (that is a single-layered feed-forward neural network, with no hidden layers and step activation function), but it can be solved by the same network if the activation function is swapped out to a differentiable activation function (e.g. sigmoid, tanh)?</p>
  <p>In the first case, the training would be done with the perceptron training rule, in the second case with the delta rule.</p>
  <p>Note that regression problems cannot be solved by perceptrons, so I'm interested in classification only.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-03-13T10:42:05.107Z
Comments.Text: Anything with a non-step output, perhaps? I thought that a perceptron with a different activation function is still a perceptron.
Comments.UserDisplayName: Criticize SE actions means ban
Tags: <classification><activation-functions><perceptron><xor-problem>
Title: What is the simplest classification problem which cannot be solved by a perceptron?
UserDisplayName: yejaxey
ThreadText: # What is the simplest classification problem which cannot be solved by a perceptron?
  
  (Asked by: username_0 on 2020-03-13)
  
  What is the simplest **classification** problem which cannot be solved by a perceptron (that is a single-layered feed-forward neural network, with no hidden layers and step activation function), but it can be solved by the same network if the activation function is swapped out to a differentiable activation function (e.g. sigmoid, tanh)?
  
  In the first case, the training would be done with the perceptron training rule, in the second case with the delta rule.
  
  Note that regression problems cannot be solved by perceptrons, so I'm interested in classification only.
  
  **Tags:** classification, activation-functions, perceptron, xor-problem
  
  > **Comments:**
  > **username_1**: Anything with a non-step output, perhaps? I thought that a perceptron with a different activation function is still a perceptron.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2020-03-22. Score: 1
  
  Anything that is not linearly separable cant be solved perceptrons, unless you use feature maps on data to map them to a higher dimension in which it is linearly separable.
  
  As a simple, concrete example, perceptron cant learn the XOR function.
  
  This [page](https://www.computing.dcu.ie/~humphrys/Notes/Neural/single.neural.html) might help you further.
  
  > **Comments:**
  > **username_3**: Someone had already provided an answer to this question in the past, but it was deleted by the author after I commented saying that they were not addressing this part "_but it can be solved by the same network if the activation function is swapped out to a differentiable activation function (e.g. sigmoid, tanh)?_". Maybe you should address this part too.  
  > **username_3**: I am not saying changing the activation function changes or not the set of problems that the perceptron can solve. I am just asking you to explain why.  
  
  ---
  
  