Answers.Body: <p>Your highlighted Adaline's features is only relative to the traditional perceptron's error correction learning rule such as Rosenblatt's perceptron which cannot even converge facing non linearly separable training data, while Adaline network may converge facing same data albeit likely cannot achieve 100% accuracy by simply providing a linear decision boundary.</p>
  <p>For non linearly separable data Madaline network may obtain much better accuracy compared to Adaline as expected due to its combinatory power, in fact <a href="https://www.geeksforgeeks.org/adaline-and-madaline-network/#" rel="nofollow noreferrer">one of your own references</a> gives an example Madaline network to solve the XOR problem with just 2 Adaline units in the hidden layer 100% correctly.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-11-06T21:57:17.080Z
Answers.LastActivityDate: 2023-11-06T21:57:17.080Z
Answers.UserDisplayName: cinch
Body: <p><a href="https://en.wikipedia.org/wiki/ADALINE" rel="nofollow noreferrer">https://en.wikipedia.org/wiki/ADALINE</a></p>
  <p>I was confused about this because, for example, the XOR problem is not linearly separable, and a simple Perceptron obviously cannot solve it, so we would need a network like the multilayer perceptron. Furthermore, some sources on the internet say that <strong>Adaline's learning algorithm, the LMS (Least Mean Squares) algorithm, converges to the minimum error assumption, regardless of whether the training data is linearly separable or not</strong>. However, this refers to minimizing MSE, not correctly classifying all training samples. But this leaves me confused. <strong>What does that mean?</strong></p>
  <p><strong>An Adaline neuron can solve problems that are not linearly separable ?</strong></p>
  <p><strong>If so, what is the difference between Adaline's ability to solve problems that are not linearly separable and other neural networks such as Madaline and multilayer perceptron?</strong></p>
  
Tags: <neural-networks>
Title: An Adaline neuron can solve problems that are not linearly separable?
UserDisplayName: will The J
ThreadText: # An Adaline neuron can solve problems that are not linearly separable?
  
  (Asked by: username_0 on 2023-11-05)
  
  <https://en.wikipedia.org/wiki/ADALINE>
  
  I was confused about this because, for example, the XOR problem is not linearly separable, and a simple Perceptron obviously cannot solve it, so we would need a network like the multilayer perceptron. Furthermore, some sources on the internet say that **Adaline's learning algorithm, the LMS (Least Mean Squares) algorithm, converges to the minimum error assumption, regardless of whether the training data is linearly separable or not**. However, this refers to minimizing MSE, not correctly classifying all training samples. But this leaves me confused. **What does that mean?**
  
  **An Adaline neuron can solve problems that are not linearly separable ?**
  
  **If so, what is the difference between Adaline's ability to solve problems that are not linearly separable and other neural networks such as Madaline and multilayer perceptron?**
  
  **Tags:** neural-networks
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2023-11-06. Score: 0
  
  Your highlighted Adaline's features is only relative to the traditional perceptron's error correction learning rule such as Rosenblatt's perceptron which cannot even converge facing non linearly separable training data, while Adaline network may converge facing same data albeit likely cannot achieve 100% accuracy by simply providing a linear decision boundary.
  
  For non linearly separable data Madaline network may obtain much better accuracy compared to Adaline as expected due to its combinatory power, in fact [one of your own references](https://www.geeksforgeeks.org/adaline-and-madaline-network/#) gives an example Madaline network to solve the XOR problem with just 2 Adaline units in the hidden layer 100% correctly.
  
  
  ---
  
  