Answers.Body: <p>It is a series of weight matrices (possibly with a bias) separated by a non-linear activation function. So one layer can be described as this act_f(Wx+b). Where W is the weight matrix, b is the bias, x the input of the layer and act_f is the activation function. This is function is then repeated (taking in the output of the previous layer as x) possibly with different W, b and act_f's and this is repeated n times where n &gt; 1 (as it's a multilayer preceptron).</p>
  <p>This is an perceptron : act_f(Wx+b) <br>
  This is an possible example of a multilayer perceptron act_f(W*act_f(Wx+b)+b).</p>
  <p>What kind of shape the W has doesn't really matter, you could even have skip connections would still be a mlp.
  It's just a word used to describe this type of architecture, just like we use the word cat to describe a cat while there are many different types of cats.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-06-21T15:00:45.533Z
Answers.LastActivityDate: 2022-06-21T15:00:45.533Z
Answers.UserDisplayName: hal9000
Answers.Body: <p>what you're getting at is a major tension in machine learning: there are sometimes different ways of defining the same mathematical concept, and different mathematical definitions for the same term. In this case context is key. In a class on machine learning it will refer to a feed forward network, in some conference communities it will refer to a linear layer. In either case, the math in <a href="https://ai.stackexchange.com/a/36008/63660">@hal9000's answer</a> will describe it technically. Though at times they may simplify the notation even further and describe it as a simple weighing e.g.</p>
  <p><span class="math-container">$$y = \sigma(Wx)$$</span></p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-11-18T18:38:22.540Z
Answers.LastActivityDate: 2022-11-18T18:41:09.437Z
Answers.LastEditDate: 2022-11-18T18:41:09.437Z
Answers.UserDisplayName: Dan
Body: <p>The term 'multilayer perceptron' has been used in literature in various ways in the literature.</p>
  <p>I am presenting some of them below</p>
  <ol>
  <li><p>As a feed-forward neural network <a href="https://www.sciencedirect.com/topics/veterinary-science-and-veterinary-medicine/feedforward-neural-network" rel="nofollow noreferrer">[1]</a>.</p>
  </li>
  <li><p>As a fully connected feed-forward neural network <a href="https://boostedml.com/2020/04/feedforward-neural-networks-and-multilayer-perceptrons.html" rel="nofollow noreferrer">[2]</a>.</p>
  </li>
  <li><p>As a fully connected feed-forward neural network in which each hidden layer has the same number of neurons.</p>
  </li>
  <li><p>As a fully connected feed-forward neural network in which each hidden layer has the same number of neurons and same activation function.</p>
  </li>
  </ol>
  <p>Afaik, the first definition is generally used, but it seems that there are many alternative definitions.</p>
  <p>In this context, I want to know all the possible definitions that are floating in the literature for the word 'multilayer perception'.</p>
  <p>I am asking this question because there can be several interpretations if we consider the words of 'multilayer perception' alone as the names suggests the only property required is multiple number of layers.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-05-23T15:37:37.117Z
Comments.Text: Words mean whatever the person saying them wants them to mean. Who said the words?
Comments.UserDisplayName: Criticize SE actions means ban
Tags: <comparison><terminology><definitions><feedforward-neural-networks><multilayer-perceptrons>
Title: What are all the possible usages of 'multilayer perceptron'?
UserDisplayName: hanugm
ThreadText: # What are all the possible usages of 'multilayer perceptron'?
  
  (Asked by: username_0 on 2022-05-22)
  
  The term 'multilayer perceptron' has been used in literature in various ways in the literature.
  
  I am presenting some of them below
  
  1. As a feed-forward neural network [[1]](https://www.sciencedirect.com/topics/veterinary-science-and-veterinary-medicine/feedforward-neural-network).
  2. As a fully connected feed-forward neural network [[2]](https://boostedml.com/2020/04/feedforward-neural-networks-and-multilayer-perceptrons.html).
  3. As a fully connected feed-forward neural network in which each hidden layer has the same number of neurons.
  4. As a fully connected feed-forward neural network in which each hidden layer has the same number of neurons and same activation function.
  
  Afaik, the first definition is generally used, but it seems that there are many alternative definitions.
  
  In this context, I want to know all the possible definitions that are floating in the literature for the word 'multilayer perception'.
  
  I am asking this question because there can be several interpretations if we consider the words of 'multilayer perception' alone as the names suggests the only property required is multiple number of layers.
  
  **Tags:** comparison, terminology, definitions, feedforward-neural-networks, multilayer-perceptrons
  
  > **Comments:**
  > **username_1**: Words mean whatever the person saying them wants them to mean. Who said the words?  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_2 on 2022-06-21. Score: 1
  
  It is a series of weight matrices (possibly with a bias) separated by a non-linear activation function. So one layer can be described as this act\_f(Wx+b). Where W is the weight matrix, b is the bias, x the input of the layer and act\_f is the activation function. This is function is then repeated (taking in the output of the previous layer as x) possibly with different W, b and act\_f's and this is repeated n times where n > 1 (as it's a multilayer preceptron).
  
  This is an perceptron : act\_f(Wx+b)   
  This is an possible example of a multilayer perceptron act\_f(W\*act\_f(Wx+b)+b).
  
  What kind of shape the W has doesn't really matter, you could even have skip connections would still be a mlp.
  It's just a word used to describe this type of architecture, just like we use the word cat to describe a cat while there are many different types of cats.
  
  
  ---
  
  ### Answer by username_3 on 2022-11-18. Score: 1
  
  what you're getting at is a major tension in machine learning: there are sometimes different ways of defining the same mathematical concept, and different mathematical definitions for the same term. In this case context is key. In a class on machine learning it will refer to a feed forward network, in some conference communities it will refer to a linear layer. In either case, the math in [@username_2's answer](https://ai.stackexchange.com/a/36008/63660) will describe it technically. Though at times they may simplify the notation even further and describe it as a simple weighing e.g.
  
  $$y = \sigma(Wx)$$
  
  
  ---
  
  