Answers.Body: <p>It depends, as mentioned in the comments, on your model and labels. For example, how would you use standardization on a multi-classification problem?</p>
  <p>Generally, standardization is more favorable for input data as its mean is around 0.</p>
  <p>I assume you have a regression model and in that case, using standardization could be better than normalization.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-07-27T04:18:22.410Z
Answers.LastActivityDate: 2021-12-21T04:06:22.767Z
Answers.LastEditDate: 2021-12-21T04:06:22.767Z
Answers.UserDisplayName: pedrum
Body: <p>Normalisation transform data into a range:
  <span class="math-container">$$X_i = \dfrac{X_i - Min}{Max-Min}$$</span></p>
  <p>Practically, I found out that the model doesn't generalise well when using normalisation of input data, instead of standardisation (another formula shown below).</p>
  <p>Before training a neural net, data are usually standardised or normalised. Standardising seems good as it makes the model generalise better, while normalisation may make the model not working with values out of training data range.</p>
  <p>So I'm using standardisation for input data (X), however, I'm confusing whether I should standardise the expected output values too?</p>
  <p>For a column in input data:
  <span class="math-container">$$X_i = \dfrac{(X_i - Mean)}{Standard\ Deviation\ of\ the\ Column}$$</span></p>
  <p>Should I apply this formula to the expected output values (labels) too?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-07-25T02:46:28.617Z
Comments.Text: What is the difference between "standardization" and "normalization"? I think these terms would refer to the same concept and, from your equation, it seems like you're referring to some form of "normalization". Can you clarify that? Also, maybe you should describe the type of task you're trying to solve: is it classification or regression? How do your labels look like? Are they integers or floating-point numbers? Do they have a range?
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-07-26T03:20:28.197Z
Comments.Text: normalisation: values are scaled into a range [a,b] that is: x = (x-min)/(max-min); and standardisation is x = (x-mean)/(sqrt(sum((x-mean)^2)/n)); they r different concepts
Comments.UserDisplayName: Dan D.
Tags: <neural-networks><machine-learning><data-preprocessing><normalisation><standardisation>
Title: Is it necessary to standardise the expected output
UserDisplayName: Dan D.
ThreadText: # Is it necessary to standardise the expected output
  
  (Asked by: username_0 on 2020-07-23)
  
  Normalisation transform data into a range:
  $$X\_i = \dfrac{X\_i - Min}{Max-Min}$$
  
  Practically, I found out that the model doesn't generalise well when using normalisation of input data, instead of standardisation (another formula shown below).
  
  Before training a neural net, data are usually standardised or normalised. Standardising seems good as it makes the model generalise better, while normalisation may make the model not working with values out of training data range.
  
  So I'm using standardisation for input data (X), however, I'm confusing whether I should standardise the expected output values too?
  
  For a column in input data:
  $$X\_i = \dfrac{(X\_i - Mean)}{Standard\ Deviation\ of\ the\ Column}$$
  
  Should I apply this formula to the expected output values (labels) too?
  
  **Tags:** neural-networks, machine-learning, data-preprocessing, normalisation, standardisation
  > **Comments:**
  > **username_1**: What is the difference between "standardization" and "normalization"? I think these terms would refer to the same concept and, from your equation, it seems like you're referring to some form of "normalization". Can you clarify that? Also, maybe you should describe the type of task you're trying to solve: is it classification or regression? How do your labels look like? Are they integers or floating-point numbers? Do they have a range?  
  > **username_0**: normalisation: values are scaled into a range [a,b] that is: x = (x-min)/(max-min); and standardisation is x = (x-mean)/(sqrt(sum((x-mean)^2)/n)); they r different concepts  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2020-07-27. Score: 2 | Accepted answer
  
  It depends, as mentioned in the comments, on your model and labels. For example, how would you use standardization on a multi-classification problem?
  
  Generally, standardization is more favorable for input data as its mean is around 0.
  
  I assume you have a regression model and in that case, using standardization could be better than normalization.
  
  
  ---
  
  