Answers.Body: <p>Batch Normalization is usually known to speed up the learning process as it makes the weights in the deeper layers more robust. It restricts the distribution of the weights in a particular layer - <a href="https://www.youtube.com/watch?v=nUUqwaxLnWs" rel="nofollow noreferrer">this</a> video might tend to be useful to what BatchNorm does. This said, batch normalization does have a regularizing effect which does to tend to increase generalization. </p>
  
  <p>Talking about generalization - A focus on regularization would probably be more helpful </p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-08-22T09:23:25.067Z
Answers.LastActivityDate: 2019-08-22T09:23:25.067Z
Answers.UserDisplayName: ashenoy
Body: <p>There are many known ways to overcome overfitting or make a model generalize better to unseen data. </p>
  
  <p>Here I would like to ask if normalizing/standardizing/similiraizing the train and test data is a plausible approach.</p>
  
  <p>By similarizing I mean making the images look alike by using some function that could be a Neural Network itself. I know that normally one would approach this the opposite way by augmenting and therefore increasing the variation in the training data. But is also possible to improve the model by restricting the variation of the training and test data?</p>
  
  <p>I know that this may not be the best approach and maybe too complicated but I see some use cases where known techniques of preventing overfitting aren't applicable. In those cases, having a network that can normalize/standardize/similarize the "style" of different images could be very useful.</p>
  
  <p>Unfortunately I didn't find a single paper discussing this approach.</p>
  
Tags: <neural-networks><deep-learning><overfitting>
Title: Is normalizing the data a way to improve generalization?
UserDisplayName: oezguensi
ThreadText: # Is normalizing the data a way to improve generalization?
  
  (Asked by: username_0 on 2019-08-22)
  
  There are many known ways to overcome overfitting or make a model generalize better to unseen data.
  
  Here I would like to ask if normalizing/standardizing/similiraizing the train and test data is a plausible approach.
  
  By similarizing I mean making the images look alike by using some function that could be a Neural Network itself. I know that normally one would approach this the opposite way by augmenting and therefore increasing the variation in the training data. But is also possible to improve the model by restricting the variation of the training and test data?
  
  I know that this may not be the best approach and maybe too complicated but I see some use cases where known techniques of preventing overfitting aren't applicable. In those cases, having a network that can normalize/standardize/similarize the "style" of different images could be very useful.
  
  Unfortunately I didn't find a single paper discussing this approach.
  
  **Tags:** neural-networks, deep-learning, overfitting
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2019-08-22. Score: 1
  
  Batch Normalization is usually known to speed up the learning process as it makes the weights in the deeper layers more robust. It restricts the distribution of the weights in a particular layer - [this](https://www.youtube.com/watch?v=nUUqwaxLnWs) video might tend to be useful to what BatchNorm does. This said, batch normalization does have a regularizing effect which does to tend to increase generalization.
  
  Talking about generalization - A focus on regularization would probably be more helpful
  
  
  ---
  
  