Answers.Body: <p>It is common to have root mean squared error (RMSE) greater on the test dataset than on the training dataset (this is equal to having accuracy/score higher for model in training dataset than test dataset). This normally happens because the training data are assesed on the same data that have been learnt before, while the test dataset may have data that are unknown / not common that may give more errors or misclassification when doing prediction.</p>
  
  <p>But if your model shows your test dataset have way too high RMSE result rather than your training dataset RMSE result, it may indicates that overfitting happens.</p>
  
  <p>If overfitting happens, there are a lot of reasons this could happen. 
  Referenced from <a href="https://elitedatascience.com/overfitting-in-machine-learning" rel="nofollow noreferrer">https://elitedatascience.com/overfitting-in-machine-learning</a>, some factors that causes overfitting are:</p>
  
  <ul>
  <li>Complexity of data (e.g. there are irrelevant input features). This can be solved with removing irrelevant input features. </li>
  <li>Not enough training data. This can be solved by training with more data (Eventhough this may not always succeed. Sometimes it may give noise towards data), etc. </li>
  </ul>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-03-21T04:00:19.477Z
Answers.Text: I concur with the comment from @Angela Marpaung. You will always are going to have a higher RMSE in testing than training because testing hasn't been seen by the model.
  
  Remember models tend to `memorize` the answer so showing new data to the model makes them struggle to `find` the answer in the figurative sense.
   
  If you have a way disparate higher value of RMSE in testing that may indicate `overfitting`, but looking at the scale of your values in training/testing for RMSE it looks like the model can generalize. In this situation your model is a `generalized` model. 
  Hope this helps.
Answers.UserDisplayName: user_dhrn
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-04-21T10:16:48.430Z
Answers.LastActivityDate: 2020-04-21T11:04:58.263Z
Answers.LastEditDate: 2020-04-21T11:04:58.263Z
Answers.UserDisplayName: Angela Marpaung
Answers.Body: <p>The training error (on any error metrics, not only for RMSE) will usually be less than the test error because the same data used to fit the model is employed to assess its training error. In other words, a fitted model usually adapts to the training data and hence its training error will be overly optimistic (too small). In fact, it is often the case that the training error steadily decreases as the size of the model increases.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-04-21T10:08:18.533Z
Answers.LastActivityDate: 2020-04-21T10:08:18.533Z
Answers.UserDisplayName: Ahmad Rayi
Answers.Body: <blockquote>
    <p>I am training a model and i am getting test results greater than train results.</p>
  </blockquote>
  
  <p>You don't give us too many details, but most probably it's <strong>underfitting</strong>.</p>
  
  <blockquote>
    <p>What could be the reason behind this?</p>
  </blockquote>
  
  <ul>
  <li><p>Underfitting is often a result of an excessively simple model.</p></li>
  <li><p>Too much regularization techniques were used.</p></li>
  </ul>
  
  <blockquote>
    <p>Is this acceptable to get the RMSE greater in test data?</p>
  </blockquote>
  
  <p>Yes, but that indicates a problem with model, so you should be aware of the consequences. </p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-31T12:34:58.807Z
Answers.LastActivityDate: 2020-03-31T12:34:58.807Z
Answers.UserDisplayName: fuwiak
Answers.Body: <p>RMSE stands for Root Mean Squared Error. As the name suggests, it is calculated by taking the square root over the mean of the squared errors of individual points. </p>
  
  <p>It is normal for the test error to be higher than the train error and in most cases, the test error will be greater than the train error. </p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-30T20:52:39.310Z
Answers.LastActivityDate: 2020-03-30T21:37:42.090Z
Answers.LastEditDate: 2020-03-30T21:37:42.090Z
Answers.UserDisplayName: Sooryakiran Pallikulathil
Body: <p>I am new to deep learning.</p>
  
  <p>I am training a model and I am getting a root mean squared error (RMSE) greater on the test dataset than on the training dataset. </p>
  
  <p><a href="https://i.sstatic.net/qlotg.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/qlotg.png" alt="enter image description here"></a></p>
  
  <p>What could be the reason behind this? Is this acceptable to get the RMSE greater in test data?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-03-31T13:19:33.080Z
Comments.Text: I think you should provide more details such as 1. your model architecture (I assume you are using a neural network) and 2. a plot of the evolution of the error and performance (on both the test and training data) throughout the epochs.
Comments.UserDisplayName: nbro
Tags: <deep-learning><performance><mean-squared-error>
Title: Is it normal to have the root mean squared error greater on the test dataset than on the training dataset?
UserDisplayName: Debugger
ThreadText: # Is it normal to have the root mean squared error greater on the test dataset than on the training dataset?
  
  (Asked by: username_0 on 2020-03-30)
  
  I am new to deep learning.
  
  I am training a model and I am getting a root mean squared error (RMSE) greater on the test dataset than on the training dataset.
  
  [![enter image description here](https://i.sstatic.net/qlotg.png)](https://i.sstatic.net/qlotg.png)
  
  What could be the reason behind this? Is this acceptable to get the RMSE greater in test data?
  
  **Tags:** deep-learning, performance, mean-squared-error
  
  > **Comments:**
  > **username_1**: I think you should provide more details such as 1. your model architecture (I assume you are using a neural network) and 2. a plot of the evolution of the error and performance (on both the test and training data) throughout the epochs.  
  
  ---
  
  ## 4 answers
  
  ### Answer by username_2 on 2020-04-21. Score: 1
  
  It is common to have root mean squared error (RMSE) greater on the test dataset than on the training dataset (this is equal to having accuracy/score higher for model in training dataset than test dataset). This normally happens because the training data are assesed on the same data that have been learnt before, while the test dataset may have data that are unknown / not common that may give more errors or misclassification when doing prediction.
  
  But if your model shows your test dataset have way too high RMSE result rather than your training dataset RMSE result, it may indicates that overfitting happens.
  
  If overfitting happens, there are a lot of reasons this could happen.
  Referenced from <https://elitedatascience.com/overfitting-in-machine-learning>, some factors that causes overfitting are:
  
  * Complexity of data (e.g. there are irrelevant input features). This can be solved with removing irrelevant input features.
  * Not enough training data. This can be solved by training with more data (Eventhough this may not always succeed. Sometimes it may give noise towards data), etc.
  
  > **Comments:**
  > **username_3**: I concur with the comment from @username_2. You will always are going to have a higher RMSE in testing than training because testing hasn't been seen by the model.  Remember models tend to `memorize` the answer so showing new data to the model makes them struggle to `find` the answer in the figurative sense.   If you have a way disparate higher value of RMSE in testing that may indicate `overfitting`, but looking at the scale of your values in training/testing for RMSE it looks like the model can generalize. In this situation your model is a `generalized` model.  Hope this helps.  
  
  ---
  
  ### Answer by username_4 on 2020-04-21. Score: 0
  
  The training error (on any error metrics, not only for RMSE) will usually be less than the test error because the same data used to fit the model is employed to assess its training error. In other words, a fitted model usually adapts to the training data and hence its training error will be overly optimistic (too small). In fact, it is often the case that the training error steadily decreases as the size of the model increases.
  
  
  ---
  
  ### Answer by username_5 on 2020-03-31. Score: 0
  
  > I am training a model and i am getting test results greater than train results.
  
  You don't give us too many details, but most probably it's **underfitting**.
  
  > What could be the reason behind this?
  
  * Underfitting is often a result of an excessively simple model.
  * Too much regularization techniques were used.
  
  > Is this acceptable to get the RMSE greater in test data?
  
  Yes, but that indicates a problem with model, so you should be aware of the consequences.
  
  
  ---
  
  ### Answer by username_6 on 2020-03-30. Score: 0
  
  RMSE stands for Root Mean Squared Error. As the name suggests, it is calculated by taking the square root over the mean of the squared errors of individual points.
  
  It is normal for the test error to be higher than the train error and in most cases, the test error will be greater than the train error.
  
  
  ---
  
  