Answers.Body: <p>The answer is I was too tired to see I was using the same model for validation every epoch, instead of that epoch's model.</p>
  
  <p>Write good code, and this won't happen to you.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-02-09T12:29:20.307Z
Answers.LastActivityDate: 2020-02-09T12:29:20.307Z
Answers.UserDisplayName: Gulzar
Body: <p>I trained <a href="https://arxiv.org/pdf/1710.00925.pdf" rel="nofollow noreferrer">this network</a> from <a href="https://github.com/natanielruiz/deep-head-pose" rel="nofollow noreferrer">this github</a>.</p>
  
  <p>The training went well, and returns nice results for new, unseen images.</p>
  
  <p>On training, the loss changed (decreased), thus I must assume the weights changed as well.</p>
  
  <p>On training, I saved a snapshot of the net every epoch.</p>
  
  <p>When trying to run a validation set through each epoch's snapshot, I get the exact same results on every epoch.</p>
  
  <p>How can this be possible? What's causing this?</p>
  
Tags: <machine-learning><deep-learning>
Title: Trained a regression network and getting EXACT same result on validation set, on every epoch
UserDisplayName: Gulzar
ThreadText: # Trained a regression network and getting EXACT same result on validation set, on every epoch
  
  (Asked by: username_0 on 2020-02-08)
  
  I trained [this network](https://arxiv.org/pdf/1710.00925.pdf) from [this github](https://github.com/natanielruiz/deep-head-pose).
  
  The training went well, and returns nice results for new, unseen images.
  
  On training, the loss changed (decreased), thus I must assume the weights changed as well.
  
  On training, I saved a snapshot of the net every epoch.
  
  When trying to run a validation set through each epoch's snapshot, I get the exact same results on every epoch.
  
  How can this be possible? What's causing this?
  
  **Tags:** machine-learning, deep-learning
  
  ---
  
  ## 1 answers
  
  ### Answer by username_0 on 2020-02-09. Score: 0 | Accepted answer
  
  The answer is I was too tired to see I was using the same model for validation every epoch, instead of that epoch's model.
  
  Write good code, and this won't happen to you.
  
  
  ---
  
  