I understand that we need a stable running_mean and running_std for eval(). But I thought pytorch already keeps a running_mean and running_std during train() and use them for eval(). Is that not the case? I’m a bit confused on why we need to get a running_mean and running_std for eval() separately. We cannot use the running_mean and running_std from train()?
Also, I am using InstanceNorm2D which is suppose to perform the same in train() and eval()?

  
      github.com/gchanan/pytorch
  
  
      
    
  


  fixes eval mode in InstanceNorm (#1604) 34


  fixes https://github.com/pytorch/pytorch/issues/1541


  by DmitryUlyanov
  on 05:27PM - 21 May 17



  changed 1 files
  with 1 additions
  and 1 deletions.


  
  
    
    
  
  


Thanks!