Solved by levan92 in post #3 
              
              
                So sorry! I just found the mistake while writing out the losses and outputs, it was an oversight on my part: in eval.py when we build our model with the inference=True argument, it will slap on a softmax layer at the end of the resnet, thereby contributing to the difference in output features when c…