Solved by Alexey_Demyanchuk in post #4 
              
              
                Hi, @Francisco_Yackel  As far as I understand, the most probable explanation of this difference is BatchNorm layers of your backbone. Even then you make requieres_grad = False on backbone layers, forward pass through the network will update running statistics of BatchNorm layers. So, you have to app…