I’ve checked the parameters of my model in the pytorch 1.0 version, so there is a parameter named “num_batches_tracked” in every BN layer. Just as follows:
bn1.weight
bn1.bias
bn1.running_mean
bn1.running_var
bn1.num_batches_tracked
However, my pretrained model is from 0.3.1 version. I also checked the parameters of the pretrained model but found that there is not a  parameter named “num_batches_tracked”. There are only four parameters in each BN layer:
bn1.weight
bn1.bias
bn1.running_mean
bn1.running_var
So when I load the pretrained model directly, it doesn’t match.
How can I solve this problem ?  I also don’t know why  there is a new param in BN layer in the pytorch >=0.4.0 versions. What for ?