Solved by ptrblck in post #13 
              
              
                I get the same results, if I try to make sure to use the same calls into the PRNG: 
torch.manual_seed(2809)
modelA = ResNet(BasicBlock, [2, 2, 2, 2], 1000)
in_ = modelA.fc.in_features
classes = 10
modelA.fc = nn.Linear(in_features=in_, out_features=classes)
torch.manual_seed(2809)
modelB = ResNet(Ba…