snowe:

Edit: I just realised that when I instantiate two ResNets from PyTorch they also yield different results, even though they are the same. Is that behaviour to be expected? Is this because of some randomness in the batchnorm or so?


I cannot reproduce this issue:
torch.manual_seed(2809)

modelA = models.resnet18()
modelB = models.resnet18()
modelB.load_state_dict(modelA.state_dict())

x = torch.randn(8, 3, 224, 224)

outA = modelA(x)
outB = modelB(x)
print((outA - outB).abs().max())
> tensor(0., grad_fn=<MaxBackward1>)

Could you clarify your use case or post a code snippet to produce this issue?