image.png1100×740 109 KB

@ptrblck  Alright so if I do one network with same input and try it twice I get the same output at two different stages of the forward. BUT if If recreate the same network and use the same input and compare its ouputs to the previous network, I dont have the same thing  (cf screen shot above
Edit: if I create two models and check if their weight are the same using :

for p1, p2 in zip(model1.parameters(), model2.parameters()):
if p1.data.ne(p2.data).sum() > 0:
print(“nop”)
print(“true”)

I find that their weights are not the same, might be the reason of the difference. What is the correct way to copy weights ?