thanks Arul that’s nice to know! I did not realize that when the ordered dictionary is constructed the weights are already initialized. Does that also mean if I move the line torch.manual_seed(1) to the first line of the for loop I should be good? Because in the last iteration of the loop, the ordered dictionary contains all the layers needed for the model.
Secondly, the weight reset is also useful! But in that case, after resetting, how do I set it to what a particular seed would have done? like say after reset, set the weights to what would have been for seed(1)?