Solved by ptrblck in post #2 
              
              
                Each call into the pseudo-random number generator will increase its state. 
Your model creation is most likely calling into a the pseudo-random number generator at some point, which will make all following (random) calls different. 
A simple code snippet is here: 
torch.manual_seed(2809)

lin1 = nn.…