Solved by ptrblck in post #5 
              
              
                Yeah, like I said, seeding is a bit tricky in such a situation. That is why in my example I’ve loaded the state_dict and also set the random seed for both forward passes to get the same result. 
As @musicpiece explained, each additional call to the pseudo random number generator might yield a differ…