Solved by ptrblck in post #7 
              
              
                Thanks for the data! 
I loaded it and executed the provided code snippet, however I’m getting all finite outputs (even with executing the training loop several times). 
Which PyTorch version are you currently using? 
I tried to reproduce it with 1.6.0.dev20200611 and it’s working fine.