Solved by Oli in post #2 
              
              
                Hi there! 
I don’t see any real faults in your code (you don’t need to wrap your tensors in Variable(…) ) and can’t explain the big difference in performance. 
One thing that does speed up pytorch performance is this line, but it adds some overhead during the first few batches so is more useful for …