Solved by tom in post #2 
              
              
                There was an issue with cuda 10.1 minor versions between anaconda’s cuda and PyTorch’s cuda differing causing excessive JIT compiles. 
It is fixed and reinstalling PyTorch helps. 
Best regards 
Thomas