There was an issue with cuda 10.1 minor versions between anaconda’s cuda and PyTorch’s cuda differing causing excessive JIT compiles.
It is fixed and reinstalling PyTorch helps.
Best regards
Thomas

  
      github.com/pytorch/pytorch
  
  
    
  
	  
  

  
    
      Very Slow Moving Tensor to CUDA device (CUDA 10.1 with PyTorch 1.3) 41
    

    
      
        opened 
        
          
        
        Oct 12, 2019
      
      

        
          closed 
        
          
        
        Oct 12, 2019
      
        

      
        
          
          dhpollack
        
      
    
  



  🐛 Bug
Moving tensors to cuda devices is super slow when using pytorch 1.3 and CUDA 10.1. The issue does not occur...



    high priority
    module: binaries