Hi,
Looks like pytorch is not Optimized for CPU as it is done for GPU. And also on their high priority list to fix the same
You Can refer the below links on the same.

  
      github.com/pytorch/pytorch
  
  
    



Issue: Performance of Simple Use Case -  PyTorch vs Plain Python with Numpy 11


	
	opened by makeyourownneuralnetwork
	on 2017-05-23
	
	
	closed by soumith
	on 2017-05-26
	


Summary - PyTorch seems to be half as fast as plain Python for very simple networks.
Context
I am learning PyTorch because it...




  
  
    
    
  
  



  
    
    
    Is PyTorch slow on the CPU? 
  
  
    Recently there was this thread (https://twitter.com/gneubig/status/899826900834689028) on Twitter about how PyTorch is currently much slower than DyNet (between 10x and 20x). Is this exclusively a problem with CPU runs, i.e., the code would be much more competitive on the GPU? Why is it so slow and how likely is to be addressed in the recent future? Soumith promised (https://twitter.com/haldaume3/status/900775899431305217) that it would be addressed soon, but I would like to be sure that it is i…
  



  
      twitter.com
  
  
    

  
    Hal Daumé III (haldaume3)
   1


after all this, I really don't know whether I should be using dynet or pytorch :(

twitter.com/haldaume3/stat…

#NationalWaffleDay



  12:44 PM - 24 Aug 2017


  
  
    
    
  
  


If you are wondering what I did next after this bottleneck. I switched to the tensorflow implementation.