Hey guys, we are interested in deploying our models on cloud CPUs as they are significantly cheaper than GPUs/TPUs etc.
Intel used to support cpu-based deployment:
  
      
      Intel
  
  
    

Getting Started with Intel® Optimization for PyTorch* on Second... 8

Accelerate deep learning PyTorch* code on second generation Intel® Xeon® Scalable processor with Intel® Deep Learning Boost.


  
  
    
    
  
  


What is the current status of CPU optimization for PyTorch models?
Is there a preferred distribution (conda etc.) to use?