### Comment:
&gt; and all we can do is shove more cores into them. 
  
 You do realize that's exactly how GPUs keep increasing their performance? By adding more stream processors/cuda cores. 
  
 Multithreaded CPUs are the future as well. Most CPU heavy software is multithreaded now days. Besides Cloud infrastructure is the name of the game. Cores do matter a lot.

### REPLY:
GPU hardware improves by many factors than just stacking processing units. The memory bus, the bandwidth, the architecture, the die shrinkages all contribute to consistent 20% performance gains each generation and 50% or more in machine learning tasks.  
  
 CPUs have been like... 8-9% each generation. Not nearly as impressive.

### END.