Yes, it&#x27;s still the case. Moore&#x27;s Law is still alive (e.g. Tegra X1 vs K1). 
However, this paper is not about using specialized architectures, it&#x27;s about compressing weight matrices and putting them in cache.