Deep Neural Networks involve Convolution and Matrix Multiplication operations which have a well defined hard upper bound in terms of speed wrt number of cores, GPUs (~thousands of processors) are in thus indispensable achieving a faster performance. There are newer interesting approaches such as reducing multiplication operations which might improve inference&#x2F;forward speed even further. <a href="http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1510.03009" rel="nofollow">http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1510.03009</a>