Even the one I have written is a very simple convolutional network. If you consider things like deep residual networks your speedup can be up to order of 100’s provided you have enough ram to fit everything. See for instance: https://github.com/iAvicenna/Residual-Network-Pytorch 28. I dont think it would even be sensible to try to run this on CPU.