nVidia&#x27;s Tesla processors and high-end GPUs are really stellar. We recently bought a machine with a Tesla K20c with some colleagues and the speed-up for neural net training has been tremendous.<p>E.g. for some of my nets (NLP tasks) training time has gone from hours to 15-30 minutes. This is great when you are just experimenting with different approaches to a problem and want to iterate quickly.<p>It&#x27;s also great that nVidia hasn&#x27;t been sitting on their laurels and released a library (cuDNN) of NN primitives that nearly everyone has been rebasing their packages on.