What do you think of alternative, non-neural-network approaches to deep learning such as Bayesian networks[1] or Support Vector Machines (which as I understand it are largely dead, but the theory behind them is interesting and could lead to more developments).<p>Is the future of deep learning just massive neural networks on huge GPU clusters? Is anyone big doing research on new approaches, or just focusing on fixing the problems with neural networks? (Which, given that the whole idea of deep NNs is rather new anyway, I suppose it might be a little early to look at other algorithms.)<p>1. <a href="http:&#x2F;&#x2F;www.psy.cmu.edu&#x2F;~ckemp&#x2F;papers&#x2F;maask09.pdf" rel="nofollow">http:&#x2F;&#x2F;www.psy.cmu.edu&#x2F;~ckemp&#x2F;papers&#x2F;maask09.pdf</a>