Darpa Goes “Meta” with Machine Learning for Machine Learning (2016)
I'm curious to hear from current researchers:<p>Back when I did some work in neural networks (10-15 years ago), the field had become saturated with 'meta' papers on topology generation, and also on optimization techniques, (slightly better gradient descent, pruning techniques etc). Neural networks had become more art than science. At the end of that period, I got the distinct sense that these were signs that the field had stalled in any significant break throughs. Soon after they fell out favor for well known reasons.<p>I'm curious outside of the current hype, if there's a sense of that now with the current field practitioners and saturation of papers.