Darpa Goes “Meta” with Machine Learning for Machine Learning (2016)
I&#x27;m curious to hear from current researchers:<p>Back when I did some work in neural networks (10-15 years ago), the field had become saturated with &#x27;meta&#x27; papers on topology generation, and also on optimization techniques, (slightly better gradient descent, pruning techniques etc). Neural networks had become more art than science. At the end of that period, I got the distinct sense that these were signs that the field had stalled in any significant break throughs. Soon after they fell out favor for well known reasons.<p>I&#x27;m curious outside of the current hype, if there&#x27;s a sense of that now with the current field practitioners and saturation of papers.