Natural Language, NLP, Cognition, Image Recognition, Convolutional Network.
could be solved with easier to handle linear or logistic regression. Moreover, this would grant us the ability to better evaluate intermediate solutions like Decision Trees, which are models halfway in between linear and non-linear models — a lot depends also on the specific implementation.