Answers.Body: <p>Deep learning is actually pretty useful (relative to other techniques) <em>precisely when there is no simple mapping between input and output</em>, and features from the raw input need to be aggregated and combined in complex ways by successive layers to form the output.</p>
  
  <p>As I pointed out in my answer to the <a href="https://ai.stackexchange.com/questions/205/how-to-write-c-decompiler-using-ai">AI SE decompilation question</a>, there is recent DL research which takes a natural language description as input and <a href="http://arxiv.org/pdf/1510.07211.pdf" rel="nofollow noreferrer">generates program text as output</a>. Despite working in this general research area, I was personally surprised by this - the problem is significantly harder than the 'AI math' link you provide above.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-05T18:44:20.053Z
Answers.LastActivityDate: 2016-08-05T18:44:20.053Z
Answers.LastEditDate: 2017-04-13T12:53:10.013Z
Answers.UserDisplayName: NietzscheanAI
Answers.Body: <p>Have you read the book <a href="http://libgen.io/ads.php?md5=F18395FBEF45575CF68BBD5AD26DF035" rel="nofollow noreferrer">The Master Algorithm:</a> by Pedro Domingos?</p>
  
  <p>He discusses the present day machine learning algorithms... Their strengths, weaknesses and applications...</p>
  
  <ul>
  <li>Deep Neural Network</li>
  <li>Genetic Algorithm</li>
  <li>Bayesian Network </li>
  <li>Support Vector Machine</li>
  <li>Inverse Deduction </li>
  </ul>
  
  <p><a href="https://i.sstatic.net/9HpIP.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/9HpIP.png" alt="enter image description here"></a></p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-05T18:41:59.757Z
Answers.LastActivityDate: 2017-07-27T08:55:09.363Z
Answers.LastEditDate: 2017-07-27T08:55:09.363Z
Answers.UserDisplayName: Conor Cosnett
Body: <p>This <a href="http://blog.claymcleod.io/2016/06/01/The-truth-about-Deep-Learning/" rel="nofollow noreferrer">article</a> suggests that deep learning is not designed to produce the universal algorithm and cannot be used to create such a complex systems.</p>
  
  <p>First of all it requires huge amounts of computing power, time and effort to train the algorithm the right way and adding extra layers doesn't really help to solve complex problems which cannot be easily predicted.</p>
  
  <p>Secondly some tasks are extremely difficult or impossible to solve using DNN, like solving a <a href="https://ai.stackexchange.com/q/154/8">math</a> equations, predicting <a href="https://ai.stackexchange.com/q/225/8">pseudo-random lists</a>, <a href="https://ai.stackexchange.com/q/168/8">fluid mechanics</a>, guessing encryption algorithms, or <a href="https://ai.stackexchange.com/q/205/8">decompiling</a> unknown formats, because there is no simple mapping between input and output.</p>
  
  <p>So I'm asking, are there any alternative learning algorithms as powerful as deep architectures for general purpose problem solving? Which can solve more variety of problems, than "deep" architectures cannot?</p>
  
Tags: <deep-neural-networks><comparison><architecture>
Title: Are there any learning algorithms as powerful as "deep" architectures?
UserDisplayName: kenorb
ThreadText: # Are there any learning algorithms as powerful as "deep" architectures?
  
  (Asked by: username_0 on 2016-08-05)
  
  This [article](http://blog.claymcleod.io/2016/06/01/The-truth-about-Deep-Learning/) suggests that deep learning is not designed to produce the universal algorithm and cannot be used to create such a complex systems.
  
  First of all it requires huge amounts of computing power, time and effort to train the algorithm the right way and adding extra layers doesn't really help to solve complex problems which cannot be easily predicted.
  
  Secondly some tasks are extremely difficult or impossible to solve using DNN, like solving a [math](https://ai.stackexchange.com/q/154/8) equations, predicting [pseudo-random lists](https://ai.stackexchange.com/q/225/8), [fluid mechanics](https://ai.stackexchange.com/q/168/8), guessing encryption algorithms, or [decompiling](https://ai.stackexchange.com/q/205/8) unknown formats, because there is no simple mapping between input and output.
  
  So I'm asking, are there any alternative learning algorithms as powerful as deep architectures for general purpose problem solving? Which can solve more variety of problems, than "deep" architectures cannot?
  
  **Tags:** deep-neural-networks, comparison, architecture
  
  ---
  
  ## 2 answers
  
  ### Answer by username_2 on 2016-08-05. Score: 7 | Accepted answer
  
  Have you read the book [The Master Algorithm:](http://libgen.io/ads.php?md5=F18395FBEF45575CF68BBD5AD26DF035) by Pedro Domingos?
  
  He discusses the present day machine learning algorithms... Their strengths, weaknesses and applications...
  
  * Deep Neural Network
  * Genetic Algorithm
  * Bayesian Network
  * Support Vector Machine
  * Inverse Deduction
  
  [![enter image description here](https://i.sstatic.net/9HpIP.png)](https://i.sstatic.net/9HpIP.png)
  
  
  ---
  
  ### Answer by username_1 on 2016-08-05. Score: 4
  
  Deep learning is actually pretty useful (relative to other techniques) *precisely when there is no simple mapping between input and output*, and features from the raw input need to be aggregated and combined in complex ways by successive layers to form the output.
  
  As I pointed out in my answer to the [AI SE decompilation question](https://ai.stackexchange.com/questions/205/how-to-write-c-decompiler-using-ai), there is recent DL research which takes a natural language description as input and [generates program text as output](http://arxiv.org/pdf/1510.07211.pdf). Despite working in this general research area, I was personally surprised by this - the problem is significantly harder than the 'AI math' link you provide above.
  
  
  ---
  
  