Answers.Body: <p>There is a paper called <a href="https://arxiv.org/pdf/1608.08225.pdf" rel="nofollow noreferrer">Why does Deep Learning work so well?</a>.</p>
  <blockquote>
  <p>However, it is still not fully understood why deep learning works so well. In contrast to GOFAI (“good old-fashioned AI”) algorithms that are hand-crafted and fully understood analytically, many algorithms using artificial neural networks are understood only at a heuristic level, where we empirically know that certain training protocols employing large data sets will result in excellent performance. This is reminiscent of the situation with human brains: we know that if we train a child according to a certain curriculum, she will learn certain skills — but we lack a deep understanding of how her brain accomplishes this.</p>
  </blockquote>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2017-03-15T10:47:38.643Z
Answers.LastActivityDate: 2021-12-22T18:36:38.027Z
Answers.LastEditDate: 2021-12-22T18:36:38.027Z
Answers.UserDisplayName: BlindKungFuMaster
Answers.Body: <p>This is very much the case. Deep learning models even shallow ones such as stacked autoencoders and neural networks are not fully understood. There are efforts to understand what is happening to the optimization process for such a complex variable intensive function. But, this is a difficult task. </p>
  
  <p>One way that researchers are using to discover how deep learning works is by using generative models. First we train a learning algorithm and handicap it systematically whilst asking it to generate examples. By observing the resulting generated examples we will be able to infer what is happening in the algorithm at a more significant level. This is very much like using inhibitors in neuroscience to understand what different components of the brain are used for. For example, we know that the visual cortex is where it is because if we damage it you will go blind.  </p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-03-15T15:21:34.540Z
Answers.LastActivityDate: 2017-03-15T15:21:34.540Z
Answers.UserDisplayName: JahKnows
Answers.Body: <p>It probably depends on what one means by "fundamental theory", but there is no lack of rigorous quantitative theory in deep learning, some of which is very general, despite claims to the contrary.</p>
  
  <p>One good example is the work around energy-based methods for learning. See e.g. Neal &amp; Hinton's work on variational inference and free energy: <a href="http://www.cs.toronto.edu/~fritz/absps/emk.pdf" rel="nofollow noreferrer">http://www.cs.toronto.edu/~fritz/absps/emk.pdf</a></p>
  
  <p>Also this guide to energy minimization as a "common theoretical framework for many learning models" by Yann LeCun and colleagues: <a href="http://yann.lecun.com/exdb/publis/pdf/lecun-06.pdf" rel="nofollow noreferrer">http://yann.lecun.com/exdb/publis/pdf/lecun-06.pdf</a></p>
  
  <p>And a general framework for energy-based models by Scellier and Bengio:
  <a href="https://arxiv.org/pdf/1602.05179.pdf" rel="nofollow noreferrer">https://arxiv.org/pdf/1602.05179.pdf</a></p>
  
  <p>There is also Hinton &amp; Sejnowski's earlier work which shows analytically that a particular Hopfield-inspired network + unsupervised learning algorithm can approximate Bayes-optimal inference: <a href="https://papers.cnl.salk.edu/PDFs/Optimal%20Perceptual%20Inference%201983-646.pdf" rel="nofollow noreferrer">https://papers.cnl.salk.edu/PDFs/Optimal%20Perceptual%20Inference%201983-646.pdf</a></p>
  
  <p>There are many papers linking deep learning with theoretical neuroscience as well, such as the following, which shows that the effects of backpropagation can be achieved in biologically plausible neural architectures:
  <a href="https://arxiv.org/pdf/1411.0247.pdf" rel="nofollow noreferrer">https://arxiv.org/pdf/1411.0247.pdf</a></p>
  
  <p>Of course there are many open questions and no single, uncontroverisal unified theory, but the same could be said of almost any field.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-03-20T06:23:18.337Z
Answers.LastActivityDate: 2017-03-20T16:10:58.973Z
Answers.LastEditDate: 2017-03-20T16:10:58.973Z
Answers.UserDisplayName: a.kief
Answers.Body: <p>A key question that remains in the theory of deep learning is why such huge models (with many more parameters than data points) don't overfit on the datasets we use. </p>
  
  <p>Classical theory based on complexity measures does not explain the behaviour of practical neural networks. For instance estimates of VC dimension give vacuous generalisation bounds. As far as I know, the tightest (upper and lower) bounds on the VC dimension are given in [1] and are on the order of the number of weights in the network. Clearly this worst case complexity cannot explain how e.g. a big resnet generalises on CIFAR or MNIST. </p>
  
  <p>Recently there have been other attempts at ensuring generalisation for neural networks, for instance by relation to the neural tangent kernel or by various norm measures on the weights. Respectively, these have been found to not apply to practically sized networks and to have other unsatisfactory properties [2]. </p>
  
  <p>There is some work in the PAC Bayes framework for non-vacuous bounds, e.g. [3]. These setups, however, require some knowledge of the trained the network and so are different in flavour to the classical PAC analysis.</p>
  
  <p>Some other aspects:</p>
  
  <ul>
  <li><p>optimisation: how come we get 'good' solutions from gradient descent on such a non-convex problem? (There are some answers to this in recent literature)</p></li>
  <li><p>interpretability: Can we explain on an intuitive level what the network is 'thinking'? (Not my area)</p></li>
  </ul>
  
  <p>(incomplete) references:</p>
  
  <ul>
  <li>[1] <a href="https://arxiv.org/abs/1703.02930" rel="nofollow noreferrer">https://arxiv.org/abs/1703.02930</a></li>
  <li>[2] <a href="http://papers.nips.cc/paper/9336-uniform-convergence-may-be-unable-to-explain-generalization-in-deep-learning" rel="nofollow noreferrer">http://papers.nips.cc/paper/9336-uniform-convergence-may-be-unable-to-explain-generalization-in-deep-learning</a></li>
  <li>[3] <a href="https://arxiv.org/abs/1804.05862" rel="nofollow noreferrer">https://arxiv.org/abs/1804.05862</a></li>
  </ul>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-04-20T14:42:12.550Z
Answers.LastActivityDate: 2020-04-20T14:42:12.550Z
Answers.UserDisplayName: user27182
Answers.Body: <p>Your wikipedia quote is <strong>questionable</strong> because deep learning is well developed. In fact, there is a <code>[citation needed]</code> on the Wikipedia page. </p>
  
  <p>Look at <a href="https://github.com/terryum/awesome-deep-learning-papers" rel="nofollow noreferrer">https://github.com/terryum/awesome-deep-learning-papers</a>. There are like 100 papers in the link, do you still think deep-learning lacks "general theory"?</p>
  
  <p>Yes. Deep learning is hard to understand because it is a very complicated model. But that doesn't mean we don't have the theories.</p>
  
  <p>Maybe the <code>lime</code> package and it's paper: <strong>"Why Should I Trust You?": Explaining the Predictions of Any Classifier</strong> will help you. The paper suggests we should be able to approximate a complicated model (includes deep learning) locally with a much simpler model. </p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-09T22:31:49.467Z
Answers.Text: Lots of interesting applications doesn't mean that those applications were developed following some rigorous process. "Hmm... maybe I should try 8 layers instead? Ah.. it works! Great, let's publish the results."
Answers.UserDisplayName: chris
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-03-12T10:58:58.147Z
Answers.Text: "Deep learning is hard to understand because it is a very complicated model. But that doesn't mean we don't have the theories." True, but we _also_ don't have the theories. There is very little mathematical understanding of the techniques in the literature. Most explanations for how or why deep learning works are based on intuition and empiricism, which is okay, but doesn't constitute a theory imo.
Answers.UserDisplayName: user27182
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-03-20T06:42:24.363Z
Answers.LastActivityDate: 2017-03-20T12:38:05.967Z
Answers.LastEditDate: 2017-03-20T12:38:05.967Z
Answers.UserDisplayName: SmallChess
Answers.Body: <p>I'd like to point out there isn't a good theory on why machine learning works in general. VC bounds still assume a model, but reality doesn't fit any of these mathematical ideals. Ultimately when it comes to application everything comes down to emperical results. Even quantifying the similarity between images using an algorithm which is consistent with humans intuitive understanding is really hard </p>
  
  <p>Anyway NN dont work well in their fully connected form. All successful networks have some kind of regularization built into the network architecture (CNN, LSTM, etc).</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-04-20T15:52:51.273Z
Answers.LastActivityDate: 2020-04-20T15:52:51.273Z
Answers.UserDisplayName: FourierFlux
Body: <p>I heard several times that one of the fundamental/open problems of deep learning is the lack of &quot;general theory&quot; on it, because, actually, we don't know why deep learning works so well. Even the Wikipedia page on deep learning has <a href="https://en.wikipedia.org/wiki/Deep_learning#Criticism_and_comment" rel="nofollow noreferrer">similar comments</a>. Are such statements credible and representative of the state of the field?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-12-22T21:26:23.403Z
Comments.Text: There probably is not a commonly approved definition of deep learning.... Even if Sejnowski wrote an entire book on that very topic.
Comments.UserDisplayName: Basile Starynkevitch
Tags: <deep-learning><computational-learning-theory>
Title: Is there actually a lack of fundamental theory on deep learning?
UserDisplayName: heleone
ThreadText: # Is there actually a lack of fundamental theory on deep learning?
  
  (Asked by: username_0 on 2017-03-15)
  
  I heard several times that one of the fundamental/open problems of deep learning is the lack of "general theory" on it, because, actually, we don't know why deep learning works so well. Even the Wikipedia page on deep learning has [similar comments](https://en.wikipedia.org/wiki/Deep_learning#Criticism_and_comment). Are such statements credible and representative of the state of the field?
  
  **Tags:** deep-learning, computational-learning-theory
  
  > **Comments:**
  > **username_1**: There probably is not a commonly approved definition of deep learning.... Even if Sejnowski wrote an entire book on that very topic.  
  
  ---
  
  ## 6 answers
  
  ### Answer by username_2 on 2017-03-15. Score: 6
  
  There is a paper called [Why does Deep Learning work so well?](https://arxiv.org/pdf/1608.08225.pdf).
  
  > However, it is still not fully understood why deep learning works so well. In contrast to GOFAI (“good old-fashioned AI”) algorithms that are hand-crafted and fully understood analytically, many algorithms using artificial neural networks are understood only at a heuristic level, where we empirically know that certain training protocols employing large data sets will result in excellent performance. This is reminiscent of the situation with human brains: we know that if we train a child according to a certain curriculum, she will learn certain skills — but we lack a deep understanding of how her brain accomplishes this.
  
  
  ---
  
  ### Answer by username_3 on 2017-03-15. Score: 4
  
  This is very much the case. Deep learning models even shallow ones such as stacked autoencoders and neural networks are not fully understood. There are efforts to understand what is happening to the optimization process for such a complex variable intensive function. But, this is a difficult task.
  
  One way that researchers are using to discover how deep learning works is by using generative models. First we train a learning algorithm and handicap it systematically whilst asking it to generate examples. By observing the resulting generated examples we will be able to infer what is happening in the algorithm at a more significant level. This is very much like using inhibitors in neuroscience to understand what different components of the brain are used for. For example, we know that the visual cortex is where it is because if we damage it you will go blind.
  
  
  ---
  
  ### Answer by username_4 on 2017-03-20. Score: 4
  
  It probably depends on what one means by "fundamental theory", but there is no lack of rigorous quantitative theory in deep learning, some of which is very general, despite claims to the contrary.
  
  One good example is the work around energy-based methods for learning. See e.g. Neal & Hinton's work on variational inference and free energy: <http://www.cs.toronto.edu/~fritz/absps/emk.pdf>
  
  Also this guide to energy minimization as a "common theoretical framework for many learning models" by Yann LeCun and colleagues: <http://yann.lecun.com/exdb/publis/pdf/lecun-06.pdf>
  
  And a general framework for energy-based models by Scellier and Bengio:
  <https://arxiv.org/pdf/1602.05179.pdf>
  
  There is also Hinton & Sejnowski's earlier work which shows analytically that a particular Hopfield-inspired network + unsupervised learning algorithm can approximate Bayes-optimal inference: <https://papers.cnl.salk.edu/PDFs/Optimal%20Perceptual%20Inference%201983-646.pdf>
  
  There are many papers linking deep learning with theoretical neuroscience as well, such as the following, which shows that the effects of backpropagation can be achieved in biologically plausible neural architectures:
  <https://arxiv.org/pdf/1411.0247.pdf>
  
  Of course there are many open questions and no single, uncontroverisal unified theory, but the same could be said of almost any field.
  
  
  ---
  
  ### Answer by username_5 on 2020-04-20. Score: 0
  
  A key question that remains in the theory of deep learning is why such huge models (with many more parameters than data points) don't overfit on the datasets we use.
  
  Classical theory based on complexity measures does not explain the behaviour of practical neural networks. For instance estimates of VC dimension give vacuous generalisation bounds. As far as I know, the tightest (upper and lower) bounds on the VC dimension are given in [1] and are on the order of the number of weights in the network. Clearly this worst case complexity cannot explain how e.g. a big resnet generalises on CIFAR or MNIST.
  
  Recently there have been other attempts at ensuring generalisation for neural networks, for instance by relation to the neural tangent kernel or by various norm measures on the weights. Respectively, these have been found to not apply to practically sized networks and to have other unsatisfactory properties [2].
  
  There is some work in the PAC Bayes framework for non-vacuous bounds, e.g. [3]. These setups, however, require some knowledge of the trained the network and so are different in flavour to the classical PAC analysis.
  
  Some other aspects:
  
  * optimisation: how come we get 'good' solutions from gradient descent on such a non-convex problem? (There are some answers to this in recent literature)
  * interpretability: Can we explain on an intuitive level what the network is 'thinking'? (Not my area)
  
  (incomplete) references:
  
  * [1] <https://arxiv.org/abs/1703.02930>
  * [2] <http://papers.nips.cc/paper/9336-uniform-convergence-may-be-unable-to-explain-generalization-in-deep-learning>
  * [3] <https://arxiv.org/abs/1804.05862>
  
  
  ---
  
  ### Answer by username_6 on 2017-03-20. Score: 0
  
  Your wikipedia quote is **questionable** because deep learning is well developed. In fact, there is a `[citation needed]` on the Wikipedia page.
  
  Look at <https://github.com/terryum/awesome-deep-learning-papers>. There are like 100 papers in the link, do you still think deep-learning lacks "general theory"?
  
  Yes. Deep learning is hard to understand because it is a very complicated model. But that doesn't mean we don't have the theories.
  
  Maybe the `lime` package and it's paper: **"Why Should I Trust You?": Explaining the Predictions of Any Classifier** will help you. The paper suggests we should be able to approximate a complicated model (includes deep learning) locally with a much simpler model.
  
  > **Comments:**
  > **username_7**: Lots of interesting applications doesn't mean that those applications were developed following some rigorous process. "Hmm... maybe I should try 8 layers instead? Ah.. it works! Great, let's publish the results."  
  > **username_5**: "Deep learning is hard to understand because it is a very complicated model. But that doesn't mean we don't have the theories." True, but we _also_ don't have the theories. There is very little mathematical understanding of the techniques in the literature. Most explanations for how or why deep learning works are based on intuition and empiricism, which is okay, but doesn't constitute a theory imo.  
  
  ---
  
  ### Answer by username_8 on 2020-04-20. Score: 0
  
  I'd like to point out there isn't a good theory on why machine learning works in general. VC bounds still assume a model, but reality doesn't fit any of these mathematical ideals. Ultimately when it comes to application everything comes down to emperical results. Even quantifying the similarity between images using an algorithm which is consistent with humans intuitive understanding is really hard
  
  Anyway NN dont work well in their fully connected form. All successful networks have some kind of regularization built into the network architecture (CNN, LSTM, etc).
  
  
  ---
  
  