Answers.Body: <p>Deep neural networks could - in principle - be a component of an <a href="https://en.wikipedia.org/wiki/Ensemble_learning" rel="nofollow">ensemble of machine learning algorithms</a>, yes.  Ensemble method basically just means use multiple algorithms and combining their output somehow.  </p>
  
  <p>Other than that, I don't see any special connection between deep learning and the idea of ensemble methods.  DL is just one more tool in the toolkit. </p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-09-15T15:50:56.390Z
Answers.LastActivityDate: 2016-09-15T15:50:56.390Z
Answers.UserDisplayName: mindcrime
Answers.Body: <p>You should think of them as different approaches. A deep neural net is a single independent model, whereas ensemble models are ensembles of many independent models.</p>
  
  <p>The primary connection between the two is <a href="https://ai.stackexchange.com/questions/40/what-is-the-dropout-technique">dropout</a>, a particular method of training deep neural nets that's inspired by ensemble methods. </p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-09-15T16:06:03.437Z
Answers.LastActivityDate: 2016-09-15T16:06:03.437Z
Answers.LastEditDate: 2017-04-13T12:53:10.013Z
Answers.UserDisplayName: Matthew Gray
Body: <p>According to the Wikipedia article on <a href="https://en.wikipedia.org/wiki/Deep_learning" rel="nofollow noreferrer">deep learning</a>:</p>
  <blockquote>
  <p>Deep learning is a branch of machine learning based on a set of algorithms that attempt to model high-level abstractions in data by using a deep graph with multiple processing layers, composed of multiple linear and non-linear transformations.</p>
  </blockquote>
  <blockquote>
  <p>Various deep learning architectures such as deep neural networks, convolutional deep neural networks, deep belief networks and recurrent neural networks have been applied to fields like computer vision, automatic speech recognition, natural language processing, audio recognition and bioinformatics where they have been shown to produce state-of-the-art results on various tasks.</p>
  </blockquote>
  <p>Can <em>deep neural networks</em> or <em>convolutional deep neural networks</em> be viewed as <em>ensemble-based</em> method of machine learning, or are they different approaches?</p>
  
Tags: <neural-networks><deep-learning><convolutional-neural-networks><computer-vision><ensemble-learning>
Title: Do deep learning algorithms represent ensemble-based methods?
UserDisplayName: Erba Aitbayev
ThreadText: # Do deep learning algorithms represent ensemble-based methods?
  
  (Asked by: username_0 on 2016-09-15)
  
  According to the Wikipedia article on [deep learning](https://en.wikipedia.org/wiki/Deep_learning):
  
  > Deep learning is a branch of machine learning based on a set of algorithms that attempt to model high-level abstractions in data by using a deep graph with multiple processing layers, composed of multiple linear and non-linear transformations.
  
  > Various deep learning architectures such as deep neural networks, convolutional deep neural networks, deep belief networks and recurrent neural networks have been applied to fields like computer vision, automatic speech recognition, natural language processing, audio recognition and bioinformatics where they have been shown to produce state-of-the-art results on various tasks.
  
  Can *deep neural networks* or *convolutional deep neural networks* be viewed as *ensemble-based* method of machine learning, or are they different approaches?
  
  **Tags:** neural-networks, deep-learning, convolutional-neural-networks, computer-vision, ensemble-learning
  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_2 on 2016-09-15. Score: 6 | Accepted answer
  
  You should think of them as different approaches. A deep neural net is a single independent model, whereas ensemble models are ensembles of many independent models.
  
  The primary connection between the two is [dropout](https://ai.stackexchange.com/questions/40/what-is-the-dropout-technique), a particular method of training deep neural nets that's inspired by ensemble methods.
  
  
  ---
  
  ### Answer by username_1 on 2016-09-15. Score: 2
  
  Deep neural networks could - in principle - be a component of an [ensemble of machine learning algorithms](https://en.wikipedia.org/wiki/Ensemble_learning), yes. Ensemble method basically just means use multiple algorithms and combining their output somehow.
  
  Other than that, I don't see any special connection between deep learning and the idea of ensemble methods. DL is just one more tool in the toolkit.
  
  
  ---
  
  