Answers.Body: <p>The term was introduced to the machine learning and computer science community by <a href="https://scholar.google.com/citations?user=PI_3bqEAAAAJ&amp;hl=en" rel="nofollow noreferrer">Rina Dechter</a> in <a href="https://www.aaai.org/Library/AAAI/1986/aaai86-029.php" rel="nofollow noreferrer">Learning While Searching in Constraint-Satisfaction-Problems</a> (1986) [<a href="http://www.scholarpedia.org/article/Deep_Learning" rel="nofollow noreferrer">1</a>], where she writes</p>
  <blockquote>
  <p>Discovering all minimal conflict-sets amounts to acquiring all the possible information out of a dead-end. Yet, such <strong>deep learning</strong> may require considerable amount of work.</p>
  </blockquote>
  <blockquote>
  <p>When <strong>deep learning</strong> is used in conjunction with restricting the level of learning we get deep first-order learning (identifying minimal conflict sets of size 1) and deep second-order learning (i.e. identifying minimal conflict-sets of sizes 1 and 2).</p>
  </blockquote>
  <blockquote>
  <p>Our experiments (implemented in LISP on a Symbolits LISP Machine) show that in most cases both performance measures improve as we move from <strong>shallow learning</strong> to <strong>deep learning</strong> and from first-order to second order.</p>
  </blockquote>
  <p>However, note that the term <em>deep learning</em> was used before 1986 in other contexts, for example, in [<a href="https://link.springer.com/content/pdf/10.1007/BF00155616.pdf" rel="nofollow noreferrer">2</a>]. Moreover, note that Rina Dechter did not use the term in the context of neural networks, which was probably used later.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-07-31T12:23:12.810Z
Answers.LastActivityDate: 2020-08-01T03:19:33.563Z
Answers.LastEditDate: 2020-08-01T03:19:33.563Z
Answers.UserDisplayName: nbro
Body: <p>AFAIK, deep learning became popular in 2012 with the victory of <a href="http://www.image-net.org/challenges/LSVRC/2012/" rel="nofollow noreferrer">ImageNet Competition - Large Scale Visual Recognition Challenge 2012</a> where winners of this contest actually used deep learning techniques for optimizing the solution for object recognition.</p>
  <p>Who first coined the term deep learning? Is there any published research paper that first used that term?</p>
  
Tags: <deep-learning><terminology><history>
Title: Who first coined the term "deep learning"?
UserDisplayName: Pluviophile
ThreadText: # Who first coined the term "deep learning"?
  
  (Asked by: username_0 on 2020-07-31)
  
  AFAIK, deep learning became popular in 2012 with the victory of [ImageNet Competition - Large Scale Visual Recognition Challenge 2012](http://www.image-net.org/challenges/LSVRC/2012/) where winners of this contest actually used deep learning techniques for optimizing the solution for object recognition.
  
  Who first coined the term deep learning? Is there any published research paper that first used that term?
  
  **Tags:** deep-learning, terminology, history
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2020-07-31. Score: 0 | Accepted answer
  
  The term was introduced to the machine learning and computer science community by [Rina Dechter](https://scholar.google.com/citations?user=PI_3bqEAAAAJ&hl=en) in [Learning While Searching in Constraint-Satisfaction-Problems](https://www.aaai.org/Library/AAAI/1986/aaai86-029.php) (1986) [[1](http://www.scholarpedia.org/article/Deep_Learning)], where she writes
  
  > Discovering all minimal conflict-sets amounts to acquiring all the possible information out of a dead-end. Yet, such **deep learning** may require considerable amount of work.
  
  > When **deep learning** is used in conjunction with restricting the level of learning we get deep first-order learning (identifying minimal conflict sets of size 1) and deep second-order learning (i.e. identifying minimal conflict-sets of sizes 1 and 2).
  
  > Our experiments (implemented in LISP on a Symbolits LISP Machine) show that in most cases both performance measures improve as we move from **shallow learning** to **deep learning** and from first-order to second order.
  
  However, note that the term *deep learning* was used before 1986 in other contexts, for example, in [[2](https://link.springer.com/content/pdf/10.1007/BF00155616.pdf)]. Moreover, note that Rina Dechter did not use the term in the context of neural networks, which was probably used later.
  
  
  ---
  
  