Answers.Body: <p>Sounds like a very interesting idea! I dont know existing work on the idea, but the implementation should be pretty simple with separate training with tied weights. It should be noted however that such behaviour occurs naturally in CNN's already. (See: <a href="http://www.cs.toronto.edu/~guerzhoy/321/lec/W07/HowConvNetsSee.pdf" rel="nofollow noreferrer">http://www.cs.toronto.edu/~guerzhoy/321/lec/W07/HowConvNetsSee.pdf</a>)</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-02-04T21:50:04.603Z
Answers.Text: Yes I figured it would be a very natural and straight-forward thing to try. I'll do the experiment some time soon
Answers.UserDisplayName: Asciiom
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-02-03T15:46:34.080Z
Answers.LastActivityDate: 2018-02-03T15:46:34.080Z
Answers.UserDisplayName: k.c. sayz 'k.c sayz'
Body: <p>I had this idea of training for example a CNN on images, and having output branches at several of its intermediate layers. The early layers' output branch might then predict high-level class of detected objects (supposedly able to do this because less info is needed for a high-level classification than a very specialised one), and the later layers giving more detailed labels of the sub-class of the earlier high level class.</p>
  
  <p>I have been searching for research on this type of setup but couldn't really find anything. Is there a name for this idea, or is this an open question/idea?</p>
  
Tags: <neural-networks><convolutional-neural-networks><classification><backpropagation>
Title: Is there any research on neural networks with multiple outputs for hierarchical label classification?
UserDisplayName: Asciiom
ThreadText: # Is there any research on neural networks with multiple outputs for hierarchical label classification?
  
  (Asked by: username_0 on 2018-02-02)
  
  I had this idea of training for example a CNN on images, and having output branches at several of its intermediate layers. The early layers' output branch might then predict high-level class of detected objects (supposedly able to do this because less info is needed for a high-level classification than a very specialised one), and the later layers giving more detailed labels of the sub-class of the earlier high level class.
  
  I have been searching for research on this type of setup but couldn't really find anything. Is there a name for this idea, or is this an open question/idea?
  
  **Tags:** neural-networks, convolutional-neural-networks, classification, backpropagation
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2018-02-03. Score: 1
  
  Sounds like a very interesting idea! I dont know existing work on the idea, but the implementation should be pretty simple with separate training with tied weights. It should be noted however that such behaviour occurs naturally in CNN's already. (See: <http://www.cs.toronto.edu/~guerzhoy/321/lec/W07/HowConvNetsSee.pdf>)
  
  > **Comments:**
  > **username_0**: Yes I figured it would be a very natural and straight-forward thing to try. I'll do the experiment some time soon  
  
  ---
  
  