Answers.Body: <p>This is an example of <strong>Transfer Learning</strong>, wherein instead of starting the learning process from scratch, a pre-trained model is used and appended with custom layers to achieve additional functionality.</p>
  
  <p><a href="https://i.sstatic.net/zifEn.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/zifEn.png" alt="enter image description here"></a></p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-02-07T21:35:51.110Z
Answers.LastActivityDate: 2020-02-07T21:44:40.590Z
Answers.LastEditDate: 2020-02-07T21:44:40.590Z
Answers.UserDisplayName: s_bh
Answers.Body: <p>This a typical transfer learning technique, a lot of people refer to it with fine-tunning. I would recommend that you have a look on <a href="https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html" rel="nofollow noreferrer">PyTorch tutorial</a>: it explains well how to use.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-02-07T21:37:03.730Z
Answers.LastActivityDate: 2020-02-08T11:28:45.007Z
Answers.LastEditDate: 2020-02-08T11:28:45.007Z
Answers.UserDisplayName: hola
Body: <p>There is a popular strategy of using a neural network trained on one task to produce features for another related task by "chopping off" the top of the network and sewing the bottom onto some other modeling pipeline.</p>
  
  <p>Word2Vec models employ this strategy, for example.</p>
  
  <p>Is there an industry-popular term for this strategy?  Are there any good resources that discuss its use in general terms?</p>
  
Tags: <neural-networks>
Title: Strategy of using intermediate layers of a neural network as features?
UserDisplayName: Him
ThreadText: # Strategy of using intermediate layers of a neural network as features?
  
  (Asked by: username_0 on 2020-02-07)
  
  There is a popular strategy of using a neural network trained on one task to produce features for another related task by "chopping off" the top of the network and sewing the bottom onto some other modeling pipeline.
  
  Word2Vec models employ this strategy, for example.
  
  Is there an industry-popular term for this strategy? Are there any good resources that discuss its use in general terms?
  
  **Tags:** neural-networks
  
  ---
  
  ## 2 answers
  
  ### Answer by username_1 on 2020-02-07. Score: 1
  
  This is an example of **Transfer Learning**, wherein instead of starting the learning process from scratch, a pre-trained model is used and appended with custom layers to achieve additional functionality.
  
  [![enter image description here](https://i.sstatic.net/zifEn.png)](https://i.sstatic.net/zifEn.png)
  
  
  ---
  
  ### Answer by username_2 on 2020-02-07. Score: 1
  
  This a typical transfer learning technique, a lot of people refer to it with fine-tunning. I would recommend that you have a look on [PyTorch tutorial](https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html): it explains well how to use.
  
  
  ---
  
  