Answers.Body: <p><strong>Transfer Learning</strong> allows you to add new categories to be predicted to the output layer without needing to re-train the entire model every time a new category needs to be classified. Rather, the weights of all initial layers up to the last few layers of the network can be <em>frozen</em> and only the last one or two layers can be made <em>trainable</em> for <em>fine-tuning</em> the classification rather than training from scratch. This approach would be relatively fast than other methods since the dataset in your case is small.</p>
  
  <p>In order for model to flag the need of a new output class by inferring on a test document, you could include a class "Unknown" in addition to existing <code>N</code> classes (hence, the output layer now contains <code>N+1</code> classes). If the model predicts "Unknown" with highest probability, you could add a new class to the output layer after examining the test data.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-12-30T05:34:16.813Z
Answers.LastActivityDate: 2019-12-30T05:34:16.813Z
Answers.UserDisplayName: Balraj Ashwath
Body: <p>I'm looking for a supervized system/approach, that could learn how to categorize incoming texts/documents, where new categories can be added over time and the training set will be small. The trained model should not be static and should be able to evolve with adding new categories or evaluating new documents.</p>
  
  <p>For each document it should first give it's suggestion that can be then corrected.</p>
  
Tags: <categorical-data>
Title: Categorizing text into dynamic amount of categories
UserDisplayName: Matej Tymes
ThreadText: # Categorizing text into dynamic amount of categories
  
  (Asked by: username_0 on 2019-12-28)
  
  I'm looking for a supervized system/approach, that could learn how to categorize incoming texts/documents, where new categories can be added over time and the training set will be small. The trained model should not be static and should be able to evolve with adding new categories or evaluating new documents.
  
  For each document it should first give it's suggestion that can be then corrected.
  
  **Tags:** categorical-data
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2019-12-30. Score: 2
  
  **Transfer Learning** allows you to add new categories to be predicted to the output layer without needing to re-train the entire model every time a new category needs to be classified. Rather, the weights of all initial layers up to the last few layers of the network can be *frozen* and only the last one or two layers can be made *trainable* for *fine-tuning* the classification rather than training from scratch. This approach would be relatively fast than other methods since the dataset in your case is small.
  
  In order for model to flag the need of a new output class by inferring on a test document, you could include a class "Unknown" in addition to existing `N` classes (hence, the output layer now contains `N+1` classes). If the model predicts "Unknown" with highest probability, you could add a new class to the output layer after examining the test data.
  
  
  ---
  
  