Answers.Body: <p>For the vast majority of cases where you have a dynamic(and assumed non-linear) relationship between your input and output, you would not use modified architecture. You would simply retrain on the new data.</p>
  
  <p>In some cases, based on domain knowledge or intuition, one might put a "weight" on the new data to increase or decrease its importance relative to previous data.</p>
  
  <p>There are some attempts(mostly by those studying one-shot learning) to create NNs that quickly fit to new data effectively with only a few samples. However, most of these are not ready for anything resembling real-world problems(particularly on tabular data).</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-08-06T11:07:59.483Z
Answers.LastActivityDate: 2019-08-06T11:07:59.483Z
Answers.UserDisplayName: hisairnessag3
Body: <p>For real applications, concept drifts often exist, i.e., the relationship between the input and output changes overtime. Thus, we need our AI or machine learning system to quickly adapt to the environment. </p>
  
  <p>What are the most common methods to enable neural networks to quickly adapt to the changing environment for supervised learning? Could somebody provide a link to a good review article? </p>
  
Tags: <neural-networks><reference-request><supervised-learning><transfer-learning><incremental-learning>
Title: What are the most common methods to enable neural networks to adapt to changing environments?
UserDisplayName: Hammer. Wang
ThreadText: # What are the most common methods to enable neural networks to adapt to changing environments?
  
  (Asked by: username_0 on 2019-08-05)
  
  For real applications, concept drifts often exist, i.e., the relationship between the input and output changes overtime. Thus, we need our AI or machine learning system to quickly adapt to the environment.
  
  What are the most common methods to enable neural networks to quickly adapt to the changing environment for supervised learning? Could somebody provide a link to a good review article?
  
  **Tags:** neural-networks, reference-request, supervised-learning, transfer-learning, incremental-learning
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2019-08-06. Score: 1
  
  For the vast majority of cases where you have a dynamic(and assumed non-linear) relationship between your input and output, you would not use modified architecture. You would simply retrain on the new data.
  
  In some cases, based on domain knowledge or intuition, one might put a "weight" on the new data to increase or decrease its importance relative to previous data.
  
  There are some attempts(mostly by those studying one-shot learning) to create NNs that quickly fit to new data effectively with only a few samples. However, most of these are not ready for anything resembling real-world problems(particularly on tabular data).
  
  
  ---
  
  