Answers.Body: <p>You are right. If you don't continuously train the neural network after you have deployed it, there is no way it can continuously learn or be updated with more information. You need to program the neural network to learn even after it has been deployed. There is <strong>no</strong> such thing as a neural network that decides what it does without a human deciding first what it needs to do: this is a very common misconception (probably caused by the media and science fiction movies). It's also true that you need to label your data if you intend to train the neural network in a <em>supervised</em> fashion, but there are other ways to train neural networks (e.g. by <em>reinforcement learning</em>), depending also on the problem you want to solve.</p>
  <p>If you want to develop neural networks that can learn continually, you probably want to look into <a href="https://arxiv.org/pdf/1802.07569.pdf" rel="nofollow noreferrer"><em>continual learning techniques for neural networks</em></a>. Another term that you may be looking for is <em>online machine learning</em>.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-09-26T12:12:38.973Z
Answers.Text: Thanks for the answer and the edit! "incremental learning" and "continuous learning" learning were the terms I was looking for. Saved the linked research paper for a later day as it looked slightly intimidating at present.
Answers.UserDisplayName: user3536523
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-09-26T12:18:37.347Z
Answers.Text: @user3536523 No problem. Yes, I suggest that you first get familiar with the basic concepts of machine learning and neural networks before reading that paper, although it's not a very difficult paper to read, but you would not understand many concepts if you are not familiar with the basics.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-09-25T13:51:24.480Z
Answers.LastActivityDate: 2020-09-25T13:56:58.517Z
Answers.LastEditDate: 2020-09-25T13:56:58.517Z
Answers.UserDisplayName: nbro
Body: <p>Say I trained a Neural Network (not RNN or CNN) to classify a particular data set.</p>
  <p>So I train using a specific data set &amp; then I test using another and get an accuracy of 95% which is good enough.</p>
  <p>I then deploy this model in a production level environment where it will then be processing real world data.</p>
  <p>My question is, will this trained NN be constantly learning even in a production scenario? I can't figure out how it will because say it processes a dataset such as this:
  <code>[ [1,2,3] ]</code> and gets an output of <code>[ 0, 0.999, 0 ]</code></p>
  <p>In a training scenario it will compare the predicted output to the actual output and back propagate but in a real world scenario it will not know the actual value.</p>
  <p>So how does a trained model learn in a real world scenario?</p>
  <p>I am still very much a beginner in this field and I am not sure if the technology used is going to affect the answer to this question, but I am hoping to use Eclipse Deeplearning4J to create a NN. That being said the answer does not need to be restricted to this technology in particular as I am hoping more for the theory behind it and how it works.</p>
  
Tags: <neural-networks><deep-learning><online-learning><incremental-learning>
Title: How does a neural network that has been trained keep learning while in a real world scenario
UserDisplayName: user3536523
ThreadText: # How does a neural network that has been trained keep learning while in a real world scenario
  
  (Asked by: username_0 on 2020-09-25)
  
  Say I trained a Neural Network (not RNN or CNN) to classify a particular data set.
  
  So I train using a specific data set & then I test using another and get an accuracy of 95% which is good enough.
  
  I then deploy this model in a production level environment where it will then be processing real world data.
  
  My question is, will this trained NN be constantly learning even in a production scenario? I can't figure out how it will because say it processes a dataset such as this:
  `[ [1,2,3] ]` and gets an output of `[ 0, 0.999, 0 ]`
  
  In a training scenario it will compare the predicted output to the actual output and back propagate but in a real world scenario it will not know the actual value.
  
  So how does a trained model learn in a real world scenario?
  
  I am still very much a beginner in this field and I am not sure if the technology used is going to affect the answer to this question, but I am hoping to use Eclipse Deeplearning4J to create a NN. That being said the answer does not need to be restricted to this technology in particular as I am hoping more for the theory behind it and how it works.
  
  **Tags:** neural-networks, deep-learning, online-learning, incremental-learning
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2020-09-25. Score: 2 | Accepted answer
  
  You are right. If you don't continuously train the neural network after you have deployed it, there is no way it can continuously learn or be updated with more information. You need to program the neural network to learn even after it has been deployed. There is **no** such thing as a neural network that decides what it does without a human deciding first what it needs to do: this is a very common misconception (probably caused by the media and science fiction movies). It's also true that you need to label your data if you intend to train the neural network in a *supervised* fashion, but there are other ways to train neural networks (e.g. by *reinforcement learning*), depending also on the problem you want to solve.
  
  If you want to develop neural networks that can learn continually, you probably want to look into [*continual learning techniques for neural networks*](https://arxiv.org/pdf/1802.07569.pdf). Another term that you may be looking for is *online machine learning*.
  
  > **Comments:**
  > **username_0**: Thanks for the answer and the edit! "incremental learning" and "continuous learning" learning were the terms I was looking for. Saved the linked research paper for a later day as it looked slightly intimidating at present.  
  > **username_1**: @username_0 No problem. Yes, I suggest that you first get familiar with the basic concepts of machine learning and neural networks before reading that paper, although it's not a very difficult paper to read, but you would not understand many concepts if you are not familiar with the basics.  
  
  ---
  
  