Answers.Body: <p>If you are confident that your pseudo-labels are correct, then you can expect that the new data you label will not be redundant. however, If you want to avoid having redundant data in your labeled dataset, then you need to make sure that it is large enough to cover all the relevant patterns.</p>
  <p>One way to avoid creating redundant data when using data augmentation is to use a technique called <strong>transfer learning</strong>. This involves training a model on one dataset and then transferring the learned knowledge to another related dataset. This can be done by fine-tuning the model on the new dataset or by using the model to extract features from the new dataset that can be used to train a new model. Transfer learning can be used to reduce the amount of data needed to train a new model, and can also improve the performance of the new model.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-10-17T20:13:53.340Z
Answers.LastActivityDate: 2022-10-17T20:13:53.340Z
Answers.UserDisplayName: Faizy
Body: <p>If I'm generating pseudo-labels that I'm confident are correct for my dataset due to high confidence scores or something else, how can I expect that the new data I'm labeling won't be redundant? To my knowledge, if a datapoint is labeled automatically, unless novel data is generated <a href="https://aclanthology.org/W09-2208.pdf" rel="nofollow noreferrer">like in this paper</a> I don't see how the data that can be labeled will be particularly useful, as it will admit no new patterns to learn from, as otherwise the data wouldn't be labeled with a high confidence. Is the point here to make sure the labeled dataset you start with is sufficiently large that it covers all the kinds of patterns you expect from the data for the model to need to be able to identify?</p>
  
Tags: <data-labelling><semi-supervised-learning>
Title: Semi-supervised learning algorithms creating redundant data
UserDisplayName: sangstar
ThreadText: # Semi-supervised learning algorithms creating redundant data
  
  (Asked by: username_0 on 2022-10-16)
  
  If I'm generating pseudo-labels that I'm confident are correct for my dataset due to high confidence scores or something else, how can I expect that the new data I'm labeling won't be redundant? To my knowledge, if a datapoint is labeled automatically, unless novel data is generated [like in this paper](https://aclanthology.org/W09-2208.pdf) I don't see how the data that can be labeled will be particularly useful, as it will admit no new patterns to learn from, as otherwise the data wouldn't be labeled with a high confidence. Is the point here to make sure the labeled dataset you start with is sufficiently large that it covers all the kinds of patterns you expect from the data for the model to need to be able to identify?
  
  **Tags:** data-labelling, semi-supervised-learning
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2022-10-17. Score: 0
  
  If you are confident that your pseudo-labels are correct, then you can expect that the new data you label will not be redundant. however, If you want to avoid having redundant data in your labeled dataset, then you need to make sure that it is large enough to cover all the relevant patterns.
  
  One way to avoid creating redundant data when using data augmentation is to use a technique called **transfer learning**. This involves training a model on one dataset and then transferring the learned knowledge to another related dataset. This can be done by fine-tuning the model on the new dataset or by using the model to extract features from the new dataset that can be used to train a new model. Transfer learning can be used to reduce the amount of data needed to train a new model, and can also improve the performance of the new model.
  
  
  ---
  
  