Hey  @lewtun, I have a follow-up.
You mentioned



 lewtun:

You’ll still need a corpus involving a mix of the original entities and the new ones, but it might be that with knowledge distillation you can get by with few samples than the original corpus that was used to train the teacher.


Is it going to be a problem if the senteces in the original training set, already contain the new entitities, but obviously not annotated?
So if I just add new training data with those new entitites annotated, will that be able to outweigh those same entitites not being annotated in the original training data? (logic telle me know, but I thought I’d ask)
Do you know what I mean?