thanks for your response @neuralpat.
mh… I feel like extractive summarizsation is not a good fit, because there is no reason why the summarizer would pick the sentences I’m looking for for the classification task.
regarding the suggested classification thresholds: yeah true that could help a bit, if the classifier is undecided between classes. the issue is that the classifer is forced to only give a probability to the classes it has learned and by experience and softmax will often give a high probability to just some class, just because no other class fits.
I feel like there must be more elegant solutions for this / more literature, because it’s such a fundamental issue for real world applications where not every sentence/text input fits the classes you have.