Hi @MoritzLaurer, what about first using a binary classifier (or even regex ) to pre-select the sentences that are relevant / not relevant, followed by applying your 20-class classifier to the relevant sentences?