Solved by nielsr in post #2 
              
              
                Sure, all you need to do is make sure the problem_type of the model’s configuration is set to multi_label_classification, e.g.: 
from transformers import BertForSequenceClassification

model = BertForSequenceClassification.from_pretrained("bert-base-uncased", num_labels=10, problem_type="multi_label…