Okay, I fixed. My labels are int, not float. My problem is that I used ‘label’ rather than ‘labels’, I think Transformers assumed it is going to be a single value rather than a vector, when testing it against int returns False, the default data collator assumed it is float. I changed the name for the feature from ‘label’ to ‘labels’, Trainer does not complain any more.