I understand but in my case here, each sentence  does not have a single label, instead I am assuming that each sentence has 512 labels ( this is the max len output for bert) as my input is question and answers and I output is the answer. so my labels are word ids.