ptrblck:

LongTensor s


Thanks for the feedback.
However, I have confirmed that during each iteration during the training, my dimensions are:
input_ids: [13,512]
input_masks: [13,512]
y_labels: [13,34]
where 34 is the number of possible labels (as one hot vectors).
Ex:
[0,0,0,1,1,0,0,… 0,1]
Doesn’t this meet the requirement for calculating Cross EntropyLoss ?