So I’ve dug through this, but still don’t have a better idea.
Tokenization is defaulting to length of 520. I printed out what the acutal tokenizer IS.
PreTrainedTokenizerFast(name_or_path=‘facebook/bart-large-xsum’, vocab_size=50265, model_max_len=1024, is_fast=True, padding_side=‘right’, special_tokens={‘bos_token’: ‘’, ‘eos_token’: ‘’, ‘unk_token’: ‘’, ‘sep_token’: ‘’, ‘pad_token’: ‘’, ‘cls_token’: ‘’, ‘mask_token’: AddedToken("", rstrip=False, lstrip=True, single_word=False, normalized=False)})
The tokenized RESULTS are different from the BartConditional… So not sure overall what’s happening.