hello, this is my line of tokenization and I put true for truncation and padding  :
tokenized_dataset = dataset.map(lambda x: flaubert_tokenizer(x['verbatim'], padding=True, truncation=True, max_length=512), batched=True)