Hey @jbeh can you share a minimal reproducible example? For example, something simple that just shows:

How you load and tokenize the datasets
How you define the training arguments
How you define the trainer

That will help us understand better what is causing the issue