Hi bryan, I can’t exactly remember what I did but you might want to check out how you define your dataset class.
For me, my task was training huggingface BERT model and instead define a dataset class I just use their datasets library.