the funny thing is, yesterday everything worked. i didn’t change anything in the dataset (i think) and nothing in the trainer. Yesterday everything worked both locally and on Google Colab. Now today I bought Colab Pro and now it crashes in the training process and when validating. Is it possible to split the WER-Compute part by flag or something like that, so that the problem does not occur anymore?`
@sgugger any suggestions? what do you mean with You should split your dataset in smaller pieces to get the decoded predictions. should i just make the eval dataset smaller? eq. only use 50%? or should  i just batch once more before using wer = wer_metric.compute(predictions=pred_str, references=label_str)
some of the eval settings
--per_device_eval_batch_size="2"
--evaluation_strategy="steps"
--save_steps="400"
--eval_steps="400"
--logging_steps="400"
--dataloader_num_workers="8"
--group_by_length