I’ll give that a try! In the meantime - my training run on the whole dataset on a single GPU has just about finished running for 5 epochs, finishing with a WER on the validation set of about 39%. I’d hoped it would do better than your smaller split, but it seems like it didn’t.
The WER does still seem to be decreasing, although slowly, so maybe more training time might help but I’m not sure. This first model is a good starting point to iterate on.