Sigh, spoke too soon, it still crashes. It just needs to train a new tokenizer, apparently, which is why I got a progress bar.
I do get a new warning, though:
[WARNING|tokenization_utils_base.py:3170] 2021-06-08 09:23:59,091 >> Token indices sequence length is longer than the specified maximum sequence length for this model (610 > 512). Running this sequence through the model will result in indexing errors