So, maybe it makes sense to limit the project to:

PreTrain ByT5-base to a family of languages (to be defined)
Fine-tune the pretrained model on extractive QA
Evaluate on corrupted input
(maybe) compare to officially released multi-lingual checkpoints