 Acknowledgements  This project would not have been possible without compute generously provided by Google through the [TPU Research Cloud](https://sites.research.google/trc/). The HuggingFace 🤗 ecosystem was also instrumental in many, if not all parts of the training. The following repositories where helpful in setting up the TPU-VM, and training the models:  * [Gsarti's Pretrain and Fine-tune a T5 model with Flax on GCP](https://github.com/gsarti/t5-flax-gcp) * [HUggingFace Flax MLM examples](https://github.com/huggingface/transformers/tree/master/examples/flax/language-modeling) * [Flax/Jax Community week t5-base-dutch](https://huggingface.co/flax-community/t5-base-dutch)  Created by [Yeb Havinga](https://www.linkedin.com/in/yeb-havinga-86530825/)