 Stats  We've also trained an ELECTRA (cased) model on the recently released Turkish part of the [multiligual C4 (mC4) corpus](https://github.com/allenai/allennlp/discussions/5265) from the AI2 team.  After filtering documents with a broken encoding, the training corpus has a size of 242GB resulting in 31,240,963,926 tokens.  We used the original 32k vocab (instead of creating a new one).  