PreTrain Wav2Vec2 in Turkish
On the previous community event I pretrained a Turkish Wav2Vec2 model 2 using the fairseq script. This is a subpar model because I hadn’t cleaned the data.
This time I want to do it properly with the freshly merged    FlaxWav2Vec2 + PreTraining script 5

Model
A randomly initialized Wav2Vec2 model

Datasets
One can make use Common Voice the dataset is also available through the datasets library here: common_voice · Datasets at Hugging Face.

Available training scripts
FlaxWav2Vec2 will be merged soon: [Flax] Add wav2vec2 by patrickvonplaten · Pull Request #12271 · huggingface/transformers · GitHub  1 and a pretraining script should be relatively easy to be merged.

(Optional) Desired project outcome
The best Turkish ASR model.

(Optional) Challenges
I have some additional scraped audiobook data. Might need a bit more though.