PreTrain Wav2Vec2 in German
There is currently only a multilingually pretrained model for German Wav2Vec2. Let’s make a Wav2Vec2 only pretrained on German.

Model
A randomly initialized Wav2Vec2 model

Datasets
One can make use Common Voice 1 the dataset is also available through the datasets library here: common_voice · Datasets at Hugging Face 2.

Available training scripts
FlaxWav2Vec2 will be merged soon: [Flax] Add wav2vec2 by patrickvonplaten · Pull Request #12271 · huggingface/transformers · GitHub 13 and a pretraining script should be relatively easy to be merged.

(Optional) Desired project outcome
The best German ASR model.

(Optional) Challenges
It might make sense to use more data than just common voice.