I took part in the Wav2Vec2 fine-tuning week for Spanish, this is my forum post 6. My model card 4 describes some of the pre-processing and training steps I took.
It would be awesome to create a pretrained model using Jax/Flax. I’m not sure I’ll have the time to take part in this one (I already signed up for a different project, and I know nothing about Jax), but I’ll try to follow your discussions if I can. Good luck!