Wav2vec2 pretraining
How can I pretrain the base wav2vec2 model using the *transformers.Wav2Vec2ForPreTraining* class on my own data?
I saw the example given on the official website -https://huggingface.co/transformers/model_doc/wav2vec2.html#wav2vec2forpretraining
But it wasn't of much help. Is there any notebook or script which I can follow? 
https://github.com/huggingface/transformers/blob/master/examples/research_projects/wav2vec2/run_pretrain.py

Does this script helps you ?<|||||>cc @patrickvonplaten <|||||>Hey @aniket7joshi,

I'm currently working on it. Hope to have a good blog/notebook in 2,3 weeks!<|||||>I'll let you know :-)<|||||>Hey @patrickvonplaten , Any update regarding this blog really looking forward to it. <|||||>Wav2vec2 Pretraining at the moment only works for PyTorch. I want to make it work for Flax to be able to showcase it nicely in a google colab with 8 TPUs. Still working on it! <|||||>Hey @patrickvonplaten Can you help me as to how I use the script here: https://github.com/huggingface/transformers/blob/master/examples/research_projects/wav2vec2/run_pretrain.py

As input, I have a folder of audio files based on which I want to pretrain my model. I don't want to use any datasets available online or on huggingface. 
TIA :) <|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.<|||||>Planning to look into this again in 2 weeks<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.