Hey @tanmaylaud,
This paper: [2105.01051] SUPERB: Speech processing Universal PERformance Benchmark 11 might be of interest. I’m also currently working on adding Wav2Vec2 in Flax, see: [WIP][Flax] Add wav2vec2 by patrickvonplaten · Pull Request #12271 · huggingface/transformers · GitHub 14. Hopefully this will be merged by next week.