Punctuation in Wav2Vec2
Playing around with Wav2Vec2, and some of the sentences contain punctuation (like apostrophes, etc.) but i don't see any periods, question marks, commas etc. in my output. 

I'm not sure if this a new feature, or just a way of handling the processing, but would it be possible to get punctuation in the Wav2Vec2 outputs ? 
Hey @krrishdholakia,

Wav2Vec2 was fine-tuned mostly on Librispeech which does not contain any punctuation so it'll be very difficult for the model to predict punctuation. You could take a pre-trained Wav2Vec2 model and fine-tune it on a downstream task that contains punctuation. This should then just work fine<|||||>I came across [this](https://huggingface.co/flexudy/t5-small-wav2vec2-grammar-fixer) t5 model trained to correct grammar outputs of wav2vec2. Not sure if this is what you were looking for @krrishdholakia, but you can pass the text to [this](https://huggingface.co/flexudy/t5-small-wav2vec2-grammar-fixer) model and get back punctuated sentences. <|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.