wav2vec 2.0 doesn't appear to do vector quantization
In the [paper](https://arxiv.org/abs/2006.11477) from FAIR, they describe wav2vec 2.0 as using a vector quantization module to learn discrete vectors of speech units (section 2.) As far as I know, this should be happening between `Wav2Vec2FeatureExtractor` and `Wav2Vec2FeatureProjection`.

The HuggingFace implementation doesn't seem to do any vector quantization. Is this a correct implementation?
Hi, I think VQ only works for Pretraining, it doesn't look like Transformers currently support Pretrain<|||||>Vector quantization is only required for pretraining which is currently not supported. It should be added soon: https://github.com/huggingface/transformers/issues/10873.<|||||>Thanks! Just to clarify, was the [base model](https://huggingface.co/facebook/wav2vec2-base) pretrained with quantization, and it's just that the port to HF doesn't include the quantization module?<|||||>The port didn't include the quantization module - we should re-port the model :-) <|||||>It was trained with quantization if I remember correctly<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.