CR-CTC: Consistency regularization on CTC for improved speech recognition
<|reference_start|>CR-CTC: Consistency regularization on CTC for improved speech recognition: Connectionist Temporal Classification (CTC) is a widely used method for automatic speech recognition (ASR), renowned for its simplicity and computational efficiency. However, it often falls short in recognition performance compared to transducer or systems combining CTC and attention-based encoder-decoder (CTC/AED). In this work, we propose the Consistency-Regularized CTC (CR-CTC), which enforces consistency between two CTC distributions obtained from different augmented views of the input speech mel-spectrogram. We provide in-depth insights into its essential behaviors from three perspectives: 1) it conducts self-distillation between random pairs of sub-models that process different augmented views; 2) it learns contextual representation through masked prediction for positions within time-masked regions, especially when we increase the amount of time masking; 3) it suppresses the extremely peaky CTC distributions, thereby reducing overfitting and improving the generalization ability. Extensive experiments on LibriSpeech, Aishell-1, and GigaSpeech datasets demonstrate the effectiveness of our CR-CTC, which achieves performance comparable to, or even slightly better than, that of transducer and CTC/AED.<|reference_end|>
@article{yao2024cr-ctc:,
    title={CR-CTC: Consistency regularization on CTC for improved speech
  recognition},
    author={Zengwei Yao, Wei Kang, Xiaoyu Yang, Fangjun Kuang, Liyong Guo, Han
  Zhu, Zengrui Jin, Zhaoqing Li, Long Lin, Daniel Povey},
    journal={arXiv preprint arXiv:2410.05101},
    year={2024},
    archivePrefix={arXiv},
    eprint={2410.05101},
    primaryClass={eess.AS cs.LG cs.SD}
}