Spectral oversubtraction? An approach for speech enhancement after robot ego speech filtering in semi-real-time
<|reference_start|>Spectral oversubtraction? An approach for speech enhancement after robot ego speech filtering in semi-real-time: Spectral subtraction, widely used for its simplicity, has been employed to address the Robot Ego Speech Filtering (RESF) problem for detecting speech contents of human interruption from robot's single-channel microphone recordings when it is speaking. However, this approach suffers from oversubtraction in the fundamental frequency range (FFR), leading to degraded speech content recognition. To address this, we propose a Two-Mask Conformer-based Metric Generative Adversarial Network (CMGAN) to enhance the detected speech and improve recognition results. Our model compensates for oversubtracted FFR values with high-frequency information and long-term features and then de-noises the new spectrogram. In addition, we introduce an incremental processing method that allows semi-real-time audio processing with streaming input on a network trained on long fixed-length input. Evaluations of two datasets, including one with unseen noise, demonstrate significant improvements in recognition accuracy and the effectiveness of the proposed two-mask approach and incremental processing, enhancing the robustness of the proposed RESF pipeline in real-world HRI scenarios.<|reference_end|>
@article{li2024spectral,
    title={Spectral oversubtraction? An approach for speech enhancement after robot
  ego speech filtering in semi-real-time},
    author={Yue Li, Koen V. Hindriks, Florian A. Kunneman},
    journal={arXiv preprint arXiv:2409.06274},
    year={2024},
    archivePrefix={arXiv},
    eprint={2409.06274},
    primaryClass={cs.RO cs.SD eess.AS}
}