What does it take to get state of the art in simultaneous speech-to-speech translation?
<|reference_start|>What does it take to get state of the art in simultaneous speech-to-speech translation?: This paper presents an in-depth analysis of the latency characteristics observed in simultaneous speech-to-speech model's performance, particularly focusing on hallucination-induced latency spikes. By systematically experimenting with various input parameters and conditions, we propose methods to minimize latency spikes and improve overall performance. The findings suggest that a combination of careful input management and strategic parameter adjustments can significantly enhance speech-to-speech model's latency behavior.<|reference_end|>
@article{wilmet2024what,
    title={What does it take to get state of the art in simultaneous
  speech-to-speech translation?},
    author={Vincent Wilmet, Johnson Du},
    journal={arXiv preprint arXiv:2409.00965},
    year={2024},
    archivePrefix={arXiv},
    eprint={2409.00965},
    primaryClass={cs.CL}
}