Cross-Lingual Conversational Speech Summarization with Large Language Models
<|reference_start|>Cross-Lingual Conversational Speech Summarization with Large Language Models: Cross-lingual conversational speech summarization is an important problem, but suffers from a dearth of resources. While transcriptions exist for a number of languages, translated conversational speech is rare and datasets containing summaries are non-existent. We build upon the existing Fisher and Callhome Spanish-English Speech Translation corpus by supplementing the translations with summaries. The summaries are generated using GPT-4 from the reference translations and are treated as ground truth. The task is to generate similar summaries in the presence of transcription and translation errors. We build a baseline cascade-based system using open-source speech recognition and machine translation models. We test a range of LLMs for summarization and analyze the impact of transcription and translation errors. Adapting the Mistral-7B model for this task performs significantly better than off-the-shelf models and matches the performance of GPT-4.<|reference_end|>
@article{nelson2024cross-lingual,
    title={Cross-Lingual Conversational Speech Summarization with Large Language
  Models},
    author={Max Nelson, Shannon Wotherspoon, Francis Keith, William Hartmann,
  Matthew Snover},
    journal={arXiv preprint arXiv:2408.06484},
    year={2024},
    archivePrefix={arXiv},
    eprint={2408.06484},
    primaryClass={cs.CL cs.AI}
}