MELD-ST: An Emotion-aware Speech Translation Dataset
<|reference_start|>MELD-ST: An Emotion-aware Speech Translation Dataset: Emotion plays a crucial role in human conversation. This paper underscores the significance of considering emotion in speech translation. We present the MELD-ST dataset for the emotion-aware speech translation task, comprising English-to-Japanese and English-to-German language pairs. Each language pair includes about 10,000 utterances annotated with emotion labels from the MELD dataset. Baseline experiments using the SeamlessM4T model on the dataset indicate that fine-tuning with emotion labels can enhance translation performance in some settings, highlighting the need for further research in emotion-aware speech translation systems.<|reference_end|>
@article{chen2024meld-st:,
    title={MELD-ST: An Emotion-aware Speech Translation Dataset},
    author={Sirou Chen, Sakiko Yahata, Shuichiro Shimizu, Zhengdong Yang, Yihang
  Li, Chenhui Chu, Sadao Kurohashi},
    journal={arXiv preprint arXiv:2405.13233},
    year={2024},
    archivePrefix={arXiv},
    eprint={2405.13233},
    primaryClass={cs.CL}
}