Video Emotion Open-vocabulary Recognition Based on Multimodal Large Language Model
<|reference_start|>Video Emotion Open-vocabulary Recognition Based on Multimodal Large Language Model: Multimodal emotion recognition is a task of great concern. However, traditional data sets are based on fixed labels, resulting in models that often focus on main emotions and ignore detailed emotional changes in complex scenes. This report introduces the solution of using MLLMs technology to generate open-vocabulary emotion labels from a video. The solution includes the use of framework, data generation and processing, training methods, results generation and multi-model co-judgment. In the MER-OV (Open-Word Emotion Recognition) of the MER2024 challenge, our method achieved significant advantages, leading to its superior capabilities in complex emotion computation.<|reference_end|>
@article{ge2024video,
    title={Video Emotion Open-vocabulary Recognition Based on Multimodal Large
  Language Model},
    author={Mengying Ge, Dongkai Tang, Mingyang Li},
    journal={arXiv preprint arXiv:2408.11286},
    year={2024},
    archivePrefix={arXiv},
    eprint={2408.11286},
    primaryClass={cs.CV}
}