A video image-based multi-modal emotion recognition system and method. The system comprises a human face extraction module, a physiological signal sensing module, a posture signal collection module, a dressing signal scanning module, a scene analysis module, an emotion time sequence encoding module, an emotion information modeling module, and an emotion space mapping module. Further provided is a video image-based multi-modal emotion recognition method. By means of the design of the functional modules and the use of multi-modal emotion feature extraction, the video image-based multi-modal emotion recognition system has the characteristic of being more accurate and more reliable in recognition structure, and is suitable for popularization and application.
VIDEO IMAGE-BASED MULTI-MODAL EMOTION RECOGNITION SYSTEM AND METHOD