The invention belongs to the technical field of human-computer interaction, and provides a human-computer interaction method and system based on multi-modal emotion and face attribute identification. The method includes the steps: acquiring a face image and sound information of a user; transforming the sound information into text information; distinguishing emotions according to the face image, the sound information and the text information; determining emotion vectors; determining face attribute characteristics according to the face image; analyzing the emotion vectors, the face attribute characteristics and the text information according to replying strategies, and outputting feedback texts. According to the human-computer interaction method and system based on multi-modal emotion and face attribute identification, face attributes can be completely identified, multi-modal face emotion identification accuracy is improved, the multi-modal emotions, the face attributes and natural language interaction information are combined, and more natural and intelligent human-computer interaction experience is provided.
Human-computer interaction method and system based on multi-modal emotion and face attribute identification