Marc Schröder|Elisabetta Bevacqua|Roddy Cowie|Florian Eyben|Hatice Güne?|Dirk Heylen|Mark ter Maat|Gary McKeown|Sathish Pammi|Maja Panti?|Catherine Pélachaud|Björn Schuller|Étienne de Sevin|Michel Valstar|Martin Wöllmer
Building Autonomous Sensitive Artificial Listeners
German Research Centre for Artificial Intelligence|Queen's University Belfast|Signal Processing (United States)|Queen Mary University of London|Scientific Methods (United States)|University of Twente|Queen's University Belfast|German Research Centre for Artificial Intelligence|Imperial College London|Laboratoire Traitement et Communication de l’Information|Technical University of Munich|Imperial College London|Technical University of Munich
paper describes substantial effort build realtime interactive multimodal dialogue system focus emotional nonverbal interaction capabilities work motivated aim provide technology competences perceiving producing emotional nonverbal behaviors required sustain conversational dialogue present sensitive artificial listener sal scenario setting seems particularly suited study emotional nonverbal behavior since requires limited verbal understanding part machine scenario allows us concentrate nonverbal capabilities without address time challenges spoken language understanding task modeling etc first report three prototype versions sal scenario behavior sensitive artificial listener characters determined human operator prototypes served purpose verifying effectiveness sal scenario allowed us collect data required building system components analyzing synthesizing respective behaviors describe fully autonomous integrated realtime system created combines incremental analysis user behavior dialogue management synthesis speaker listener behavior sal character displayed virtual agent discuss principles underlie evaluation saltype systems since system designed modularity reuse since publicly available sal system potential joint research tool affective computing research community