Embodied conversational agents (ECA) should exhibit non- verbal behaviors that are meaningfully related to their speech and mental state. This paper describes Cerebella, a system that automatically de- rives communicative functions from the text and audio of an utterance by combining lexical, acoustic, syntactic, semantic and rhetorical analy- ses. Communicative functions are then mapped to a multimodal behavior performance. Two studies demonstrate that the generated performances are meaningful and consistent with the speech.
['Margaux Lhommet', 'Stacy C. Marsella']
Gesture with Meaning