Incorporating Spatial Awareness in Data-Driven Gesture Generation for Virtual Agents
<|reference_start|>Incorporating Spatial Awareness in Data-Driven Gesture Generation for Virtual Agents: This paper focuses on enhancing human-agent communication by integrating spatial context into virtual agents' non-verbal behaviors, specifically gestures. Recent advances in co-speech gesture generation have primarily utilized data-driven methods, which create natural motion but limit the scope of gestures to those performed in a void. Our work aims to extend these methods by enabling generative models to incorporate scene information into speech-driven gesture synthesis. We introduce a novel synthetic gesture dataset tailored for this purpose. This development represents a critical step toward creating embodied conversational agents that interact more naturally with their environment and users.<|reference_end|>
@article{deichler2024incorporating,
    title={Incorporating Spatial Awareness in Data-Driven Gesture Generation for
  Virtual Agents},
    author={Anna Deichler, Simon Alexanderson, Jonas Beskow},
    journal={arXiv preprint arXiv:2408.04127},
    year={2024},
    doi={10.1145/3652988.3673936},
    archivePrefix={arXiv},
    eprint={2408.04127},
    primaryClass={cs.HC cs.CL cs.GR}
}