Motion Avatar: Generate Human and Animal Avatars with Arbitrary Motion
<|reference_start|>Motion Avatar: Generate Human and Animal Avatars with Arbitrary Motion: In recent years, there has been significant interest in creating 3D avatars and motions, driven by their diverse applications in areas like film-making, video games, AR/VR, and human-robot interaction. However, current efforts primarily concentrate on either generating the 3D avatar mesh alone or producing motion sequences, with integrating these two aspects proving to be a persistent challenge. Additionally, while avatar and motion generation predominantly target humans, extending these techniques to animals remains a significant challenge due to inadequate training data and methods. To bridge these gaps, our paper presents three key contributions. Firstly, we proposed a novel agent-based approach named Motion Avatar, which allows for the automatic generation of high-quality customizable human and animal avatars with motions through text queries. The method significantly advanced the progress in dynamic 3D character generation. Secondly, we introduced a LLM planner that coordinates both motion and avatar generation, which transforms a discriminative planning into a customizable Q&A fashion. Lastly, we presented an animal motion dataset named Zoo-300K, comprising approximately 300,000 text-motion pairs across 65 animal categories and its building pipeline ZooGen, which serves as a valuable resource for the community. See project website https://steve-zeyu-zhang.github.io/MotionAvatar/<|reference_end|>
@article{zhang2024motion,
    title={Motion Avatar: Generate Human and Animal Avatars with Arbitrary Motion},
    author={Zeyu Zhang, Yiran Wang, Biao Wu, Shuo Chen, Zhiyuan Zhang, Shiya
  Huang, Wenbo Zhang, Meng Fang, Ling Chen, Yang Zhao},
    journal={arXiv preprint arXiv:2405.11286},
    year={2024},
    archivePrefix={arXiv},
    eprint={2405.11286},
    primaryClass={cs.CV}
}