Quality Diversity Imitation Learning
<|reference_start|>Quality Diversity Imitation Learning: Imitation learning (IL) has shown great potential in various applications, such as robot control. However, traditional IL methods are usually designed to learn only one specific type of behavior since demonstrations typically correspond to a single expert. In this work, we introduce the first generic framework for Quality Diversity Imitation Learning (QD-IL), which enables the agent to learn a broad range of skills from limited demonstrations. Our framework integrates the principles of quality diversity with adversarial imitation learning (AIL) methods, and can potentially improve any inverse reinforcement learning (IRL) method. Empirically, our framework significantly improves the QD performance of GAIL and VAIL on the challenging continuous control tasks derived from Mujoco environments. Moreover, our method even achieves 2x expert performance in the most challenging Humanoid environment.<|reference_end|>
@article{wan2024quality,
    title={Quality Diversity Imitation Learning},
    author={Zhenglin Wan, Xingrui Yu, David Mark Bossens, Yueming Lyu, Qing Guo,
  Flint Xiaofeng Fan, Ivor Tsang},
    journal={arXiv preprint arXiv:2410.06151},
    year={2024},
    archivePrefix={arXiv},
    eprint={2410.06151},
    primaryClass={cs.LG cs.AI}
}