title: AnchorCrafter: Animate CyberAnchors Saling Your Products via
    Human-Object Interacting Video Generation
summary: The automatic generation of anchor-style product promotion videos presents
  promising opportunities in online commerce, advertising, and consumer
  engagement. However, this remains a challenging task despite significant
  advancements in pose-guided human video generation. In addressing this
  challenge, we identify the integration of human-object interactions (HOI) into
  pose-guided human video generation as a core issue. To this end, we introduce
  AnchorCrafter, a novel diffusion-based system designed to generate 2D videos
  featuring a target human and a customized object, achieving high visual
  fidelity and controllable interactions. Specifically, we propose two key
  innovations: the HOI-appearance perception, which enhances object appearance
  recognition from arbitrary multi-view perspectives and disentangles object and
  human appearance, and the HOI-motion injection, which enables complex
  human-object interactions by overcoming challenges in object trajectory
  conditioning and inter-occlusion management. Additionally, we introduce the
  HOI-region reweighting loss, a training objective that enhances the learning of
  object details. Extensive experiments demonstrate that our proposed system
  outperforms existing methods in preserving object appearance and shape
  awareness, while simultaneously maintaining consistency in human appearance and
  motion. Project page: https://cangcz.github.io/Anchor-Crafter/
paper_authors._id: 67468e323f6c325cb30981b3
paper_authors.name: Ziyi Xu
paper_authors._id: 67468e323f6c325cb30981b4
paper_authors.name: Ziyao Huang
paper_authors._id: 67468e323f6c325cb30981b5
paper_authors.name: Juan Cao
paper_authors._id: 67468e323f6c325cb30981b6
paper_authors.name: Yong Zhang
paper_authors._id: 67468e323f6c325cb30981b7
paper_authors.name: Xiaodong Cun
paper_authors._id: 67468e323f6c325cb30981b8
paper_authors.name: Qing Shuai
paper_authors._id: 67468e323f6c325cb30981b9
paper_authors.name: Yuchen Wang
paper_authors._id: 67468e323f6c325cb30981ba
paper_authors.name: Linchao Bao
paper_authors._id: 67468e323f6c325cb30981bb
paper_authors.name: Jintao Li
paper_authors._id: 67468e323f6c325cb30981bc
paper_authors.name: Fan Tang
paper_title: AnchorCrafter: Animate CyberAnchors Saling Your Products via
    Human-Object Interacting Video Generation
paper_summary: The automatic generation of anchor-style product promotion videos presents
  promising opportunities in online commerce, advertising, and consumer
  engagement. However, this remains a challenging task despite significant
  advancements in pose-guided human video generation. In addressing this
  challenge, we identify the integration of human-object interactions (HOI) into
  pose-guided human video generation as a core issue. To this end, we introduce
  AnchorCrafter, a novel diffusion-based system designed to generate 2D videos
  featuring a target human and a customized object, achieving high visual
  fidelity and controllable interactions. Specifically, we propose two key
  innovations: the HOI-appearance perception, which enhances object appearance
  recognition from arbitrary multi-view perspectives and disentangles object and
  human appearance, and the HOI-motion injection, which enables complex
  human-object interactions by overcoming challenges in object trajectory
  conditioning and inter-occlusion management. Additionally, we introduce the
  HOI-region reweighting loss, a training objective that enhances the learning of
  object details. Extensive experiments demonstrate that our proposed system
  outperforms existing methods in preserving object appearance and shape
  awareness, while simultaneously maintaining consistency in human appearance and
  motion. Project page: https://cangcz.github.io/Anchor-Crafter/
paper_ai_summary: AnchorCrafter, a diffusion-based system, generates high-fidelity 2D product promotion videos with controllable human-object interactions through HOI-appearance perception, HOI-motion injection, and HOI-region reweighting loss.
paper_ai_keywords: diffusion-based system HOI-appearance perception HOI-motion injection HOI-region reweighting loss