title: DragAnything: Motion Control for Anything using Entity Representation
summary: We introduce DragAnything, which utilizes a entity representation to achieve
  motion control for any object in controllable video generation. Comparison to
  existing motion control methods, DragAnything offers several advantages.
  Firstly, trajectory-based is more userfriendly for interaction, when acquiring
  other guidance signals (e.g., masks, depth maps) is labor-intensive. Users only
  need to draw a line (trajectory) during interaction. Secondly, our entity
  representation serves as an open-domain embedding capable of representing any
  object, enabling the control of motion for diverse entities, including
  background. Lastly, our entity representation allows simultaneous and distinct
  motion control for multiple objects. Extensive experiments demonstrate that our
  DragAnything achieves state-of-the-art performance for FVD, FID, and User
  Study, particularly in terms of object motion control, where our method
  surpasses the previous methods (e.g., DragNUWA) by 26% in human voting.
paper_authors._id: 65f10ccb3cf945cb5ad34297
paper_authors.name: Wejia Wu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-03-13T16:15:04.656Z
paper_authors._id: 6345a93afe134dfd7a0cfabd
paper_authors.avatarUrl: /avatars/65130ce06b1c72ab1066678419731d88.svg
paper_authors.fullname: wu weijia
paper_authors.type: user
paper_authors.user: weijiawu
paper_authors._id: 65f10ccb3cf945cb5ad34298
paper_authors.name: Zhuang Li
paper_authors._id: 65f10ccb3cf945cb5ad34299
paper_authors.name: Yuchao Gu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-13T14:08:45.518Z
paper_authors._id: 63021630a35b21bd8a53305a
paper_authors.avatarUrl: /avatars/7a7e8b39749eda61e57d8a1908726558.svg
paper_authors.fullname: Gu Yuchao
paper_authors.type: user
paper_authors.user: guyuchao
paper_authors._id: 65f10ccb3cf945cb5ad3429a
paper_authors.name: Rui Zhao
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-13T14:09:05.553Z
paper_authors._id: 652b83b73b5997ed71a310f2
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/652b83b73b5997ed71a310f2/ipCpdeHUp4-0OmRz5z8IW.png
paper_authors.fullname: Rui Zhao
paper_authors.type: user
paper_authors.user: ruizhaocv
paper_authors._id: 65f10ccb3cf945cb5ad3429b
paper_authors.name: Yefei He
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-13T14:09:16.095Z
paper_authors._id: 65a88c3d26598b995531fff1
paper_authors.avatarUrl: /avatars/b1a524857d8572d0405476661b434160.svg
paper_authors.fullname: Yefei He
paper_authors.type: user
paper_authors.user: yefly
paper_authors._id: 65f10ccb3cf945cb5ad3429c
paper_authors.name: David Junhao Zhang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-13T14:09:22.678Z
paper_authors._id: 6468855763a564ba347e1efa
paper_authors.avatarUrl: /avatars/caa99c3318c1d6d21be44d2d32795a62.svg
paper_authors.fullname: David Junhao ZHANG
paper_authors.type: user
paper_authors.user: Junhao233
paper_authors._id: 65f10ccb3cf945cb5ad3429d
paper_authors.name: Mike Zheng Shou
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-13T14:09:46.187Z
paper_authors._id: 63a55320ce5763e06f78519c
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1671779060549-noauth.jpeg
paper_authors.fullname: Mike Shou
paper_authors.type: user
paper_authors.user: mikeshou
paper_authors._id: 65f10ccb3cf945cb5ad3429e
paper_authors.name: Yan Li
paper_authors._id: 65f10ccb3cf945cb5ad3429f
paper_authors.name: Tingting Gao
paper_authors._id: 65f10ccb3cf945cb5ad342a0
paper_authors.name: Di Zhang
paper_title: DragAnything: Motion Control for Anything using Entity Representation
paper_summary: We introduce DragAnything, which utilizes a entity representation to achieve
  motion control for any object in controllable video generation. Comparison to
  existing motion control methods, DragAnything offers several advantages.
  Firstly, trajectory-based is more userfriendly for interaction, when acquiring
  other guidance signals (e.g., masks, depth maps) is labor-intensive. Users only
  need to draw a line (trajectory) during interaction. Secondly, our entity
  representation serves as an open-domain embedding capable of representing any
  object, enabling the control of motion for diverse entities, including
  background. Lastly, our entity representation allows simultaneous and distinct
  motion control for multiple objects. Extensive experiments demonstrate that our
  DragAnything achieves state-of-the-art performance for FVD, FID, and User
  Study, particularly in terms of object motion control, where our method
  surpasses the previous methods (e.g., DragNUWA) by 26% in human voting.
paper_ai_keywords: entity representation motion control trajectory-based synthesis images depth maps embedding FVD FID User Study state-of-the-art performance DragNUWA