title: TraDiffusion: Trajectory-Based Training-Free Image Generation
summary: In this work, we propose a training-free, trajectory-based controllable T2I
  approach, termed TraDiffusion. This novel method allows users to effortlessly
  guide image generation via mouse trajectories. To achieve precise control, we
  design a distance awareness energy function to effectively guide latent
  variables, ensuring that the focus of generation is within the areas defined by
  the trajectory. The energy function encompasses a control function to draw the
  generation closer to the specified trajectory and a movement function to
  diminish activity in areas distant from the trajectory. Through extensive
  experiments and qualitative assessments on the COCO dataset, the results reveal
  that TraDiffusion facilitates simpler, more natural image control. Moreover, it
  showcases the ability to manipulate salient regions, attributes, and
  relationships within the generated images, alongside visual input based on
  arbitrary or enhanced trajectories.
paper_authors._id: 66c41a52b237028a181ef5be
paper_authors.name: Mingrui Wu
paper_authors._id: 66c41a52b237028a181ef5bf
paper_authors.name: Oucheng Huang
paper_authors._id: 66c41a52b237028a181ef5c0
paper_authors.name: Jiayi Ji
paper_authors._id: 66c41a52b237028a181ef5c1
paper_authors.name: Jiale Li
paper_authors._id: 66c41a52b237028a181ef5c2
paper_authors.name: Xinyue Cai
paper_authors._id: 66c41a52b237028a181ef5c3
paper_authors.name: Huafeng Kuang
paper_authors._id: 66c41a52b237028a181ef5c4
paper_authors.name: Jianzhuang Liu
paper_authors._id: 66c41a52b237028a181ef5c5
paper_authors.name: Xiaoshuai Sun
paper_authors._id: 66c41a52b237028a181ef5c6
paper_authors.name: Rongrong Ji
paper_title: TraDiffusion: Trajectory-Based Training-Free Image Generation
paper_summary: In this work, we propose a training-free, trajectory-based controllable T2I
  approach, termed TraDiffusion. This novel method allows users to effortlessly
  guide image generation via mouse trajectories. To achieve precise control, we
  design a distance awareness energy function to effectively guide latent
  variables, ensuring that the focus of generation is within the areas defined by
  the trajectory. The energy function encompasses a control function to draw the
  generation closer to the specified trajectory and a movement function to
  diminish activity in areas distant from the trajectory. Through extensive
  experiments and qualitative assessments on the COCO dataset, the results reveal
  that TraDiffusion facilitates simpler, more natural image control. Moreover, it
  showcases the ability to manipulate salient regions, attributes, and
  relationships within the generated images, alongside visual input based on
  arbitrary or enhanced trajectories.
paper_ai_summary: TraDiffusion, a training-free trajectory-based approach, allows precise control over image generation using mouse trajectories by adjusting latent variables with a custom energy function.
paper_ai_keywords: TraDiffusion training-free trajectory-based controllable T2I image generation energy function latent variables control function movement function COCO dataset salient regions attributes relationships visual input