ByteMorph: Benchmarking Instruction-Guided Image Editing with Non-Rigid
  Motions
Editing images with instructions to reflect non-rigid motions, camera
viewpoint shifts, object deformations, human articulations, and complex
interactions, poses a challenging yet underexplored problem in computer vision.
Existing approaches and datasets predominantly focus on static scenes or rigid
transformations, limiting their capacity to handle expressive edits involving
dynamic motion. To address this gap, we introduce ByteMorph, a comprehensive
framework for instruction-based image editing with an emphasis on non-rigid
motions. ByteMorph comprises a large-scale dataset, ByteMorph-6M, and a strong
baseline model built upon the Diffusion Transformer (DiT), named ByteMorpher.
ByteMorph-6M includes over 6 million high-resolution image editing pairs for
training, along with a carefully curated evaluation benchmark ByteMorph-Bench.
Both capture a wide variety of non-rigid motion types across diverse
environments, human figures, and object categories. The dataset is constructed
using motion-guided data generation, layered compositing techniques, and
automated captioning to ensure diversity, realism, and semantic coherence. We
further conduct a comprehensive evaluation of recent instruction-based image
editing methods from both academic and commercial domains.
683ff7f54f32bd7bbca62163
Di Chang
extracted_pending
2025-06-04T07:38:32.749Z
64a5d8219f3b568c202b3137
https://cdn-avatars.huggingface.co/v1/production/uploads/64a5d8219f3b568c202b3137/TI20Z1lWHzZpLsMkayDbU.png
Di Chang
user
Boese0601
683ff7f54f32bd7bbca62164
Mingdeng Cao
admin_assigned
2025-06-05T07:35:13.955Z
6374a02d0856ac905bfc6113
/avatars/2cbe75c9cc818a647ca6e416f129c96f.svg
Mingdeng Cao
user
Ljzycmd
683ff7f54f32bd7bbca62165
Yichun Shi
683ff7f54f32bd7bbca62166
Bo Liu
683ff7f54f32bd7bbca62167
Shengqu Cai
admin_assigned
2025-06-05T07:35:28.200Z
66a1da7cc9e703d2af5ad742
/avatars/f9cd9ae3407e249ab4569479200feb1f.svg
Shengqu Cai
user
primecai
683ff7f54f32bd7bbca62168
Shijie Zhou
683ff7f54f32bd7bbca62169
Weilin Huang
683ff7f54f32bd7bbca6216a
Gordon Wetzstein
admin_assigned
2025-06-05T07:35:48.160Z
6694e583ac96ca2c17131505
/avatars/6e7a31f257e36cf301da6f879dc0a122.svg
Gordon Wetzstein
user
wetzste1
683ff7f54f32bd7bbca6216b
Mohammad Soleymani
admin_assigned
2025-06-05T07:35:42.327Z
65fcb99d383d3f256c3a92d2
/avatars/b85d32f4d7a19816b8d499e05b173ad1.svg
Mohammad Soleymani
user
msoleymani
683ff7f54f32bd7bbca6216c
Peng Wang
extracted_pending
2025-06-04T07:38:32.749Z
619c4a5cb392787f0f3ead53
/avatars/e62bc6fed6e9cbe4e0339e050cc3be5f.svg
peng  wang
user
Peng-Wang
ByteMorph: Benchmarking Instruction-Guided Image Editing with Non-Rigid
  Motions
Editing images with instructions to reflect non-rigid motions, camera
viewpoint shifts, object deformations, human articulations, and complex
interactions, poses a challenging yet underexplored problem in computer vision.
Existing approaches and datasets predominantly focus on static scenes or rigid
transformations, limiting their capacity to handle expressive edits involving
dynamic motion. To address this gap, we introduce ByteMorph, a comprehensive
framework for instruction-based image editing with an emphasis on non-rigid
motions. ByteMorph comprises a large-scale dataset, ByteMorph-6M, and a strong
baseline model built upon the Diffusion Transformer (DiT), named ByteMorpher.
ByteMorph-6M includes over 6 million high-resolution image editing pairs for
training, along with a carefully curated evaluation benchmark ByteMorph-Bench.
Both capture a wide variety of non-rigid motion types across diverse
environments, human figures, and object categories. The dataset is constructed
using motion-guided data generation, layered compositing techniques, and
automated captioning to ensure diversity, realism, and semantic coherence. We
further conduct a comprehensive evaluation of recent instruction-based image
editing methods from both academic and commercial domains.
ByteMorph, a framework using the Diffusion Transformer, addresses non-rigid motion in image editing with a large-scale dataset and comprehensive evaluation.
Diffusion Transformer ByteMorph ByteMorph-6M ByteMorpher ByteMorph-Bench motion-guided data generation layered compositing automated captioning instruction-based image editing