Generative Blocks World: Moving Things Around in Pictures
We describe Generative Blocks World to interact with the scene of a generated
image by manipulating simple geometric abstractions. Our method represents
scenes as assemblies of convex 3D primitives, and the same scene can be
represented by different numbers of primitives, allowing an editor to move
either whole structures or small details. Once the scene geometry has been
edited, the image is generated by a flow-based method which is conditioned on
depth and a texture hint. Our texture hint takes into account the modified 3D
primitives, exceeding texture-consistency provided by existing key-value
caching techniques. These texture hints (a) allow accurate object and camera
moves and (b) largely preserve the identity of objects depicted. Quantitative
and qualitative experiments demonstrate that our approach outperforms prior
works in visual fidelity, editability, and compositional generalization.
685ef79a9e7509383d29a992
Vaibhav Vavilala
claimed_verified
2025-06-27T20:30:31.925Z
631219973a773344e06c2fd4
/avatars/44a09471f7b0d551505cb14cc878a09f.svg
Vaibhav Vavilala
user
vv1233
685ef79a9e7509383d29a993
Seemandhar Jain
685ef79a9e7509383d29a994
Rahul Vasanth
685ef79a9e7509383d29a995
D. A. Forsyth
685ef79a9e7509383d29a996
Anand Bhattad
claimed_verified
2025-06-29T10:14:14.520Z
6303d5924ec2dfa82a5627de
/avatars/1e433b7fb9d30b9f42dec487d658b1e3.svg
Anand Bhattad
user
anandbhattad
Generative Blocks World: Moving Things Around in Pictures
We describe Generative Blocks World to interact with the scene of a generated
image by manipulating simple geometric abstractions. Our method represents
scenes as assemblies of convex 3D primitives, and the same scene can be
represented by different numbers of primitives, allowing an editor to move
either whole structures or small details. Once the scene geometry has been
edited, the image is generated by a flow-based method which is conditioned on
depth and a texture hint. Our texture hint takes into account the modified 3D
primitives, exceeding texture-consistency provided by existing key-value
caching techniques. These texture hints (a) allow accurate object and camera
moves and (b) largely preserve the identity of objects depicted. Quantitative
and qualitative experiments demonstrate that our approach outperforms prior
works in visual fidelity, editability, and compositional generalization.
A generative method that edits 3D scenes using convex primitives and regenerates images with enhanced texture consistency and visual fidelity.
flow-based method convex 3D primitives depth texture hint key-value caching visual fidelity editability compositional generalization