An Object is Worth 64x64 Pixels: Generating 3D Object via Image
  Diffusion
We introduce a new approach for generating realistic 3D models with UV maps
through a representation termed "Object Images." This approach encapsulates
surface geometry, appearance, and patch structures within a 64x64 pixel image,
effectively converting complex 3D shapes into a more manageable 2D format. By
doing so, we address the challenges of both geometric and semantic irregularity
inherent in polygonal meshes. This method allows us to use image generation
models, such as Diffusion Transformers, directly for 3D shape generation.
Evaluated on the ABO dataset, our generated shapes with patch structures
achieve point cloud FID comparable to recent 3D generative models, while
naturally supporting PBR material generation.
66b2dccffa7069c7f1f22f12
Xingguang Yan
admin_assigned
2024-08-08T12:14:00.289Z
6441ccbf608bf7e3ad7941f1
/avatars/55f83f3bd1e49d0d74cc949cae54a57b.svg
Xingguang Yan
user
yanxg
66b2dccffa7069c7f1f22f13
Han-Hung Lee
admin_assigned
2024-08-08T12:14:06.434Z
6313c7a754e6e5d9f0fa4d81
/avatars/0b0e5f09171b87d61260225b2021aa98.svg
HAN-HUNG LEE
user
rexleeppp
66b2dccffa7069c7f1f22f14
Ziyu Wan
admin_assigned
2024-08-08T12:14:18.316Z
669f5261ab5548b23ea659f0
/avatars/9db59c5db1c451e492081e1bdaede0c8.svg
wanziyu
user
wnaziyu002
66b2dccffa7069c7f1f22f15
Angel X. Chang
admin_assigned
2024-08-08T12:14:28.715Z
6363d5d92e11f41bc819176e
/avatars/516bea7f7da973bfcc992df9a63727ca.svg
Angel Chang
user
angelxuanchang
An Object is Worth 64x64 Pixels: Generating 3D Object via Image
  Diffusion
We introduce a new approach for generating realistic 3D models with UV maps
through a representation termed "Object Images." This approach encapsulates
surface geometry, appearance, and patch structures within a 64x64 pixel image,
effectively converting complex 3D shapes into a more manageable 2D format. By
doing so, we address the challenges of both geometric and semantic irregularity
inherent in polygonal meshes. This method allows us to use image generation
models, such as Diffusion Transformers, directly for 3D shape generation.
Evaluated on the ABO dataset, our generated shapes with patch structures
achieve point cloud FID comparable to recent 3D generative models, while
naturally supporting PBR material generation.
Object Images convert 3D models into a manageable 2D format using image generation models like Diffusion Transformers, providing realistic 3D shapes and PBR materials.
Object Images 3D models UV maps surface geometry appearance patch structures polygonal meshes Diffusion Transformers point cloud FID PBR material generation