Floating No More: Object-Ground Reconstruction from a Single Image
Recent advancements in 3D object reconstruction from single images have
primarily focused on improving the accuracy of object shapes. Yet, these
techniques often fail to accurately capture the inter-relation between the
object, ground, and camera. As a result, the reconstructed objects often appear
floating or tilted when placed on flat surfaces. This limitation significantly
affects 3D-aware image editing applications like shadow rendering and object
pose manipulation. To address this issue, we introduce ORG (Object
Reconstruction with Ground), a novel task aimed at reconstructing 3D object
geometry in conjunction with the ground surface. Our method uses two compact
pixel-level representations to depict the relationship between camera, object,
and ground. Experiments show that the proposed ORG model can effectively
reconstruct object-ground geometry on unseen data, significantly enhancing the
quality of shadow generation and pose manipulation compared to conventional
single-image 3D reconstruction techniques.
66a709fae103701b1e577ca6
Yunze Man
admin_assigned
2024-07-29T07:26:01.066Z
654c09356a49f6f6e0034755
/avatars/dd1759e8a60f17c1ad33aafd35a7b672.svg
Yunze Man
user
yunzeman
66a709fae103701b1e577ca7
Yichen Sheng
extracted_pending
2024-07-29T03:18:19.162Z
6590c0fb89f1ff0463859fa7
/avatars/986e7fb0cedada46c057598a289a25ef.svg
sheng
user
yichen-purdue
66a709fae103701b1e577ca8
Jianming Zhang
admin_assigned
2024-07-29T07:26:06.835Z
632d52047bad38a82f75daee
/avatars/56cc9b5dea95408a83cb80ee8c5565bf.svg
Jianming Zhang
user
jimmie33
66a709fae103701b1e577ca9
Liang-Yan Gui
66a709fae103701b1e577caa
Yu-Xiong Wang
Floating No More: Object-Ground Reconstruction from a Single Image
Recent advancements in 3D object reconstruction from single images have
primarily focused on improving the accuracy of object shapes. Yet, these
techniques often fail to accurately capture the inter-relation between the
object, ground, and camera. As a result, the reconstructed objects often appear
floating or tilted when placed on flat surfaces. This limitation significantly
affects 3D-aware image editing applications like shadow rendering and object
pose manipulation. To address this issue, we introduce ORG (Object
Reconstruction with Ground), a novel task aimed at reconstructing 3D object
geometry in conjunction with the ground surface. Our method uses two compact
pixel-level representations to depict the relationship between camera, object,
and ground. Experiments show that the proposed ORG model can effectively
reconstruct object-ground geometry on unseen data, significantly enhancing the
quality of shadow generation and pose manipulation compared to conventional
single-image 3D reconstruction techniques.
A novel method ORG reconstructs 3D object geometry and ground surface to improve shadow rendering and pose manipulation in 3D-aware image editing tasks.
3D object reconstruction pixel-level representations ORG object-ground geometry shadow rendering object pose manipulation