title: AlphaTablets: A Generic Plane Representation for 3D Planar
    Reconstruction from Monocular Videos
summary: We introduce AlphaTablets, a novel and generic representation of 3D planes
  that features continuous 3D surface and precise boundary delineation. By
  representing 3D planes as rectangles with alpha channels, AlphaTablets combine
  the advantages of current 2D and 3D plane representations, enabling accurate,
  consistent and flexible modeling of 3D planes. We derive differentiable
  rasterization on top of AlphaTablets to efficiently render 3D planes into
  images, and propose a novel bottom-up pipeline for 3D planar reconstruction
  from monocular videos. Starting with 2D superpixels and geometric cues from
  pre-trained models, we initialize 3D planes as AlphaTablets and optimize them
  via differentiable rendering. An effective merging scheme is introduced to
  facilitate the growth and refinement of AlphaTablets. Through iterative
  optimization and merging, we reconstruct complete and accurate 3D planes with
  solid surfaces and clear boundaries. Extensive experiments on the ScanNet
  dataset demonstrate state-of-the-art performance in 3D planar reconstruction,
  underscoring the great potential of AlphaTablets as a generic 3D plane
  representation for various applications. Project page is available at:
  https://hyzcluster.github.io/alphatablets
paper_authors._id: 674d422720c42228e89c477e
paper_authors.name: Yuze He
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-02T09:20:25.901Z
paper_authors._id: 64c903957b4d0d947ce86bc6
paper_authors.avatarUrl: /avatars/61d70a3ba00c83a5950f5c909a1a06f8.svg
paper_authors.fullname: Yuze He
paper_authors.type: user
paper_authors.user: hyz317
paper_authors._id: 674d422720c42228e89c477f
paper_authors.name: Wang Zhao
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-12-02T09:34:05.024Z
paper_authors._id: 66054d519af76210c2ee4b8e
paper_authors.avatarUrl: /avatars/c1854765b1e45ec33602b2cb9443f82a.svg
paper_authors.fullname: Wang Zhao
paper_authors.type: user
paper_authors.user: thuzhaowang
paper_authors._id: 674d422720c42228e89c4780
paper_authors.name: Shaohui Liu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-02T09:20:34.937Z
paper_authors._id: 635265ff3d604ecb3936e3d0
paper_authors.avatarUrl: /avatars/53e7cd1a216f97c45fc3e51e3a8bae35.svg
paper_authors.fullname: Shaohui Liu
paper_authors.type: user
paper_authors.user: lshmouse
paper_authors._id: 674d422720c42228e89c4781
paper_authors.name: Yubin Hu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-02T09:20:40.445Z
paper_authors._id: 672a099e6077b009b3c9972d
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/lduG_xVw-XFElSKhZrava.jpeg
paper_authors.fullname: Yubin Hu
paper_authors.type: user
paper_authors.user: AlbertHuyb
paper_authors._id: 674d422720c42228e89c4782
paper_authors.name: Yushi Bai
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-02T09:20:45.506Z
paper_authors._id: 64ed568ccf6118a9379a61b8
paper_authors.avatarUrl: /avatars/6d040cbcb4a9b624cbe64c9d01cd5c88.svg
paper_authors.fullname: Yushi Bai
paper_authors.type: user
paper_authors.user: bys0318
paper_authors._id: 674d422720c42228e89c4783
paper_authors.name: Yu-Hui Wen
paper_authors._id: 674d422720c42228e89c4784
paper_authors.name: Yong-Jin Liu
paper_title: AlphaTablets: A Generic Plane Representation for 3D Planar
    Reconstruction from Monocular Videos
paper_summary: We introduce AlphaTablets, a novel and generic representation of 3D planes
  that features continuous 3D surface and precise boundary delineation. By
  representing 3D planes as rectangles with alpha channels, AlphaTablets combine
  the advantages of current 2D and 3D plane representations, enabling accurate,
  consistent and flexible modeling of 3D planes. We derive differentiable
  rasterization on top of AlphaTablets to efficiently render 3D planes into
  images, and propose a novel bottom-up pipeline for 3D planar reconstruction
  from monocular videos. Starting with 2D superpixels and geometric cues from
  pre-trained models, we initialize 3D planes as AlphaTablets and optimize them
  via differentiable rendering. An effective merging scheme is introduced to
  facilitate the growth and refinement of AlphaTablets. Through iterative
  optimization and merging, we reconstruct complete and accurate 3D planes with
  solid surfaces and clear boundaries. Extensive experiments on the ScanNet
  dataset demonstrate state-of-the-art performance in 3D planar reconstruction,
  underscoring the great potential of AlphaTablets as a generic 3D plane
  representation for various applications. Project page is available at:
  https://hyzcluster.github.io/alphatablets
paper_ai_summary: AlphaTablets, a new 3D plane representation, combines 2D and 3D advantages, enabling precise 3D planar reconstruction from monocular videos.
paper_ai_keywords: AlphaTablets 3D planes continuous 3D surface precise boundary delineation differentiable rasterization bottom-up pipeline 3D planar reconstruction monocular videos 2D superpixels geometric cues pre-trained models iterative optimization merging ScanNet dataset