3D Reconstruction with Fast Dipole Sums
<|reference_start|>3D Reconstruction with Fast Dipole Sums: We introduce a method for high-quality 3D reconstruction from multi-view images. Our method uses a new point-based representation, the regularized dipole sum, which generalizes the winding number to allow for interpolation of per-point attributes in point clouds with noisy or outlier points. Using regularized dipole sums, we represent implicit geometry and radiance fields as per-point attributes of a dense point cloud, which we initialize from structure from motion. We additionally derive Barnes-Hut fast summation schemes for accelerated forward and adjoint dipole sum queries. These queries facilitate the use of ray tracing to efficiently and differentiably render images with our point-based representations, and thus update their point attributes to optimize scene geometry and appearance. We evaluate our method in inverse rendering applications against state-of-the-art alternatives, based on ray tracing of neural representations or rasterization of Gaussian point-based representations. Our method significantly improves 3D reconstruction quality and robustness at equal runtimes, while also supporting more general rendering methods such as shadow rays for direct illumination.<|reference_end|>
@article{chen20243d,
    title={3D Reconstruction with Fast Dipole Sums},
    author={Hanyu Chen, Bailey Miller, Ioannis Gkioulekas},
    journal={arXiv preprint arXiv:2405.16788},
    year={2024},
    archivePrefix={arXiv},
    eprint={2405.16788},
    primaryClass={cs.CV cs.GR}
}