Radiance Fields from Photons
<|reference_start|>Radiance Fields from Photons: Neural radiance fields, or NeRFs, have become the de facto approach for high-quality view synthesis from a collection of images captured from multiple viewpoints. However, many issues remain when capturing images in-the-wild under challenging conditions, such as low light, high dynamic range, or rapid motion leading to smeared reconstructions with noticeable artifacts. In this work, we introduce quanta radiance fields, a novel class of neural radiance fields that are trained at the granularity of individual photons using single-photon cameras (SPCs). We develop theory and practical computational techniques for building radiance fields and estimating dense camera poses from unconventional, stochastic, and high-speed binary frame sequences captured by SPCs. We demonstrate, both via simulations and a SPC hardware prototype, high-fidelity reconstructions under high-speed motion, in low light, and for extreme dynamic range settings.<|reference_end|>
@article{jungerman2024radiance,
    title={Radiance Fields from Photons},
    author={Sacha Jungerman and Mohit Gupta},
    journal={arXiv preprint arXiv:2407.09386},
    year={2024},
    archivePrefix={arXiv},
    eprint={2407.09386},
    primaryClass={cs.CV eess.IV}
}