Beyond the Visible: Jointly Attending to Spectral and Spatial Dimensions with HSI-Diffusion for the FINCH Spacecraft
<|reference_start|>Beyond the Visible: Jointly Attending to Spectral and Spatial Dimensions with HSI-Diffusion for the FINCH Spacecraft: Satellite remote sensing missions have gained popularity over the past fifteen years due to their ability to cover large swaths of land at regular intervals, making them ideal for monitoring environmental trends. The FINCH mission, a 3U+ CubeSat equipped with a hyperspectral camera, aims to monitor crop residue cover in agricultural fields. Although hyperspectral imaging captures both spectral and spatial information, it is prone to various types of noise, including random noise, stripe noise, and dead pixels. Effective denoising of these images is crucial for downstream scientific tasks. Traditional methods, including hand-crafted techniques encoding strong priors, learned 2D image denoising methods applied across different hyperspectral bands, or diffusion generative models applied independently on bands, often struggle with varying noise strengths across spectral bands, leading to significant spectral distortion. This paper presents a novel approach to hyperspectral image denoising using latent diffusion models that integrate spatial and spectral information. We particularly do so by building a 3D diffusion model and presenting a 3-stage training approach on real and synthetically crafted datasets. The proposed method preserves image structure while reducing noise. Evaluations on both popular hyperspectral denoising datasets and synthetically crafted datasets for the FINCH mission demonstrate the effectiveness of this approach.<|reference_end|>
@article{vyse2024beyond,
    title={Beyond the Visible: Jointly Attending to Spectral and Spatial Dimensions
  with HSI-Diffusion for the FINCH Spacecraft},
    author={Ian Vyse, Rishit Dagli, Dav Vrat Chadha, John P. Ma, Hector Chen, Isha
  Ruparelia, Prithvi Seran, Matthew Xie, Eesa Aamer, Aidan Armstrong, Naveen
  Black, Ben Borstein, Kevin Caldwell, Orrin Dahanaggamaarachchi, Joe Dai,
  Abeer Fatima, Stephanie Lu, Maxime Michet, Anoushka Paul, Carrie Ann Po,
  Shivesh Prakash, Noa Prosser, Riddhiman Roy, Mirai Shinjo, Iliya Shofman,
  Coby Silayan, Reid Sox-Harris, Shuhan Zheng, and Khang Nguyen},
    journal={arXiv preprint arXiv:2406.10724},
    year={2024},
    archivePrefix={arXiv},
    eprint={2406.10724},
    primaryClass={eess.IV cs.CV cs.LG}
}