Seg-CycleGAN : SAR-to-optical image translation guided by a downstream task
<|reference_start|>Seg-CycleGAN : SAR-to-optical image translation guided by a downstream task: Optical remote sensing and Synthetic Aperture Radar(SAR) remote sensing are crucial for earth observation, offering complementary capabilities. While optical sensors provide high-quality images, they are limited by weather and lighting conditions. In contrast, SAR sensors can operate effectively under adverse conditions. This letter proposes a GAN-based SAR-to-optical image translation method named Seg-CycleGAN, designed to enhance the accuracy of ship target translation by leveraging semantic information from a pre-trained semantic segmentation model. Our method utilizes the downstream task of ship target semantic segmentation to guide the training of image translation network, improving the quality of output Optical-styled images. The potential of foundation-model-annotated datasets in SAR-to-optical translation tasks is revealed. This work suggests broader research and applications for downstream-task-guided frameworks. The code will be available at https://github.com/NPULHH/<|reference_end|>
@article{zhang2024seg-cyclegan,
    title={Seg-CycleGAN : SAR-to-optical image translation guided by a downstream
  task},
    author={Hannuo Zhang, Huihui Li, Jiarui Lin, Yujie Zhang, Jianghua Fan, Hang
  Liu},
    journal={arXiv preprint arXiv:2408.05777},
    year={2024},
    archivePrefix={arXiv},
    eprint={2408.05777},
    primaryClass={cs.CV cs.AI eess.IV}
}