A General Method to Incorporate Spatial Information into Loss Functions for GAN-based Super-resolution Models
<|reference_start|>A General Method to Incorporate Spatial Information into Loss Functions for GAN-based Super-resolution Models: Generative Adversarial Networks (GANs) have shown great performance on super-resolution problems since they can generate more visually realistic images and video frames. However, these models often introduce side effects into the outputs, such as unexpected artifacts and noises. To reduce these artifacts and enhance the perceptual quality of the results, in this paper, we propose a general method that can be effectively used in most GAN-based super-resolution (SR) models by introducing essential spatial information into the training process. We extract spatial information from the input data and incorporate it into the training loss, making the corresponding loss a spatially adaptive (SA) one. After that, we utilize it to guide the training process. We will show that the proposed approach is independent of the methods used to extract the spatial information and independent of the SR tasks and models. This method consistently guides the training process towards generating visually pleasing SR images and video frames, substantially mitigating artifacts and noise, ultimately leading to enhanced perceptual quality.<|reference_end|>
@article{wang2024a,
    title={A General Method to Incorporate Spatial Information into Loss Functions
  for GAN-based Super-resolution Models},
    author={Xijun Wang, Santiago L'opez-Tapia, Alice Lucas, Xinyi Wu, Rafael
  Molina, Aggelos K. Katsaggelos},
    journal={arXiv preprint arXiv:2403.10589},
    year={2024},
    archivePrefix={arXiv},
    eprint={2403.10589},
    primaryClass={eess.IV cs.CV}
}