Surround-View Fisheye Optics in Computer Vision and Simulation: Survey and Challenges
<|reference_start|>Surround-View Fisheye Optics in Computer Vision and Simulation: Survey and Challenges: In this paper, we provide a survey on automotive surround-view fisheye optics, with an emphasis on the impact of optical artifacts on computer vision tasks in autonomous driving and ADAS. The automotive industry has advanced in applying state-of-the-art computer vision to enhance road safety and provide automated driving functionality. When using camera systems on vehicles, there is a particular need for a wide field of view to capture the entire vehicle's surroundings, in areas such as low-speed maneuvering, automated parking, and cocoon sensing. However, one crucial challenge in surround-view cameras is the strong optical aberrations of the fisheye camera, which is an area that has received little attention in the literature. Additionally, a comprehensive dataset is needed for testing safety-critical scenarios in vehicle automation. The industry has turned to simulation as a cost-effective strategy for creating synthetic datasets with surround-view camera imagery. We examine different simulation methods (such as model-driven and data-driven simulations) and discuss the simulators' ability (or lack thereof) to model real-world optical performance. Overall, this paper highlights the optical aberrations in automotive fisheye datasets, and the limitations of optical reality in simulated fisheye datasets, with a focus on computer vision in surround-view optical systems.<|reference_end|>
@article{jakab2024surround-view,
    title={Surround-View Fisheye Optics in Computer Vision and Simulation: Survey
  and Challenges},
    author={Daniel Jakab, Brian Michael Deegan, Sushil Sharma, Eoin Martino Grua,
  Jonathan Horgan, Enda Ward, Pepijn Van De Ven, Anthony Scanlan, Ciar'an
  Eising},
    journal={IEEE Transactions on Intelligent Transportation Systems, 2024},
    year={2024},
    doi={10.1109/TITS.2024.3368136},
    archivePrefix={arXiv},
    eprint={2402.12041},
    primaryClass={cs.CV eess.IV}
}