Visual and audio scene classification for detecting discrepancies in video: a baseline method and experimental protocol
<|reference_start|>Visual and audio scene classification for detecting discrepancies in video: a baseline method and experimental protocol: This paper presents a baseline approach and an experimental protocol for a specific content verification problem: detecting discrepancies between the audio and video modalities in multimedia content. We first design and optimize an audio-visual scene classifier, to compare with existing classification baselines that use both modalities. Then, by applying this classifier separately to the audio and the visual modality, we can detect scene-class inconsistencies between them. To facilitate further research and provide a common evaluation platform, we introduce an experimental protocol and a benchmark dataset simulating such inconsistencies. Our approach achieves state-of-the-art results in scene classification and promising outcomes in audio-visual discrepancies detection, highlighting its potential in content verification applications.<|reference_end|>
@article{apostolidis2024visual,
    title={Visual and audio scene classification for detecting discrepancies in
  video: a baseline method and experimental protocol},
    author={Konstantinos Apostolidis, Jakob Abesser, Luca Cuccovillo, Vasileios
  Mezaris},
    journal={arXiv preprint arXiv:2405.00384},
    year={2024},
    archivePrefix={arXiv},
    eprint={2405.00384},
    primaryClass={cs.CV cs.MM cs.SD eess.AS}
}