Liat Bar, Shelley Shaul
Early Numeracy and Literacy Skills Among Monolingual and Bilingual Kindergarten Children
Frontiers in psychology
recent years multiplechoice visual question answering vqa become topical achieved remarkable progress however pioneer multiplechoice vqa models heavily driven statistical correlations datasets cannot perform well multimodal understanding suffer poor generalization paper identify two kinds spurious correlations ie visionanswer bias va bias questionanswer bias qa bias systematically scientifically study biases construct new video question answering videoqa benchmark nextood ood setting propose graphbased crosssample method bias reduction specifically nextood designed quantify models generalizability measure reasoning ability comprehensively contains three subdatasets including nextoodva nextoodqa nextoodvqa designed va bias qa bias vaqa bias respectively evaluate several existing multiplechoice vqa models nextood illustrate performance degrades significantly compared results obtained original multiplechoice vqa dataset besides mitigate va bias qa bias explicitly consider crosssample information design contrastive graph matching loss approach provides adequate debiasing guidance perspective whole dataset encourages model focus multimodal contents instead spurious statistical regularities extensive experimental results illustrate method significantly outperforms bias reduction strategies demonstrating effectiveness generalizability proposed approach