Seeing Faces in Things: A Model and Dataset for Pareidolia
The human visual system is well-tuned to detect faces of all shapes and
sizes. While this brings obvious survival advantages, such as a better chance
of spotting unknown predators in the bush, it also leads to spurious face
detections. ``Face pareidolia'' describes the perception of face-like structure
among otherwise random stimuli: seeing faces in coffee stains or clouds in the
sky. In this paper, we study face pareidolia from a computer vision
perspective. We present an image dataset of ``Faces in Things'', consisting of
five thousand web images with human-annotated pareidolic faces. Using this
dataset, we examine the extent to which a state-of-the-art human face detector
exhibits pareidolia, and find a significant behavioral gap between humans and
machines. We find that the evolutionary need for humans to detect animal faces,
as well as human faces, may explain some of this gap. Finally, we propose a
simple statistical model of pareidolia in images. Through studies on human
subjects and our pareidolic face detectors we confirm a key prediction of our
model regarding what image conditions are most likely to induce pareidolia.
Dataset and Website: https://aka.ms/faces-in-things
66f3b3815294d1cc7c3256a3
Mark Hamilton
claimed_verified
2024-09-25T07:35:02.998Z
62dae3734398e21bf7f53443
https://cdn-avatars.huggingface.co/v1/production/uploads/1658512237806-noauth.jpeg
Mark Hamilton
user
mhamilton723
66f3b3815294d1cc7c3256a4
Simon Stent
66f3b3815294d1cc7c3256a5
Vasha DuTell
66f3b3815294d1cc7c3256a6
Anne Harrington
66f3b3815294d1cc7c3256a7
Jennifer Corbett
66f3b3815294d1cc7c3256a8
Ruth Rosenholtz
66f3b3815294d1cc7c3256a9
William T. Freeman
Seeing Faces in Things: A Model and Dataset for Pareidolia
The human visual system is well-tuned to detect faces of all shapes and
sizes. While this brings obvious survival advantages, such as a better chance
of spotting unknown predators in the bush, it also leads to spurious face
detections. ``Face pareidolia'' describes the perception of face-like structure
among otherwise random stimuli: seeing faces in coffee stains or clouds in the
sky. In this paper, we study face pareidolia from a computer vision
perspective. We present an image dataset of ``Faces in Things'', consisting of
five thousand web images with human-annotated pareidolic faces. Using this
dataset, we examine the extent to which a state-of-the-art human face detector
exhibits pareidolia, and find a significant behavioral gap between humans and
machines. We find that the evolutionary need for humans to detect animal faces,
as well as human faces, may explain some of this gap. Finally, we propose a
simple statistical model of pareidolia in images. Through studies on human
subjects and our pareidolic face detectors we confirm a key prediction of our
model regarding what image conditions are most likely to induce pareidolia.
Dataset and Website: https://aka.ms/faces-in-things
A study investigating the detection of face-like structures in non-face images by both humans and face detectors, revealing differences in pareidolia and proposing a statistical model to explain these detections.
face pareidolia human face detector state-of-the-art image dataset Faces in Things pareidolic face detectors