Vision Language Models are Biased
Large language models (LLMs) memorize a vast amount of prior knowledge from
the Internet that help them on downstream tasks but also may notoriously sway
their outputs towards wrong or biased answers. In this work, we test how the
knowledge about popular subjects hurt the accuracy of vision language models
(VLMs) on standard, objective visual tasks of counting and identification. We
find that state-of-the-art VLMs are strongly biased (e.g, unable to recognize a
fourth stripe has been added to a 3-stripe Adidas logo) scoring an average of
17.05% accuracy in counting (e.g., counting stripes in an Adidas-like logo)
across 7 diverse domains from animals, logos, chess, board games, optical
illusions, to patterned grids. Insert text (e.g., "Adidas") describing the
subject name into the counterfactual image further decreases VLM accuracy. The
biases in VLMs are so strong that instructing them to double-check their
results or rely exclusively on image details to answer improves counting
accuracy by only +2 points, on average. Our work presents an interesting
failure mode in VLMs and an automated framework for testing VLM biases. Code
and data are available at: vlmsarebiased.github.io.
683cf4405810d395f0a3788b
An Vo
claimed_verified
2025-06-02T13:39:54.864Z
6631fd5961a4305e5610d403
https://cdn-avatars.huggingface.co/v1/production/uploads/6631fd5961a4305e5610d403/P1Dtxzn-KIbYDDsiw60nr.jpeg
An Vo
user
anvo25
683cf4405810d395f0a3788c
Khai-Nguyen Nguyen
683cf4405810d395f0a3788d
Mohammad Reza Taesiri
extracted_confirmed
2025-06-02T00:52:37.933Z
6039478ab3ecf716b1a5fd4d
https://cdn-avatars.huggingface.co/v1/production/uploads/6039478ab3ecf716b1a5fd4d/_Thy4E7taiSYBLKxEKJbT.jpeg
taesiri
user
taesiri
683cf4405810d395f0a3788e
Vy Tuong Dang
claimed_verified
2025-06-02T13:39:52.070Z
67a87266e113700e5ee1c3fc
/avatars/ea21f5d239244b810c892333663b5390.svg
Tường Vy
user
tuongvy2603
683cf4405810d395f0a3788f
Anh Totti Nguyen
extracted_pending
2025-06-02T00:45:56.803Z
653194a4c8da3465f4701ad1
/avatars/6682164fcaf1d339ce9ac82ba131af5e.svg
Khai-Nguyen Nguyen
user
knguyennguyen
683cf4405810d395f0a37890
Daeyoung Kim
Vision Language Models are Biased
Large language models (LLMs) memorize a vast amount of prior knowledge from
the Internet that help them on downstream tasks but also may notoriously sway
their outputs towards wrong or biased answers. In this work, we test how the
knowledge about popular subjects hurt the accuracy of vision language models
(VLMs) on standard, objective visual tasks of counting and identification. We
find that state-of-the-art VLMs are strongly biased (e.g, unable to recognize a
fourth stripe has been added to a 3-stripe Adidas logo) scoring an average of
17.05% accuracy in counting (e.g., counting stripes in an Adidas-like logo)
across 7 diverse domains from animals, logos, chess, board games, optical
illusions, to patterned grids. Insert text (e.g., "Adidas") describing the
subject name into the counterfactual image further decreases VLM accuracy. The
biases in VLMs are so strong that instructing them to double-check their
results or rely exclusively on image details to answer improves counting
accuracy by only +2 points, on average. Our work presents an interesting
failure mode in VLMs and an automated framework for testing VLM biases. Code
and data are available at: vlmsarebiased.github.io.
Vision language models exhibit strong biases in counting and identification tasks, demonstrating a failure mode that persist even with additional instructions or context.
large language models vision language models downstream tasks popular subjects accuracy visual tasks counting identification biases counterfactual image automated framework