Geopolitical biases in LLMs: what are the "good" and the "bad" countries
  according to contemporary language models
This paper evaluates geopolitical biases in LLMs with respect to various
countries though an analysis of their interpretation of historical events with
conflicting national perspectives (USA, UK, USSR, and China). We introduce a
novel dataset with neutral event descriptions and contrasting viewpoints from
different countries. Our findings show significant geopolitical biases, with
models favoring specific national narratives. Additionally, simple debiasing
prompts had a limited effect in reducing these biases. Experiments with
manipulated participant labels reveal models' sensitivity to attribution,
sometimes amplifying biases or recognizing inconsistencies, especially with
swapped labels. This work highlights national narrative biases in LLMs,
challenges the effectiveness of simple debiasing methods, and offers a
framework and dataset for future geopolitical bias research.
6848fecf42e4f9106973f315
Mikhail Salnikov
claimed_verified
2025-06-11T08:34:47.630Z
62bd6c6baaf1480f1aa2222e
/avatars/fd92ae2986d435a47eb1e382ac11d8e0.svg
Mikhail Salnikov
user
msalnikov
6848fecf42e4f9106973f316
Dmitrii Korzh
6848fecf42e4f9106973f317
Ivan Lazichny
admin_assigned
2025-06-11T09:26:44.876Z
657c4a8dfb0285d857d86e4c
/avatars/17635a4c2c804dd3837ae01833bb940d.svg
Ivan
user
IvanLazichny
6848fecf42e4f9106973f318
Elvir Karimov
6848fecf42e4f9106973f319
Artyom Iudin
6848fecf42e4f9106973f31a
Ivan Oseledets
claimed_verified
2025-06-12T12:42:46.020Z
6169a581d05945bfd8718dfa
/avatars/1892ab06a7ddb557232777de3cbec470.svg
Ivan Oseledets
user
oseledets
6848fecf42e4f9106973f31b
Oleg Y. Rogov
6848fecf42e4f9106973f31c
Alexander Panchenko
admin_assigned
2025-06-11T09:27:06.218Z
605473729d7c1d4d81b7e52b
https://cdn-avatars.huggingface.co/v1/production/uploads/1662046050710-605473729d7c1d4d81b7e52b.jpeg
Alexander Panchenko
user
apanc
6848fecf42e4f9106973f31d
Natalia Loukachevitch
6848fecf42e4f9106973f31e
Elena Tutubalina
admin_assigned
2025-06-11T09:26:55.840Z
662f8d645c4db70c77a203b0
/avatars/72f9a3c39b3ba5114388d16a35524835.svg
Elena Tutubalina
user
tlenusik
Geopolitical biases in LLMs: what are the "good" and the "bad" countries
  according to contemporary language models
This paper evaluates geopolitical biases in LLMs with respect to various
countries though an analysis of their interpretation of historical events with
conflicting national perspectives (USA, UK, USSR, and China). We introduce a
novel dataset with neutral event descriptions and contrasting viewpoints from
different countries. Our findings show significant geopolitical biases, with
models favoring specific national narratives. Additionally, simple debiasing
prompts had a limited effect in reducing these biases. Experiments with
manipulated participant labels reveal models' sensitivity to attribution,
sometimes amplifying biases or recognizing inconsistencies, especially with
swapped labels. This work highlights national narrative biases in LLMs,
challenges the effectiveness of simple debiasing methods, and offers a
framework and dataset for future geopolitical bias research.
LLMs exhibit significant geopolitical biases in their interpretation of historical events, and simple debiasing methods have limited effectiveness; a novel dataset for further research is provided.
LLMs geopolitical biases historical events national narratives debiasing prompts