Survey of Cultural Awareness in Language Models: Text and Beyond
Large-scale deployment of large language models (LLMs) in various
applications, such as chatbots and virtual assistants, requires LLMs to be
culturally sensitive to the user to ensure inclusivity. Culture has been widely
studied in psychology and anthropology, and there has been a recent surge in
research on making LLMs more culturally inclusive in LLMs that goes beyond
multilinguality and builds on findings from psychology and anthropology. In
this paper, we survey efforts towards incorporating cultural awareness into
text-based and multimodal LLMs. We start by defining cultural awareness in
LLMs, taking the definitions of culture from anthropology and psychology as a
point of departure. We then examine methodologies adopted for creating
cross-cultural datasets, strategies for cultural inclusion in downstream tasks,
and methodologies that have been used for benchmarking cultural awareness in
LLMs. Further, we discuss the ethical implications of cultural alignment, the
role of Human-Computer Interaction in driving cultural inclusion in LLMs, and
the role of cultural alignment in driving social science research. We finally
provide pointers to future research based on our findings about gaps in the
literature.
6729cc9f35af989bcce75f03
Siddhesh Pawar
claimed_verified
2024-11-05T07:57:08.217Z
60c50f18754747f54fa37114
/avatars/648ae58b81806dbd93a68546666047e3.svg
Siddhesh
user
sidicity
6729cc9f35af989bcce75f04
Junyeong Park
claimed_verified
2024-11-15T09:37:47.789Z
637c624d3d8e2e9c40c2537b
/avatars/99dddf923f3f15a74546ec2b94b4e3ce.svg
Junyeong Park
user
jjjunyeong
6729cc9f35af989bcce75f05
Jiho Jin
claimed_verified
2024-11-05T08:49:26.630Z
65e52c1c57459fa149c7fd48
/avatars/594749486825ea3cce7d0aa2c673d644.svg
Jiho Jin
user
jinjh0123
6729cc9f35af989bcce75f06
Arnav Arora
6729cc9f35af989bcce75f07
Junho Myung
admin_assigned
2024-11-05T14:02:44.622Z
628c9b7ed1ed15f46a96a258
/avatars/1dc91fee8b3766759caf00f0a3c588dd.svg
Junho Myung
user
Junho00211
6729cc9f35af989bcce75f08
Srishti Yadav
claimed_verified
2024-11-05T13:36:23.103Z
60c7ccd1dfbd57a384a0111e
/avatars/70e55e861656a52ae535182db17d3789.svg
Srishti
user
srishtiy
6729cc9f35af989bcce75f09
Faiz Ghifari Haznitrama
admin_assigned
2024-11-05T14:02:10.088Z
634627a5ac1cb29fb2ac485f
/avatars/275ad360aacbd9956f09aa1dffff9fd7.svg
Faiz Ghifari Haznitrama
user
haznitrama
6729cc9f35af989bcce75f0a
Inhwa Song
admin_assigned
2024-11-05T14:02:19.643Z
63249643dabddff8da6dae26
/avatars/256b917445920feb92f3e2de8609d65d.svg
Inhwa Song
user
greenina
6729cc9f35af989bcce75f0b
Alice Oh
admin_assigned
2024-11-05T14:02:28.798Z
60e0251ea9b5d8282481f2b7
/avatars/43441373af054a6184c22097bfeb97e4.svg
Alice Oh
user
aliceoh
6729cc9f35af989bcce75f0c
Isabelle Augenstein
admin_assigned
2024-11-05T14:02:35.372Z
608918b7df398c3b285ce960
https://cdn-avatars.huggingface.co/v1/production/uploads/1621507769190-608918b7df398c3b285ce960.jpeg
Isabelle Augenstein
user
IAugenstein
Survey of Cultural Awareness in Language Models: Text and Beyond
Large-scale deployment of large language models (LLMs) in various
applications, such as chatbots and virtual assistants, requires LLMs to be
culturally sensitive to the user to ensure inclusivity. Culture has been widely
studied in psychology and anthropology, and there has been a recent surge in
research on making LLMs more culturally inclusive in LLMs that goes beyond
multilinguality and builds on findings from psychology and anthropology. In
this paper, we survey efforts towards incorporating cultural awareness into
text-based and multimodal LLMs. We start by defining cultural awareness in
LLMs, taking the definitions of culture from anthropology and psychology as a
point of departure. We then examine methodologies adopted for creating
cross-cultural datasets, strategies for cultural inclusion in downstream tasks,
and methodologies that have been used for benchmarking cultural awareness in
LLMs. Further, we discuss the ethical implications of cultural alignment, the
role of Human-Computer Interaction in driving cultural inclusion in LLMs, and
the role of cultural alignment in driving social science research. We finally
provide pointers to future research based on our findings about gaps in the
literature.
Research investigates methods to incorporate cultural awareness into large language models, focusing on dataset creation, task strategies, benchmarking, and ethical considerations.
cultural awareness large language models cross-cultural datasets cultural inclusion benchmarking Human-Computer Interaction social science research