---
title: "Defining Cultural Capabilities for AI Evaluation: A Taxonomy"
description: "The authors call this a construct-validity problem: when such scores are read as broad cultural skill, they can inflate how ready… 68 references."
authors: ["Isar Nejadgholi", "Masoud Kianpour", "Krishnapriya Vishnubhotla", "Maryam Molamohammadi"]
year: 2026
venue: "Proceedings of the Workshop on Evaluating Evaluations (EvalEval)"
source: "https://aclanthology.org/2026.evaleval-1.26/"
doi: "10.18653/v1/2026.evaleval-1.26"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/nejadgholi-2026-defining-cultural-capabilities-ai-evaluation/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/nejadgholi-2026-defining-cultural-capabilities-ai-evaluation/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/27/) / Defining Cultural Capabilities for AI Evaluation: A Taxonomy Grounded in Intercultural Communication Theory

# Defining Cultural Capabilities for AI Evaluation: A Taxonomy Grounded in Intercultural Communication Theory

**Authors:** Isar Nejadgholi, Masoud Kianpour, [Krishnapriya Vishnubhotla](https://md.research.elamur.ai/free/en/authors/krishnapriya-vishnubhotla/) and Maryam Molamohammadi · **Year:** 2026 · **Venue:** [Proceedings of the Workshop on Evaluating Evaluations (EvalEval)](https://md.research.elamur.ai/free/en/venues/evaleval/) ([EvalEval 2026](https://md.research.elamur.ai/free/en/venues/evaleval/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.evaleval-1.26/) · [PDF](https://aclanthology.org/2026.evaleval-1.26.pdf) · [DOI 10.18653/v1/2026.evaleval-1.26](https://doi.org/10.18653/v1/2026.evaleval-1.26) · [OpenAlex](https://openalex.org/W7166838454)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Research on the cultural abilities of AI systems often uses the labels "awareness," "sensitivity," and "competence" loosely, sometimes interchangeably. As a result, many benchmarks mostly test whether a model can recall facts about cultures. The authors call this a construct-validity problem: when such scores are read as broad cultural skill, they can inflate how ready a model appears for deployment.

Following Wallach et al.'s argument that a construct must be systematized before it can be measured, the paper turns to Intercultural Communication (ICC) theory. It examines three established ICC models and drops the traits that only apply to humans, such as motivation and affect. From what remains, it builds a three-tier taxonomy defined by observable model behavior:
- **Awareness:** accurate cultural knowledge.
- **Sensitivity:** respectful, non-ethnocentric framing within a single response.
- **Competence:** adjusting over several turns as new cultural cues appear.

The paper then places existing benchmarks on these tiers and finds that most target only the first. It also suggests how to design evaluations for the higher tiers. The contribution is conceptual rather than empirical, offering a scaffold for designing evaluations and interpreting their results.

## Key points
- The taxonomy rests on three ICC models: DMIS, CQ (cultural intelligence), and PMIC. Only their behavioral and interactional dimensions are kept.
- A running example is a Japanese user who wants to apologize to a senior colleague. It shows how factual grounding, respectful framing, and multi-turn adjustment differ.
- Knowledge-oriented benchmarks reviewed include FORK, CULTURALBENCH, BLEnD (16 regions, 13 languages), GeoMLAMA, INCLUDE (44 languages), and JMMMU. MC-SIGNS and SHADES address inappropriate signals and stereotypes.
- Only a few works approach competence in the authors' sense: NormGenesis, SocialCC, Nunchi-Bench, and the framework of Havaldar et al. (2025).
- Stated limitations:
  - The ICC models take an "outsider" (expatriate or workplace) view of culture.
  - The tiers overlap rather than forming strict categories.
  - Metacognitive behavior, such as asking for missing cultural context, remains understudied.
  - Low-resource languages require participatory, community-based evaluation.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [National Research Council Canada](https://md.research.elamur.ai/free/en/government/national-research-council-canada/) — Government body, Ottawa, Canada · 59 works · 21,677 citations

Also on the byline: [Toronto Metropolitan University](https://ror.org/05g13zd79).

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🤝 Social Sciences](https://md.research.elamur.ai/free/en/shelves/social-sciences/) · 1,772 works · [🤝 Safety Research](https://md.research.elamur.ai/free/en/shelves/social-sciences/safety-research/) · 543 works · [💼 Business, Management and Accounting](https://md.research.elamur.ai/free/en/shelves/business-management-and-accounting/) · 32 works · [💼 Organizational Behavior and Human Resource Management](https://md.research.elamur.ai/free/en/shelves/business-management-and-accounting/organizational-behavior-and-human-resource-management/) · 12 works

🧭 Topics (1): [📏 Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · 1,220 works

## Cite

Cite as: Isar Nejadgholi, Masoud Kianpour, Krishnapriya Vishnubhotla and Maryam Molamohammadi. 2026. Defining Cultural Capabilities for AI Evaluation: A Taxonomy Grounded in Intercultural Communication Theory. Proceedings of the Workshop on Evaluating Evaluations (EvalEval).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{nejadgholi2026defining,
  title = {{Defining Cultural Capabilities for AI Evaluation: A Taxonomy Grounded in Intercultural Communication Theory}},
  author = {Isar Nejadgholi, Masoud Kianpour, Krishnapriya Vishnubhotla and Maryam Molamohammadi},
  booktitle = {Proceedings of the Workshop on Evaluating Evaluations (EvalEval)},
  year = {2026},
  doi = {10.18653/v1/2026.evaleval-1.26},
  url = {https://doi.org/10.18653/v1/2026.evaleval-1.26}
}
```

- [← previous Defense Against Knowledge Poisoning Attack on GraphRAG](https://md.research.elamur.ai/free/en/papers/noughabi-2026-defense-against-knowledge-poisoning-attack/)
- [next → DEFT: Demystifying VLN Failures via a Unified Dual-View Explainability Framework for LLM-based Agents](https://md.research.elamur.ai/free/en/papers/wang-2026-deft-demystifying-vln-failures-unified/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/27/)

## References

68 references, 12 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Marwa Abdulhai, Gregory Serapio-Garcia, Clément Crepy, Daria Valter, John Canny, and Natasha Jaques. 2024. [Moral foundations of large language models](https://md.research.elamur.ai/free/en/papers/abdulhai-2024-moral-foundations-large-language-models/). In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 17737–17752.
2. Kaori Abe, Changqin Quan, Sheng Cao, and Zhiwei Luo. 2025. Classification of properties in human-like dialogue systems using generative ai to adapt to individual preferences. Applied Sciences, 15(7):3466. [find](https://scholar.google.com/scholar?q=Kaori+Abe%2C+Changqin+Quan%2C+Sheng+Cao%2C+and+Zhiwei+Luo%2E+2025%2E+Classification+of+properties+in+human%2Dlike+dialogue+systems+using+generative+ai+to+adapt+to+individual+preferences%2E+Applied+Sciences%2C+15%287%29%3A3)
3. Muhammad Farid Adilazuarda, Sagnik Mukherjee, Pradhyumna Lavania, Siddhant Shivdutt Singh, Alham Fikri Aji, Jacki O’Neill, Ashutosh Modi, and Monojit Choudhury. 2024. [Towards measuring and modeling “culture” in LLMs: A survey](https://md.research.elamur.ai/free/en/papers/adilazuarda-2024-measuring-modeling-culture-llms-survey/). In Proceedings of the 2024 Conference on Empirical Methods in Natural Lan…
4. Ilan Alon and James M Higgins. 2005. Global leadership success through emotional and cultural intelligences. Business horizons, 48(6):501–512. [find](https://scholar.google.com/scholar?q=Ilan+Alon+and+James+M+Higgins%2E+2005%2E+Global+leadership+success+through+emotional+and+cultural+intelligences%2E+Business+horizons%2C+48%286%29%3A501%E2%80%93512%2E)
5. Soon Ang and Linn Van Dyne. 2015. Handbook of cultural intelligence: Theory, measurement, and applications. Routledge. [find](https://scholar.google.com/scholar?q=Soon+Ang+and+Linn+Van+Dyne%2E+2015%2E+Handbook+of+cultural+intelligence%3A+Theory%2C+measurement%2C+and+applications%2E+Routledge%2E)
6. Soon Ang, Linn Van Dyne, Christine Koh, K Yee Ng, Klaus J Templer, Cheryl Tay, and N Anand Chandrasekar. 2007. Cultural intelligence: Its measurement and effects on cultural judgment and decision making, cultural adaptation and task performance. Management and organization review, 3(3):335–371. [find](https://scholar.google.com/scholar?q=Soon+Ang%2C+Linn+Van+Dyne%2C+Christine+Koh%2C+K+Yee+Ng%2C+Klaus+J+Templer%2C+Cheryl+Tay%2C+and+N+Anand+Chandrasekar%2E+2007%2E+Cultural+intelligence%3A+Its+measurement+and+effects+on+cultural+judgment+and+decision+maki)
7. Lily A Arasaratnam and Marya L Doerfel. 2005. Intercultural communication competence: Identifying key components from multicultural perspectives. International journal of intercultural relations, 29(2):137– 163. [find](https://scholar.google.com/scholar?q=Lily+A+Arasaratnam+and+Marya+L+Doerfel%2E+2005%2E+Intercultural+communication+competence%3A+Identifying+key+components+from+multicultural+perspectives%2E+International+journal+of+intercultural+relations%2C+29%282)
8. Lily A Arasaratnam-Smith. 2017. Intercultural competence: An overview. Intercultural competence in higher education, pages 7–18. [find](https://scholar.google.com/scholar?q=Lily+A+Arasaratnam%2DSmith%2E+2017%2E+Intercultural+competence%3A+An+overview%2E+Intercultural+competence+in+higher+education%2C+pages+7%E2%80%9318%2E)
9. Association of American Colleges and Universities (AAC&U). 2025. Inquiry and analysis value rubric. [https://www.aacu.org/value/rubrics/value](https://www.aacu.org/value/rubrics/value) -rubrics-inquiry-and-analysis. Accessed: 2025-12-09. [↗](https://www.aacu.org/value/rubrics/value)
10. Milton J Bennett. 1986. A developmental approach to training for intercultural sensitivity. International journal of intercultural relations, 10(2):179–196. [find](https://scholar.google.com/scholar?q=Milton+J+Bennett%2E+1986%2E+A+developmental+approach+to+training+for+intercultural+sensitivity%2E+International+journal+of+intercultural+relations%2C+10%282%29%3A179%E2%80%93196%2E)
11. Milton J Bennett. 1993. Towards ethnorelativism: A developmental model of intercultural sensitivity. Education for the intercultural experience, 2:21–71. [find](https://scholar.google.com/scholar?q=Milton+J+Bennett%2E+1993%2E+Towards+ethnorelativism%3A+A+developmental+model+of+intercultural+sensitivity%2E+Education+for+the+intercultural+experience%2C+2%3A21%E2%80%9371%2E)
12. J Stewart Black, Mark Mendenhall, and Gary Oddou. 1991. Toward a comprehensive model of international adjustment: An integration of multiple theoretical perspectives. Academy of management review, 16(2):291–317. [find](https://scholar.google.com/scholar?q=J+Stewart+Black%2C+Mark+Mendenhall%2C+and+Gary+Oddou%2E+1991%2E+Toward+a+comprehensive+model+of+international+adjustment%3A+An+integration+of+multiple+theoretical+perspectives%2E+Academy+of+management+review%2C+16%28)
13. Joretha N Bourjolly, Roberta G Sands, Phyllis Solomon, Victoria Stanhope, Anita Pernell-Arnold, and Laurene Finley. 2005. The journey toward intercultural sensitivity: A non-linear process. Journal of Ethnic & Cultural Diversity in Social Work, 14(3-4):41–62. [find](https://scholar.google.com/scholar?q=Joretha+N+Bourjolly%2C+Roberta+G+Sands%2C+Phyllis+Solomon%2C+Victoria+Stanhope%2C+Anita+Pernell%2DArnold%2C+and+Laurene+Finley%2E+2005%2E+The+journey+toward+intercultural+sensitivity%3A+A+non%2Dlinear+process%2E+Journal+of)
14. Dominic Busch. 2024. Ai translation and intercultural communication: New questions for a new field of research. SocArXiv 31p. [find](https://scholar.google.com/scholar?q=Dominic+Busch%2E+2024%2E+Ai+translation+and+intercultural+communication%3A+New+questions+for+a+new+field+of+research%2E+SocArXiv+31p%2E)
15. Michael Byram. 2020. Teaching and assessing intercultural communicative competence: Revisited. Multilingual matters. [find](https://scholar.google.com/scholar?q=Michael+Byram%2E+2020%2E+Teaching+and+assessing+intercultural+communicative+competence%3A+Revisited%2E+Multilingual+matters%2E)
16. Yu Ying Chiu, Liwei Jiang, Bill Yuchen Lin, Chan Young Park, Shuyue Stella Li, Sahithya Ravi, Mehar Bhatia, Maria Antoniak, Yulia Tsvetkov, Vered Shwartz, and Yejin Choi. 2025. Culturalbench: A robust, diverse, and challenging cultural benchmark by human-ai culturalteaming. Preprint, arXiv:2410.0267… — [arXiv:2410.02677](https://arxiv.org/abs/2410.02677) [find](https://scholar.google.com/scholar?q=Yu+Ying+Chiu%2C+Liwei+Jiang%2C+Bill+Yuchen+Lin%2C+Chan+Young+Park%2C+Shuyue+Stella+Li%2C+Sahithya+Ravi%2C+Mehar+Bhatia%2C+Maria+Antoniak%2C+Yulia+Tsvetkov%2C+Vered+Shwartz%2C+and+Yejin+Choi%2E+2025%2E+Culturalbench%3A+A+robust)
17. Bovornpot Choompunuch, Khanika Kamdee, and Prakit-tiya Taksino. 2024. Exploring the components of multicultural competence among pre-service teacher students in thailand: an approach utilizing confirmatory factor analysis. European Journal of Investigation in Health, Psychology and Education, 14(9):… [find](https://scholar.google.com/scholar?q=Bovornpot+Choompunuch%2C+Khanika+Kamdee%2C+and+Prakit%2Dtiya+Taksino%2E+2024%2E+Exploring+the+components+of+multicultural+competence+among+pre%2Dservice+teacher+students+in+thailand%3A+an+approach+utilizing+confirm)
18. Darla K Deardorff. 2006. Identification and assessment of intercultural competence as a student outcome of internationalization. Journal of studies in international education, 10(3):241–266. [find](https://scholar.google.com/scholar?q=Darla+K+Deardorff%2E+2006%2E+Identification+and+assessment+of+intercultural+competence+as+a+student+outcome+of+internationalization%2E+Journal+of+studies+in+international+education%2C+10%283%29%3A241%E2%80%93266%2E)
19. Darla K Deardorff. 2009a. The SAGE handbook of intercultural competence. Sage Publications. [find](https://scholar.google.com/scholar?q=Darla+K+Deardorff%2E+2009a%2E+The+SAGE+handbook+of+intercultural+competence%2E+Sage+Publications%2E)
20. Darla K. Deardorff. 2009b. Synthesizing conceptualizations of intercultural competence: A summary and emerging themes. In Darla K. Deardorff, editor, The SAGE Handbook of Intercultural Competence, pages 264–270. SAGE Publications, Thousand Oaks, CA. [find](https://scholar.google.com/scholar?q=Darla+K%2E+Deardorff%2E+2009b%2E+Synthesizing+conceptualizations+of+intercultural+competence%3A+A+summary+and+emerging+themes%2E+In+Darla+K%2E+Deardorff%2C+editor%2C+The+SAGE+Handbook+of+Intercultural+Competence%2C+pag)
21. Joan G DeJaeghere and Yi Cao. 2009. Developing us teachers’ intercultural competence: Does professional development matter? International Journal of Intercultural Relations, 33(5):437–447. [find](https://scholar.google.com/scholar?q=Joan+G+DeJaeghere+and+Yi+Cao%2E+2009%2E+Developing+us+teachers%E2%80%99+intercultural+competence%3A+Does+professional+development+matter%3F+International+Journal+of+Intercultural+Relations%2C+33%285%29%3A437%E2%80%93447%2E)
22. P. Christopher Earley and Soon Ang. 2003. Cultural Intelligence: Individual Interactions Across Cultures. Stanford University Press, Stanford, CA. [find](https://scholar.google.com/scholar?q=P%2E+Christopher+Earley+and+Soon+Ang%2E+2003%2E+Cultural+Intelligence%3A+Individual+Interactions+Across+Cultures%2E+Stanford+University+Press%2C+Stanford%2C+CA%2E)
23. Anjalie Field, Su Lin Blodgett, Zeerak Talat, and Yulia Tsvetkov. 2021. A survey of race, racism, and anti-racism in nlp. In Proceedings of the 59th annual meeting of the association for computational linguistics and the 11th international joint conference on natural language processing (Volume 1: l… [find](https://scholar.google.com/scholar?q=Anjalie+Field%2C+Su+Lin+Blodgett%2C+Zeerak+Talat%2C+and+Yulia+Tsvetkov%2E+2021%2E+A+survey+of+race%2C+racism%2C+and+anti%2Dracism+in+nlp%2E+In+Proceedings+of+the+59th+annual+meeting+of+the+association+for+computational)
24. Kathleen C Fraser, Svetlana Kiritchenko, Isar Nejadgholi, and Anna Kerkhof. 2023. What makes a good counter-stereotype? evaluating strategies for automated responses to stereotypical text. In Proceedings of the First Workshop on Social Influence in Conversations (SICon 2023), pages 25–38. [find](https://scholar.google.com/scholar?q=Kathleen+C+Fraser%2C+Svetlana+Kiritchenko%2C+Isar+Nejadgholi%2C+and+Anna+Kerkhof%2E+2023%2E+What+makes+a+good+counter%2Dstereotype%3F+evaluating+strategies+for+automated+responses+to+stereotypical+text%2E+In+Proceedi)
25. Kathleen C. Fraser, Isar Nejadgholi, and Svetlana Kiritchenko. 2021. Understanding and countering stereotypes: A computational approach to the stereotype content model. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Confere… [find](https://scholar.google.com/scholar?q=Kathleen+C%2E+Fraser%2C+Isar+Nejadgholi%2C+and+Svetlana+Kiritchenko%2E+2021%2E+Understanding+and+countering+stereotypes%3A+A+computational+approach+to+the+stereotype+content+model%2E+In+Proceedings+of+the+59th+Annu)
26. Caterina Gozzoli and Diletta Gazzaroli. 2018. The cultural intelligence scale (cqs): A contribution to the italian validation. Frontiers in psychology, 9:1183. [find](https://scholar.google.com/scholar?q=Caterina+Gozzoli+and+Diletta+Gazzaroli%2E+2018%2E+The+cultural+intelligence+scale+%28cqs%29%3A+A+contribution+to+the+italian+validation%2E+Frontiers+in+psychology%2C+9%3A1183%2E)
27. Rongchen Guo, Isar Nejadgholi, Hillary Dawkins, Kathleen C Fraser, and Svetlana Kiritchenko. 2024. Adaptable moral stances of large language models on sexist content: Implications for society and gender discourse. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Process… [find](https://scholar.google.com/scholar?q=Rongchen+Guo%2C+Isar+Nejadgholi%2C+Hillary+Dawkins%2C+Kathleen+C+Fraser%2C+and+Svetlana+Kiritchenko%2E+2024%2E+Adaptable+moral+stances+of+large+language+models+on+sexist+content%3A+Implications+for+society+and+gend)
28. Shreya Havaldar, Young Min Cho, Sunny Rai, and Lyle Ungar. 2025. Culturally-aware conversations: A framework & benchmark for LLMs. In [Proceedings of the Fourth Workshop on Bridging Human-Computer Interaction and Natural Language Processing (HCI+NLP)](https://md.research.elamur.ai/free/en/papers/blodgett-2025-proceedings-fourth-workshop-bridging-human/), pages 220–229, Suzhou, China. Association for Com…
29. Daniel Hershcovich, Stella Frank, Heather Lent, Miryam de Lhoneux, Mostafa Abdou, Stephanie Brandl, Emanuele Bugliarello, Laura Cabello Piqueras, Ilias Chalkidis, Ruixiang Cui, Constanza Fierro, Katerina Margatina, Phillip Rust, and Anders Søgaard. 2022. [Challenges and strategies in cross-cultural N…](https://md.research.elamur.ai/free/en/papers/hershcovich-2022-challenges-strategies-cross-cultural-nlp/)
30. Jess Hohenstein, Rene F Kizilcec, Dominic DiFranzo, Zhila Aghajari, Hannah Mieczkowski, Karen Levy, Mor Naaman, Jeffrey Hancock, and Malte F Jung. 2023. Artificial intelligence in communication impacts language and social relationships. Scientific reports, 13(1):5487. [find](https://scholar.google.com/scholar?q=Jess+Hohenstein%2C+Rene+F+Kizilcec%2C+Dominic+DiFranzo%2C+Zhila+Aghajari%2C+Hannah+Mieczkowski%2C+Karen+Levy%2C+Mor+Naaman%2C+Jeffrey+Hancock%2C+and+Malte+F+Jung%2E+2023%2E+Artificial+intelligence+in+communication+impact)
31. Minki Hong, Jangho Choi, and Jihie Kim. 2025. NormGenesis: Multicultural dialogue generation via exemplar-guided social norm modeling and violation recovery. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 33781–33819, Suzhou, China. Association for C… [find](https://scholar.google.com/scholar?q=Minki+Hong%2C+Jangho+Choi%2C+and+Jihie+Kim%2E+2025%2E+NormGenesis%3A+Multicultural+dialogue+generation+via+exemplar%2Dguided+social+norm+modeling+and+violation+recovery%2E+In+Proceedings+of+the+2025+Conference+on+E)
32. Towards a multilingual assessment of stereotypes in large language models. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 11995–12041, Albuquerque, New Mexico. A… [find](https://scholar.google.com/scholar?q=Towards+a+multilingual+assessment+of+stereotypes+in+large+language+models%2E+In+Proceedings+of+the+2025+Conference+of+the+Nations+of+the+Americas+Chapter+of+the+Association+for+Computational+Linguistics)
33. Junho Myung, Nayeon Lee, Yi Zhou, Jiho Jin, Rifki Afina Putri, Dimosthenis Antypas, Hsuvas Borkakoty, Eunsu Kim, Carla Perez-Almendros, Abinew Ali Ayele, Víctor Gutiérrez-Basulto, Yazmín Ibáñez García, Hwaran Lee, Shamsuddeen Hassan Muhammad, Kiwoong Park, Anar Sabuhi Rzayev, Nina White, Seid Muhie… — [BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languages](https://md.research.elamur.ai/free/en/papers/myung-2024-blend-benchmark-llms-everyday-knowledge/)
34. Simon Kaggwa, Tobechukwu Francisa Eleogu, Fran-ciscamary Okonkwo, Oluwatoyin Ajoke Farayola, Prisca Ugomma Uwaoma, and Abiodun Akinoso. 2024. Ai in decision making: transforming business strategies. International Journal of Research and Scientific Innovation, 10(12):423–444. [find](https://scholar.google.com/scholar?q=Simon+Kaggwa%2C+Tobechukwu+Francisa+Eleogu%2C+Fran%2Dciscamary+Okonkwo%2C+Oluwatoyin+Ajoke+Farayola%2C+Prisca+Ugomma+Uwaoma%2C+and+Abiodun+Akinoso%2E+2024%2E+Ai+in+decision+making%3A+transforming+business+strategies%2E+I)
35. Tarek Naous and Wei Xu. 2025. [On the origin of cultural biases in language models: From pre-training data to linguistic phenomena](https://md.research.elamur.ai/free/en/papers/naous-2025-origin-cultural-biases-language-models/). In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Lon…
36. Kyuhee Kim and Sangah Lee. 2025. Nunchi-bench: Benchmarking language models on cultural reasoning with a focus on Korean superstition. In Findings of the Association for Computational Linguistics: ACL 2025, pages 15328–15342, Vienna, Austria. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Kyuhee+Kim+and+Sangah+Lee%2E+2025%2E+Nunchi%2Dbench%3A+Benchmarking+language+models+on+cultural+reasoning+with+a+focus+on+Korean+superstition%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+ACL)
37. Palanichamy Naveen and Pavel Trojovský. 2024. Overview and challenges of machine translation for contextually appropriate translations. Iscience, 27(10). [find](https://scholar.google.com/scholar?q=Palanichamy+Naveen+and+Pavel+Trojovsk%C3%BD%2E+2024%2E+Overview+and+challenges+of+machine+translation+for+contextually+appropriate+translations%2E+Iscience%2C+27%2810%29%2E)
38. David A Kolb. 2014. Experiential learning: Experience as the source of learning and development. FT press. [find](https://scholar.google.com/scholar?q=David+A+Kolb%2E+2014%2E+Experiential+learning%3A+Experience+as+the+source+of+learning+and+development%2E+FT+press%2E)
39. Dilek Küçük and Fazli Can. 2020. Stance detection: A survey. ACM Computing Surveys (CSUR), 53(1):1– 37. [find](https://scholar.google.com/scholar?q=Dilek+K%C3%BC%C3%A7%C3%BCk+and+Fazli+Can%2E+2020%2E+Stance+detection%3A+A+survey%2E+ACM+Computing+Surveys+%28CSUR%29%2C+53%281%29%3A1%E2%80%93+37%2E)
40. Jakob Lauring. 2011. Intercultural organizational communication: The social organizing of interaction in international encounters. The Journal of Business Communication (1973), 48(3):231–255. [find](https://scholar.google.com/scholar?q=Jakob+Lauring%2E+2011%2E+Intercultural+organizational+communication%3A+The+social+organizing+of+interaction+in+international+encounters%2E+The+Journal+of+Business+Communication+%281973%29%2C+48%283%29%3A231%E2%80%93255%2E)
41. Chen Cecilia Liu, Iryna Gurevych, and Anna Korhonen. 2025. [Culturally aware and adapted NLP: A taxonomy and a survey of the state of the art](https://md.research.elamur.ai/free/en/papers/liu-2025-culturally-aware-adapted-nlp-taxonomy/). Transactions of the Association for Computational Linguistics, 13:652–689.
42. Mark Mendenhall, MICHAEL J Stevens, Allan Bird, Gary Oddou, and Joyce Osland. 2008. Specification of the content domain of the intercultural effectiveness scale. The Kozai monograph series, 1(2):1–22. [find](https://scholar.google.com/scholar?q=Mark+Mendenhall%2C+MICHAEL+J+Stevens%2C+Allan+Bird%2C+Gary+Oddou%2C+and+Joyce+Osland%2E+2008%2E+Specification+of+the+content+domain+of+the+intercultural+effectiveness+scale%2E+The+Kozai+monograph+series%2C+1%282%29%3A1%E2%80%9322%2E)
43. Margaret Mitchell, Giuseppe Attanasio, Ioana Baldini, Miruna Clinciu, Jordan Clive, Pieter Delobelle, Manan Dey, Sil Hamilton, Timm Dill, Jad Doughman, Ritam Dutt, Avijit Ghosh, Jessica Zosa Forde, Carolin Holtermann, Lucie-Aimée Kaffee, Tanmay Laud, Anne Lauscher, Roberto L Lopez-Davila, Maraim Mas… [find](https://scholar.google.com/scholar?q=Margaret+Mitchell%2C+Giuseppe+Attanasio%2C+Ioana+Baldini%2C+Miruna+Clinciu%2C+Jordan+Clive%2C+Pieter+Delobelle%2C+Manan+Dey%2C+Sil+Hamilton%2C+Timm+Dill%2C+Jad+Doughman%2C+Ritam+Dutt%2C+Avijit+Ghosh%2C+Jessica+Zosa+Forde%2C+Ca)
44. SHADES: Isar Nejadgholi, Kathleen C Fraser, Anna Kerkhof, and Svetlana Kiritchenko. 2024. Challenging negative gender stereotypes: A study on the effectiveness of automated counter-stereotypes. arXiv preprint arXiv:2404.11845. [find](https://scholar.google.com/scholar?q=SHADES%3A+Isar+Nejadgholi%2C+Kathleen+C+Fraser%2C+Anna+Kerkhof%2C+and+Svetlana+Kiritchenko%2E+2024%2E+Challenging+negative+gender+stereotypes%3A+A+study+on+the+effectiveness+of+automated+counter%2Dstereotypes%2E+arXiv+)
45. Shota Onohara, Atsuyuki Miyai, Yuki Imajuku, Kazuki Egashira, Jeonghun Baek, Xiang Yue, Graham Neubig, and Kiyoharu Aizawa. 2025. JMMMU: A Japanese massive multi-discipline multimodal understanding benchmark for culture-aware evaluation. In Proceedings of the 2025 Conference of the Nations of the Am… [find](https://scholar.google.com/scholar?q=Shota+Onohara%2C+Atsuyuki+Miyai%2C+Yuki+Imajuku%2C+Kazuki+Egashira%2C+Jeonghun+Baek%2C+Xiang+Yue%2C+Graham+Neubig%2C+and+Kiyoharu+Aizawa%2E+2025%2E+JMMMU%3A+A+Japanese+massive+multi%2Ddiscipline+multimodal+understanding+be)
46. Shramay Palta and Rachel Rudinger. 2023. [Fork: A bite-sized test set for probing culinary cultural biases in commonsense reasoning models](https://md.research.elamur.ai/free/en/papers/palta-2023-fork-bite-sized-test-set/). In Findings of the Association for Computational Linguistics: ACL 2023, pages 9952–9962.
47. Siddhesh Pawar, Junyeong Park, Jiho Jin, Arnav Arora, Junho Myung, Srishti Yadav, Faiz Ghifari Haznitrama, Inhwa Song, Alice Oh, and Isabelle Augenstein. 2025. [Survey of cultural awareness in language models: Text and beyond](https://md.research.elamur.ai/free/en/papers/pawar-2025-survey-cultural-awareness-language-models/). Computational Linguistics, pages 1–96.
48. Paula J Pedersen. 2010. Assessing intercultural effectiveness outcomes in a year-long study abroad program. International Journal of intercultural relations, 34(1):70–80. [find](https://scholar.google.com/scholar?q=Paula+J+Pedersen%2E+2010%2E+Assessing+intercultural+effectiveness+outcomes+in+a+year%2Dlong+study+abroad+program%2E+International+Journal+of+intercultural+relations%2C+34%281%29%3A70%E2%80%9380%2E)
49. Betina Szkudlarek, Joyce S Osland, Luciara Nardon, and Lena Zander. 2020. Communication and culture in international business–moving the field forward. Journal of World Business, 55(6):101126. [find](https://scholar.google.com/scholar?q=Betina+Szkudlarek%2C+Joyce+S+Osland%2C+Luciara+Nardon%2C+and+Lena+Zander%2E+2020%2E+Communication+and+culture+in+international+business%E2%80%93moving+the+field+forward%2E+Journal+of+World+Business%2C+55%286%29%3A101126%2E)
50. Guanxiong Pei, Haiying Li, Yandi Lu, Yanlei Wang, Shizhen Hua, and Taihao Li. 2024. Affective computing: Recent advances, challenges, and future trends. Intelligent Computing, 3:0076. [find](https://scholar.google.com/scholar?q=Guanxiong+Pei%2C+Haiying+Li%2C+Yandi+Lu%2C+Yanlei+Wang%2C+Shizhen+Hua%2C+and+Taihao+Li%2E+2024%2E+Affective+computing%3A+Recent+advances%2C+challenges%2C+and+future+trends%2E+Intelligent+Computing%2C+3%3A0076%2E)
51. UNESCO. 2025. Terms of reference: Unesco whatsapp chatbots (bot development and ai integration). [https://www.unesco.org/en/articles/terms-r](https://www.unesco.org/en/articles/terms-r) eference-unesco-whatsapp-chatbots-bot-d evelopment-and-ai-integration. Accessed: 2026-01-09. [↗](https://www.unesco.org/en/articles/terms-r)
52. Haoyi Qiu, Alexander Fabbri, Divyansh Agarwal, Kung-Hsiang Huang, Sarah Tan, Nanyun Peng, and Chien-Sheng Wu. 2025. Evaluating cultural and social awareness of LLM web agents. In Findings of the Association for Computational Linguistics: NAACL 2025, pages 3978–4005, Albuquerque, New Mexico. Associat… [find](https://scholar.google.com/scholar?q=Haoyi+Qiu%2C+Alexander+Fabbri%2C+Divyansh+Agarwal%2C+Kung%2DHsiang+Huang%2C+Sarah+Tan%2C+Nanyun+Peng%2C+and+Chien%2DSheng+Wu%2E+2025%2E+Evaluating+cultural+and+social+awareness+of+LLM+web+agents%2E+In+Findings+of+the+Assoc)
53. Subramaniam Sri Ramalu, Raduan Che Rose, Jegak Uli, and Naresh Kumar. 2012. Cultural intelligence and expatriate performance in global assignment: The mediating role of adjustment. International Journal of Business and Society, 13(1):19. [find](https://scholar.google.com/scholar?q=Subramaniam+Sri+Ramalu%2C+Raduan+Che+Rose%2C+Jegak+Uli%2C+and+Naresh+Kumar%2E+2012%2E+Cultural+intelligence+and+expatriate+performance+in+global+assignment%3A+The+mediating+role+of+adjustment%2E+International+Journ)
54. Linn Van Dyne, Soon Ang, and Christine Koh. 2015. Development and validation of the cqs: The cultural intelligence scale. In Handbook of cultural intelligence, pages 34–56. Routledge. [find](https://scholar.google.com/scholar?q=Linn+Van+Dyne%2C+Soon+Ang%2C+and+Christine+Koh%2E+2015%2E+Development+and+validation+of+the+cqs%3A+The+cultural+intelligence+scale%2E+In+Handbook+of+cultural+intelligence%2C+pages+34%E2%80%9356%2E+Routledge%2E)
55. Hanna Wallach, Meera Desai, Nicholas Pangakis, A Feder Cooper, Angelina Wang, Solon Barocas, Alexandra Chouldechova, Chad Atalla, Su Lin Blodgett, Emily Corvi, and 1 others. 2024. Evaluating generative ai systems is a social science measurement challenge. arXiv preprint arXiv:2411.10939. — [arXiv:2411.10939](https://arxiv.org/abs/2411.10939) [find](https://scholar.google.com/scholar?q=Hanna+Wallach%2C+Meera+Desai%2C+Nicholas+Pangakis%2C+A+Feder+Cooper%2C+Angelina+Wang%2C+Solon+Barocas%2C+Alexandra+Chouldechova%2C+Chad+Atalla%2C+Su+Lin+Blodgett%2C+Emily+Corvi%2C+and+1+others%2E+2024%2E+Evaluating+generativ)
56. Claire A Richards and Ardith Z Doorenbos. 2016. Intercultural competency development of health professions students during study abroad in india. Journal of nursing education and practice, 6(12):89. [find](https://scholar.google.com/scholar?q=Claire+A+Richards+and+Ardith+Z+Doorenbos%2E+2016%2E+Intercultural+competency+development+of+health+professions+students+during+study+abroad+in+india%2E+Journal+of+nursing+education+and+practice%2C+6%2812%29%3A89%2E)
57. Martin Warren and William WL Lee. 2020. Intercultural communication in professional and workplace settings. In The Routledge handbook of language and intercultural communication, pages 473–486. Routledge. [find](https://scholar.google.com/scholar?q=Martin+Warren+and+William+WL+Lee%2E+2020%2E+Intercultural+communication+in+professional+and+workplace+settings%2E+In+The+Routledge+handbook+of+language+and+intercultural+communication%2C+pages+473%E2%80%93486%2E+Routle)
58. Nicole Franziska Richter, Christopher Schlaegel, Vasyl Taras, Ilan Alon, and Allan Bird. 2023. Reviewing half a century of measuring cross-cultural competence: Aligning theoretical constructs and empirical measures. International Business Review, 32(4):102122. [find](https://scholar.google.com/scholar?q=Nicole+Franziska+Richter%2C+Christopher+Schlaegel%2C+Vasyl+Taras%2C+Ilan+Alon%2C+and+Allan+Bird%2E+2023%2E+Reviewing+half+a+century+of+measuring+cross%2Dcultural+competence%3A+Aligning+theoretical+constructs+and+empi)
59. Jincenzi Wu, Jianxun Lian, Dingdong Wang, and Helen M. Meng. 2025. SocialCC: Interactive evaluation for cultural competence in language agents. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 33242–33271, Vienna, Austria. Asso… [find](https://scholar.google.com/scholar?q=Jincenzi+Wu%2C+Jianxun+Lian%2C+Dingdong+Wang%2C+and+Helen+M%2E+Meng%2E+2025%2E+SocialCC%3A+Interactive+evaluation+for+cultural+competence+in+language+agents%2E+In+Proceedings+of+the+63rd+Annual+Meeting+of+the+Associa)
60. Thomas Rockstuhl, Stefan Seiler, Soon Ang, Linn Van Dyne, and Hubert Annen. 2011. Beyond general intelligence (iq) and emotional intelligence (eq): The role of cultural intelligence (cq) on cross-border leadership effectiveness in a globalized world. Journal of Social Issues, 67(4):825–840. [find](https://scholar.google.com/scholar?q=Thomas+Rockstuhl%2C+Stefan+Seiler%2C+Soon+Ang%2C+Linn+Van+Dyne%2C+and+Hubert+Annen%2E+2011%2E+Beyond+general+intelligence+%28iq%29+and+emotional+intelligence+%28eq%29%3A+The+role+of+cultural+intelligence+%28cq%29+on+cross%2Dbord)
61. Shuang Yang, Huiwen Zhao, and Wen Luo. 2024. The impact of artificial intelligence on intercultural communication. In Belonging in Culturally Diverse Societies-Official Structures and Personal Customs. IntechOpen. [find](https://scholar.google.com/scholar?q=Shuang+Yang%2C+Huiwen+Zhao%2C+and+Wen+Luo%2E+2024%2E+The+impact+of+artificial+intelligence+on+intercultural+communication%2E+In+Belonging+in+Culturally+Diverse+Societies%2DOfficial+Structures+and+Personal+Customs)
62. Angelika Romanou, Negar Foroutan, Anna Sotnikova, Sree Harsha Nelaturu, Shivalika Singh, Rishabh Maheshwary, Micol Altomare, Zeming Chen, Mohamed A. Haggag, Snegha A, Alfonso Amayuelas, Azril Hafizi Amirudin, Danylo Boiko, Michael Chang, Jenny Chim, Gal Cohen, Aditya Kumar Dalmia, Abraham Diress, Sh… — [INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge](https://md.research.elamur.ai/free/en/papers/romanou-2024-include-evaluating-multilingual-language-understanding/)
63. Sougata Saha, Saurabh Kumar Pandey, and Monojit Choudhury. 2025. Meta-cultural competence: Climbing the right hill of cultural awareness. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume… [find](https://scholar.google.com/scholar?q=Sougata+Saha%2C+Saurabh+Kumar+Pandey%2C+and+Monojit+Choudhury%2E+2025%2E+Meta%2Dcultural+competence%3A+Climbing+the+right+hill+of+cultural+awareness%2E+In+Proceedings+of+the+2025+Conference+of+the+Nations+of+the+Am)
64. Binwei Yao, Ming Jiang, Tara Bobinac, Diyi Yang, and Junjie Hu. 2024. [Benchmarking machine translation with cultural awareness](https://md.research.elamur.ai/free/en/papers/yao-2023-benchmarking-machine-translation-cultural-awareness/). In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 13078–13096.
65. Akhila Yerukola, Saadia Gabriel, Nanyun Peng, and Maarten Sap. 2025. Mind the gesture: Evaluating AI sensitivity to culturally offensive non-verbal gestures. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 25041–25080, Vienna,… [find](https://scholar.google.com/scholar?q=Akhila+Yerukola%2C+Saadia+Gabriel%2C+Nanyun+Peng%2C+and+Maarten+Sap%2E+2025%2E+Mind+the+gesture%3A+Evaluating+AI+sensitivity+to+culturally+offensive+non%2Dverbal+gestures%2E+In+Proceedings+of+the+63rd+Annual+Meeting+)
66. Da Yin, Hritik Bansal, Masoud Monajatipoor, Liunian Harold Li, and Kai-Wei Chang. 2022. GeoM-LAMA: Geo-diverse commonsense probing on multilingual pre-trained language models. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 2039–2055, Abu Dhabi, Unite… [find](https://scholar.google.com/scholar?q=Da+Yin%2C+Hritik+Bansal%2C+Masoud+Monajatipoor%2C+Liunian+Harold+Li%2C+and+Kai%2DWei+Chang%2E+2022%2E+GeoM%2DLAMA%3A+Geo%2Ddiverse+commonsense+probing+on+multilingual+pre%2Dtrained+language+models%2E+In+Proceedings+of+the+20)
67. Yi Zheng, Björn Ross, and Walid Magdy. 2023. What makes good counterspeech? a comparison of generation approaches and evaluation metrics. In Proceedings of the 1st Workshop on CounterSpeech for Online Abuse (CS4OA), pages 62–71. [find](https://scholar.google.com/scholar?q=Yi+Zheng%2C+Bj%C3%B6rn+Ross%2C+and+Walid+Magdy%2E+2023%2E+What+makes+good+counterspeech%3F+a+comparison+of+generation+approaches+and+evaluation+metrics%2E+In+Proceedings+of+the+1st+Workshop+on+CounterSpeech+for+Online)
68. Naitian Zhou, David Bamman, and Isaac L. Bleaman. 2025. [Culture is not trivia: Sociocultural theory for cultural NLP](https://md.research.elamur.ai/free/en/papers/zhou-2025-culture-is-not-trivia-sociocultural/). In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 25869– 25886, Vienna, Austria. Association for Computational…

*Updated 1 November 2026*