---
title: "Cultural and Knowledge Biases in LLMs through the — Xu 2026"
description: "LLMs translate fluently, but they know far less about entities rooted in underrepresented cultures."
authors: ["Lu Xu", "Luca Moroni", "Roberto Navigli"]
year: 2026
venue: "Proceedings of the Fifteenth Language Resources and Evaluation Conference"
source: "https://aclanthology.org/2026.lrec-1.692/"
doi: "10.63317/3jxgnspt4srr"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/xu-2026-cultural-knowledge-biases-llms-through/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/xu-2026-cultural-knowledge-biases-llms-through/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/3/) / Cultural and Knowledge Biases in LLMs through the Lens of Entity-Aware Machine Translation

# Cultural and Knowledge Biases in LLMs through the Lens of Entity-Aware Machine Translation

**Authors:** [Lu Xu](https://md.research.elamur.ai/free/en/authors/lu-xu/), Luca Moroni, [Roberto Navigli](https://md.research.elamur.ai/free/en/authors/roberto-navigli/) · **Year:** 2026 · **Venue:** Proceedings of the Fifteenth Language Resources and Evaluation Conference · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.lrec-1.692/) · [PDF](https://aclanthology.org/2026.lrec-1.692.pdf) · [DOI 10.63317/3jxgnspt4srr](https://doi.org/10.63317/3jxgnspt4srr) · [OpenAlex](https://openalex.org/W7160108075)

**Citations:** 0 citations (openalex-snapshot · 2026-10-14)

## Summary
LLMs translate fluently, but they know far less about entities rooted in underrepresented cultures. Earlier cultural MT work also treated all "cultural" entities as one group. The authors study this gap through entity-aware machine translation (EA-MT) and propose a three-tier scale of cultural specificity:
- **Culturally Agnostic:** recognisable through direct lexical mapping.
- **Culturally Sensitive:** identifiable with general knowledge of both cultures.
- **Culturally Local:** requires insider knowledge.

On the XCTranslate benchmark (English into 10 languages), they test 11 closed, open-weight and open-data LLMs, with and without Wikidata entity information. That information is supplied either through the Relik linker or from gold annotations. Outputs are scored with m-ETA and COMET. Over 500 Traditional Chinese and Italian entities were manually labelled by level. Baseline accuracy falls as entities become more local, and external knowledge helps most for these entities (m-ETA gains up to 70%). Agnostic entities barely benefit. The study shows that cultural embeddedness should guide knowledge augmentation in MT. It also reveals that mismatches between Wikidata labels and benchmark references distort evaluation.

## Key points
- Experiments cover 11 LLMs and 10 languages from XCTranslate, translating from English only. Cultural-level annotation was done for Traditional Chinese and Italian.
- The released annotation resource contains 500+ entities. Inter-annotator agreement is κ = 0.81 (Chinese) and κ = 0.74 (Italian). The code and data are on GitHub as SapienzaNLP/cultural-ea-mt.
- Knowledge injection (Relik-based or gold) raises m-ETA by as much as 70% for Culturally Local entities. Smaller models depend on it more.
- Closed and open-weight models improve in both entity accuracy (m-ETA) and overall quality (COMET). Open-data models gain entity accuracy but lose COMET because they follow instructions poorly, for example by adding unrequested text.
- Error analysis with GPT-5-mini shows that Wikidata labels often diverge from XCTranslate gold mentions. Some gold labels are themselves wrong, which unfairly penalises correct outputs.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/)

Topics: [Machine translation](https://md.research.elamur.ai/free/en/topics/machine-translation/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{xu2026cultural,
  title = {{Cultural and Knowledge Biases in LLMs through the Lens of Entity-Aware Machine Translation}},
  author = {Xu, Lu and Moroni, Luca and Navigli, Roberto},
  booktitle = {Proceedings of the Fifteenth Language Resources and Evaluation Conference},
  year = {2026},
  doi = {10.63317/3jxgnspt4srr},
  url = {https://doi.org/10.63317/3jxgnspt4srr}
}
```

- [← previous CUHKSZ Simultaneous Speech Translation System for IWSLT 2026](https://md.research.elamur.ai/free/en/papers/yang-2026-cuhksz-simultaneous-speech-translation-system/)
- [next → Culturally-Aware Image Captioning for Guaraní with Multimodal Prompting: IUHoosiers at AmericasNLP 2026](https://md.research.elamur.ai/free/en/papers/shi-2026-culturally-aware-image-captioning-guarani/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/3/)

## References

38 references, 10 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Meltem Aksoy. 2025. Whose morality do they speak? unraveling cultural bias in multilingual language models. Natural Language Processing Journal, page 100172. [find](https://scholar.google.com/scholar?q=Meltem+Aksoy%2E+2025%2E+Whose+morality+do+they+speak%3F+unraveling+cultural+bias+in+multilingual+language+models%2E+Natural+Language+Processing+Journal%2C+page+100172%2E)
2. Tuka Alhanai, Adam Kasumovic, Mohammad M Ghassemi, Aven Zitzelberger, Jessica M Lundin, and Guillaume Chabot-Couture. 2025. Bridging the gap: enhancing llm performance for low-resource african languages with new benchmarks, fine-tuning, and cultural adjustments. In Proceedings of the AAAI Conference… [find](https://scholar.google.com/scholar?q=Tuka+Alhanai%2C+Adam+Kasumovic%2C+Mohammad+M+Ghassemi%2C+Aven+Zitzelberger%2C+Jessica+M+Lundin%2C+and+Guillaume+Chabot%2DCouture%2E+2025%2E+Bridging+the+gap%3A+enhancing+llm+performance+for+low%2Dresource+african+languag)
3. Sahar Araghi and Alfons Palangkaraya. 2024. The link between translation difficulty and the quality of machine translation: a literature review and empirical investigation. Language Resources and Evaluation, 58(4):1093–1114. [find](https://scholar.google.com/scholar?q=Sahar+Araghi+and+Alfons+Palangkaraya%2E+2024%2E+The+link+between+translation+difficulty+and+the+quality+of+machine+translation%3A+a+literature+review+and+empirical+investigation%2E+Language+Resources+and+Eval)
4. Arnav Arora, Lucie-Aimée Kaffee, and Isabelle Augenstein. 2023. Probing pre-trained language models for cross-cultural differences in values. Cross-Cultural Considerations in NLP@ EACL, page 114. [find](https://scholar.google.com/scholar?q=Arnav+Arora%2C+Lucie%2DAim%C3%A9e+Kaffee%2C+and+Isabelle+Augenstein%2E+2023%2E+Probing+pre%2Dtrained+language+models+for+cross%2Dcultural+differences+in+values%2E+Cross%2DCultural+Considerations+in+NLP%40+EACL%2C+page+114%2E) [our card](https://md.research.elamur.ai/free/en/papers/arora-2023-probing-pre-trained-language-models/)
5. Bojana Budimir. 2025. The challenge of translating culture-specific items: Evaluating MT and LLMs compared to human translators. In Proceedings of Machine Translation Summit XX: Volume 1, pages 455–467, Geneva, Switzerland. European Association for Machine Translation. [find](https://scholar.google.com/scholar?q=Bojana+Budimir%2E+2025%2E+The+challenge+of+translating+culture%2Dspecific+items%3A+Evaluating+MT+and+LLMs+compared+to+human+translators%2E+In+Proceedings+of+Machine+Translation+Summit+XX%3A+Volume+1%2C+pages+455%E2%80%9346)
6. Niccolò Campolungo, Federico Martelli, Francesco Saina, and Roberto Navigli. 2022. DiBiMT: A novel benchmark for measuring Word Sense Disambiguation biases in Machine Translation. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), page… [find](https://scholar.google.com/scholar?q=Niccol%C3%B2+Campolungo%2C+Federico+Martelli%2C+Francesco+Saina%2C+and+Roberto+Navigli%2E+2022%2E+DiBiMT%3A+A+novel+benchmark+for+measuring+Word+Sense+Disambiguation+biases+in+Machine+Translation%2E+In+Proceedings+of+th)
7. Yong Cao, Li Zhou, Seolhwa Lee, Laura Cabello, Min Chen, and Daniel Hershcovich. 2023. Assessing cross-cultural alignment between chatgpt and human societies: An empirical study. In Proceedings of the First Workshop on Cross-Cultural Considerations in NLP (C3NLP), pages 53–67. [find](https://scholar.google.com/scholar?q=Yong+Cao%2C+Li+Zhou%2C+Seolhwa+Lee%2C+Laura+Cabello%2C+Min+Chen%2C+and+Daniel+Hershcovich%2E+2023%2E+Assessing+cross%2Dcultural+alignment+between+chatgpt+and+human+societies%3A+An+empirical+study%2E+In+Proceedings+of+the) [our card](https://md.research.elamur.ai/free/en/papers/cao-2023-assessing-cross-cultural-alignment-between/)
8. Chen Cecilia Liu, Fajri Koto, Timothy Baldwin, and Iryna Gurevych. 2024. Are multilingual LLMs culturally-diverse reasoners? an investigation into multicultural proverbs and sayings. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics:… [find](https://scholar.google.com/scholar?q=Chen+Cecilia+Liu%2C+Fajri+Koto%2C+Timothy+Baldwin%2C+and+Iryna+Gurevych%2E+2024%2E+Are+multilingual+LLMs+culturally%2Ddiverse+reasoners%3F+an+investigation+into+multicultural+proverbs+and+sayings%2E+In+Proceedings+of)
9. Yu Ying Chiu, Liwei Jiang, Bill Yuchen Lin, Chan Young Park, Shuyue Stella Li, Sahithya Ravi, Mehar Bhatia, Maria Antoniak, Yulia Tsvetkov, Vered Shwartz, et al. Culturalbench: a robust, diverse and challenging benchmark on measuring (the lack of) cultural knowledge of llms. [find](https://scholar.google.com/scholar?q=Yu+Ying+Chiu%2C+Liwei+Jiang%2C+Bill+Yuchen+Lin%2C+Chan+Young+Park%2C+Shuyue+Stella+Li%2C+Sahithya+Ravi%2C+Mehar+Bhatia%2C+Maria+Antoniak%2C+Yulia+Tsvetkov%2C+Vered+Shwartz%2C+et+al%2E+Culturalbench%3A+a+robust%2C+diverse+and+c)
10. Simone Conia, Daniel Lee, Min Li, Umar Farooq Minhas, Saloni Potdar, and Yunyao Li. 2024. Towards cross-cultural machine translation with retrieval-augmented generation from multilingual knowledge graphs. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, page… [find](https://scholar.google.com/scholar?q=Simone+Conia%2C+Daniel+Lee%2C+Min+Li%2C+Umar+Farooq+Minhas%2C+Saloni+Potdar%2C+and+Yunyao+Li%2E+2024%2E+Towards+cross%2Dcultural+machine+translation+with+retrieval%2Daugmented+generation+from+multilingual+knowledge+gra)
11. Simone Conia, Min Li, Roberto Navigli, and Saloni Potdar. 2025. Semeval-2025 task 2: Entity-aware machine translation. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 2535–2557. [find](https://scholar.google.com/scholar?q=Simone+Conia%2C+Min+Li%2C+Roberto+Navigli%2C+and+Saloni+Potdar%2E+2025%2E+Semeval%2D2025+task+2%3A+Entity%2Daware+machine+translation%2E+In+Proceedings+of+the+19th+International+Workshop+on+Semantic+Evaluation+%28SemEval)
12. Shekoufeh Daghoughi and Mahmood Hashemian. 2016. Analysis of culture-specific items and translation strategies applied in translating jalal al-ahmad’s" by the pen". English language teaching, 9(4):171–185. [find](https://scholar.google.com/scholar?q=Shekoufeh+Daghoughi+and+Mahmood+Hashemian%2E+2016%2E+Analysis+of+culture%2Dspecific+items+and+translation+strategies+applied+in+translating+jalal+al%2Dahmad%E2%80%99s%22+by+the+pen%22%2E+English+language+teaching%2C+9%284%29%3A171)
13. Julen Etxaniz, Gorka Azkune, Aitor Soroa, Oier Lacalle, and Mikel Artetxe. 2024. Bertaqa: How much do language models know about local culture? Advances in Neural Information Processing Systems, 37:34077–34097. [find](https://scholar.google.com/scholar?q=Julen+Etxaniz%2C+Gorka+Azkune%2C+Aitor+Soroa%2C+Oier+Lacalle%2C+and+Mikel+Artetxe%2E+2024%2E+Bertaqa%3A+How+much+do+language+models+know+about+local+culture%3F+Advances+in+Neural+Information+Processing+Systems%2C+37%3A34)
14. Aitor Gonzalez-Agirre, Marc Pàmies, Joan Llop, Irene Baucells, Severino Da Dalt, Daniel Tamayo, José Javier Saiz, Ferran Espuña, Jaume Prats, Javier Aula-Blasco, Mario Mina, Iñigo Pikabea, Adrián Rubio, Alexander Shvets, Anna Sallés, Iñaki Lacunza, Jorge Palomar, Júlia Falcão, Lucía Tormo, Luis Vasq… [find](https://scholar.google.com/scholar?q=Aitor+Gonzalez%2DAgirre%2C+Marc+P%C3%A0mies%2C+Joan+Llop%2C+Irene+Baucells%2C+Severino+Da+Dalt%2C+Daniel+Tamayo%2C+Jos%C3%A9+Javier+Saiz%2C+Ferran+Espu%C3%B1a%2C+Jaume+Prats%2C+Javier+Aula%2DBlasco%2C+Mario+Mina%2C+I%C3%B1igo+Pikabea%2C+Adri%C3%A1n+Rubi)
15. Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Alex Vaughan, Amy Yang, Angela Fan, Anirudh Goyal, Anthony Hartshorn, Aobo Yang, Archi Mitra, Archie Sravankumar, Artem Korenev, Arthur Hinsvark, Arun Rao,… [find](https://scholar.google.com/scholar?q=Aaron+Grattafiori%2C+Abhimanyu+Dubey%2C+Abhinav+Jauhri%2C+Abhinav+Pandey%2C+Abhishek+Kadian%2C+Ahmad+Al%2DDahle%2C+Aiesha+Letman%2C+Akhil+Mathur%2C+Alan+Schelten%2C+Alex+Vaughan%2C+Amy+Yang%2C+Angela+Fan%2C+Anirudh+Goyal%2C+Anth)
16. Pratik Joshi, Sebastin Santy, Amar Budhiraja, Kalika Bali, and Monojit Choudhury. 2020. The state and fate of linguistic diversity and inclusion in the NLP world. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 6282–6293, Online. Association for Comp… [find](https://scholar.google.com/scholar?q=Pratik+Joshi%2C+Sebastin+Santy%2C+Amar+Budhiraja%2C+Kalika+Bali%2C+and+Monojit+Choudhury%2E+2020%2E+The+state+and+fate+of+linguistic+diversity+and+inclusion+in+the+NLP+world%2E+In+Proceedings+of+the+58th+Annual+Mee) [our card](https://md.research.elamur.ai/free/en/papers/joshi-2020-state-fate-linguistic-diversity-inclusion/)
17. Huihan Li, Liwei Jiang, Nouha Dziri, Xiang Ren, and Yejin Choi. 2024. CULTURE-GEN: Revealing global cultural perception in language models through natural language prompting. In First Conference on Language Modeling. [find](https://scholar.google.com/scholar?q=Huihan+Li%2C+Liwei+Jiang%2C+Nouha+Dziri%2C+Xiang+Ren%2C+and+Yejin+Choi%2E+2024%2E+CULTURE%2DGEN%3A+Revealing+global+cultural+perception+in+language+models+through+natural+language+prompting%2E+In+First+Conference+on+La)
18. Zheng Wei Lim, Ekaterina Vylomova, Charles Kemp, and Trevor Cohn. 2024. Predicting human translation difficulty with neural machine translation. Transactions of the Association for Computational Linguistics, 12:1479–1496. [find](https://scholar.google.com/scholar?q=Zheng+Wei+Lim%2C+Ekaterina+Vylomova%2C+Charles+Kemp%2C+and+Trevor+Cohn%2E+2024%2E+Predicting+human+translation+difficulty+with+neural+machine+translation%2E+Transactions+of+the+Association+for+Computational+Lingu)
19. Federico Martelli, Stefano Perrella, Niccolò Campolungo, Tina Munda, Svetla Koeva, Carole Tiberius, and Roberto Navigli. 2025. Dibimt: A gold evaluation benchmark for studying lexical ambiguity in machine translation. Computational Linguistics, 51(2):343–413. [find](https://scholar.google.com/scholar?q=Federico+Martelli%2C+Stefano+Perrella%2C+Niccol%C3%B2+Campolungo%2C+Tina+Munda%2C+Svetla+Koeva%2C+Carole+Tiberius%2C+and+Roberto+Navigli%2E+2025%2E+Dibimt%3A+A+gold+evaluation+benchmark+for+studying+lexical+ambiguity+in+mac) [our card](https://md.research.elamur.ai/free/en/papers/martelli-2025-dibimt-gold-evaluation-benchmark-studying/)
20. Pedro Henrique Martins, João Alves, Patrick Fernandes, Nuno M. Guerreiro, Ricardo Rei, Amin Farajian, Mateusz Klimaszewski, Duarte M. Alves, José Pombal, Nicolas Boizard, Manuel Faysse, Pierre Colombo, François Yvon, Barry Haddow, José G. C. de Souza, Alexandra Birch, and André F. T. Martins. 2025.… [find](https://scholar.google.com/scholar?q=Pedro+Henrique+Martins%2C+Jo%C3%A3o+Alves%2C+Patrick+Fernandes%2C+Nuno+M%2E+Guerreiro%2C+Ricardo+Rei%2C+Amin+Farajian%2C+Mateusz+Klimaszewski%2C+Duarte+M%2E+Alves%2C+Jos%C3%A9+Pombal%2C+Nicolas+Boizard%2C+Manuel+Faysse%2C+Pierre+Colombo)
21. Domenico Meconi, Simone Stirpe, Federico Martelli, Leonardo Lavalle, and Roberto Navigli. 2025. Do large language models understand word senses? In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 33897–33916, Suzhou, China. Association for Computational… [find](https://scholar.google.com/scholar?q=Domenico+Meconi%2C+Simone+Stirpe%2C+Federico+Martelli%2C+Leonardo+Lavalle%2C+and+Roberto+Navigli%2E+2025%2E+Do+large+language+models+understand+word+senses%3F+In+Proceedings+of+the+2025+Conference+on+Empirical+Meth) [our card](https://md.research.elamur.ai/free/en/papers/lex-2025-meconi-llms-word-senses/)
22. Junho Myung, Nayeon Lee, Yi Zhou, Jiho Jin, Rifki Putri, Dimosthenis Antypas, Hsuvas Borkakoty, Eunsu Kim, Carla Perez-Almendros, Abinew Ali Ayele, et al. 2024. Blend: A benchmark for llms on everyday knowledge in diverse cultures and languages. Advances in Neural Information Processing Systems, 37:… [find](https://scholar.google.com/scholar?q=Junho+Myung%2C+Nayeon+Lee%2C+Yi+Zhou%2C+Jiho+Jin%2C+Rifki+Putri%2C+Dimosthenis+Antypas%2C+Hsuvas+Borkakoty%2C+Eunsu+Kim%2C+Carla+Perez%2DAlmendros%2C+Abinew+Ali+Ayele%2C+et+al%2E+2024%2E+Blend%3A+A+benchmark+for+llms+on+everyday) [our card](https://md.research.elamur.ai/free/en/papers/myung-2024-blend-benchmark-llms-everyday-knowledge/)
23. Millicent Ochieng, Varun Gumma, Sunayana Sitaram, Jindong Wang, Vishrav Chaudhary, Keshet Ronen, Kalika Bali, and Jacki O’Neill. 2024. Beyond metrics: evaluating llms’ effectiveness in culturally nuanced, low-resource real-world scenarios. arXiv preprint arXiv:2406.00343. [find](https://scholar.google.com/scholar?q=Millicent+Ochieng%2C+Varun+Gumma%2C+Sunayana+Sitaram%2C+Jindong+Wang%2C+Vishrav+Chaudhary%2C+Keshet+Ronen%2C+Kalika+Bali%2C+and+Jacki+O%E2%80%99Neill%2E+2024%2E+Beyond+metrics%3A+evaluating+llms%E2%80%99+effectiveness+in+culturally+nuan)
24. OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, Red Avila, Igor Babuschkin, Suchir Balaji, Valerie Balcom, Paul Baltescu, Haiming Bao, Mohammad Bavarian, Jeff Belgum, Irwan Bello, Ja… [find](https://scholar.google.com/scholar?q=OpenAI%2C+Josh+Achiam%2C+Steven+Adler%2C+Sandhini+Agarwal%2C+Lama+Ahmad%2C+Ilge+Akkaya%2C+Florencia+Leoni+Aleman%2C+Diogo+Almeida%2C+Janko+Altenschmidt%2C+Sam+Altman%2C+Shyamal+Anadkat%2C+Red+Avila%2C+Igor+Babuschkin%2C+Suchir) [our card](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/)
25. Riccardo Orlando, Pere-Lluís Huguet Cabot, Edoardo Barba, and Roberto Navigli. 2024a. Relik: Retrieve and link, fast and accurate entity linking and relation extraction on an academic budget. In Findings of the Association for Computational Linguistics ACL 2024, pages 14114– 14132. [find](https://scholar.google.com/scholar?q=Riccardo+Orlando%2C+Pere%2DLlu%C3%ADs+Huguet+Cabot%2C+Edoardo+Barba%2C+and+Roberto+Navigli%2E+2024a%2E+Relik%3A+Retrieve+and+link%2C+fast+and+accurate+entity+linking+and+relation+extraction+on+an+academic+budget%2E+In+Findi)
26. Riccardo Orlando, Luca Moroni, Pere-Lluís Huguet Cabot, Simone Conia, Edoardo Barba, Sergio Orlandini, Giuseppe Fiameni, and Roberto Navigli. 2024b. Minerva LLMs: The first family of large language models trained from scratch on Italian data. In Proceedings of the 10th Italian Conference on Computat… [find](https://scholar.google.com/scholar?q=Riccardo+Orlando%2C+Luca+Moroni%2C+Pere%2DLlu%C3%ADs+Huguet+Cabot%2C+Simone+Conia%2C+Edoardo+Barba%2C+Sergio+Orlandini%2C+Giuseppe+Fiameni%2C+and+Roberto+Navigli%2E+2024b%2E+Minerva+LLMs%3A+The+first+family+of+large+language+mo)
27. Qwen, :, An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, Huan Lin, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Yang, Jiaxi Yang, Jingren Zhou, Junyang Lin, Kai Dang, Keming Lu, Keqin Bao, Kexin Yang, Le Yu, Mei Li, Mingfeng… [find](https://scholar.google.com/scholar?q=Qwen%2C+%3A%2C+An+Yang%2C+Baosong+Yang%2C+Beichen+Zhang%2C+Binyuan+Hui%2C+Bo+Zheng%2C+Bowen+Yu%2C+Chengyuan+Li%2C+Dayiheng+Liu%2C+Fei+Huang%2C+Haoran+Wei%2C+Huan+Lin%2C+Jian+Yang%2C+Jianhong+Tu%2C+Jianwei+Zhang%2C+Jianxin+Yang%2C+Jiaxi+)
28. Ricardo Rei, Craig Stewart, Ana C Farinha, and Alon Lavie. 2020. COMET: A neural framework for MT evaluation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 2685–2702, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ricardo+Rei%2C+Craig+Stewart%2C+Ana+C+Farinha%2C+and+Alon+Lavie%2E+2020%2E+COMET%3A+A+neural+framework+for+MT+evaluation%2E+In+Proceedings+of+the+2020+Conference+on+Empirical+Methods+in+Natural+Language+Processing+) [our card](https://md.research.elamur.ai/free/en/papers/rei-2020-comet-neural-framework-mt-evaluation/)
29. Matiss Rikters and Makoto Miwa. 2024. Entity-aware multi-task training helps rare word machine translation. In Proceedings of the 17th International Natural Language Generation Conference, pages 47–54, Tokyo, Japan. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Matiss+Rikters+and+Makoto+Miwa%2E+2024%2E+Entity%2Daware+multi%2Dtask+training+helps+rare+word+machine+translation%2E+In+Proceedings+of+the+17th+International+Natural+Language+Generation+Conference%2C+pages+47%E2%80%9354)
30. Nikit Srivastava, Aleksandr Perevalov, Denis Kuchelev, Diego Moussallem, Axel-Cyrille Ngonga Ngomo, and Andreas Both. 2023. Lingua franca–entity-aware machine translation approach for question answering over knowledge graphs. In Proceedings of the 12th Knowledge Capture Conference 2023, pages 122–13… [find](https://scholar.google.com/scholar?q=Nikit+Srivastava%2C+Aleksandr+Perevalov%2C+Denis+Kuchelev%2C+Diego+Moussallem%2C+Axel%2DCyrille+Ngonga+Ngomo%2C+and+Andreas+Both%2E+2023%2E+Lingua+franca%E2%80%93entity%2Daware+machine+translation+approach+for+question+answeri)
31. Yan Tao, Olga Viberg, Ryan S Baker, and René F Kizilcec. 2024. Cultural bias and cultural alignment of large language models. PNAS nexus, 3(9):pgae346. [find](https://scholar.google.com/scholar?q=Yan+Tao%2C+Olga+Viberg%2C+Ryan+S+Baker%2C+and+Ren%C3%A9+F+Kizilcec%2E+2024%2E+Cultural+bias+and+cultural+alignment+of+large+language+models%2E+PNAS+nexus%2C+3%289%29%3Apgae346%2E)
32. Gemini Team, Rohan Anil, Sebastian Borgeaud, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M. Dai, Anja Hauth, Katie Millican, David Silver, Melvin Johnson, Ioannis Antonoglou, Julian Schrittwieser, Amelia Glaese, Jilin Chen, Emily Pitler, Timothy Lillicrap, Angeliki Lazari… [find](https://scholar.google.com/scholar?q=Gemini+Team%2C+Rohan+Anil%2C+Sebastian+Borgeaud%2C+Jean%2DBaptiste+Alayrac%2C+Jiahui+Yu%2C+Radu+Soricut%2C+Johan+Schalkwyk%2C+Andrew+M%2E+Dai%2C+Anja+Hauth%2C+Katie+Millican%2C+David+Silver%2C+Melvin+Johnson%2C+Ioannis+Antonoglo) [our card](https://md.research.elamur.ai/free/en/papers/gemini-2023-team-gemini-family-highly-capable-multimodal/)
33. Gemma Team, Aishwarya Kamath, Johan Ferret, Shreya Pathak, Nino Vieillard, Ramona Merhej, Sarah Perrin, Tatiana Matejovicova, Alexandre Ramé, Morgane Rivière, Louis Rouillard, Thomas Mesnard, Geoffrey Cideron, Jean bastien Grill, Sabela Ramos, Edouard Yvinec, Michelle Casbon, Etienne Pot, Ivo Penche… [find](https://scholar.google.com/scholar?q=Gemma+Team%2C+Aishwarya+Kamath%2C+Johan+Ferret%2C+Shreya+Pathak%2C+Nino+Vieillard%2C+Ramona+Merhej%2C+Sarah+Perrin%2C+Tatiana+Matejovicova%2C+Alexandre+Ram%C3%A9%2C+Morgane+Rivi%C3%A8re%2C+Louis+Rouillard%2C+Thomas+Mesnard%2C+Geoffrey)
34. Jiaan Wang, Fandong Meng, Yingxue Zhang, and Jie Zhou. 2024. Retrieval-augmented machine translation with unstructured knowledge. arXiv preprint arXiv:2412.04342. [find](https://scholar.google.com/scholar?q=Jiaan+Wang%2C+Fandong+Meng%2C+Yingxue+Zhang%2C+and+Jie+Zhou%2E+2024%2E+Retrieval%2Daugmented+machine+translation+with+unstructured+knowledge%2E+arXiv+preprint+arXiv%3A2412%2E04342%2E)
35. Shufang Xie, Yingce Xia, Lijun Wu, Yiqing Huang, Yang Fan, and Tao Qin. 2022. End-to-end entity-aware neural machine translation. Machine Learning, 111(3):1181–1203. [find](https://scholar.google.com/scholar?q=Shufang+Xie%2C+Yingce+Xia%2C+Lijun+Wu%2C+Yiqing+Huang%2C+Yang+Fan%2C+and+Tao+Qin%2E+2022%2E+End%2Dto%2Dend+entity%2Daware+neural+machine+translation%2E+Machine+Learning%2C+111%283%29%3A1181%E2%80%931203%2E)
36. Lu Xu. 2025. Wikidata-driven entity-aware translation: Boosting LLMs with external knowledge. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 1802–1809, Vienna, Austria. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Lu+Xu%2E+2025%2E+Wikidata%2Ddriven+entity%2Daware+translation%3A+Boosting+LLMs+with+external+knowledge%2E+In+Proceedings+of+the+19th+International+Workshop+on+Semantic+Evaluation+%28SemEval%2D2025%29%2C+pages+1802%E2%80%931809%2C+)
37. Binwei Yao, Ming Jiang, Tara Bobinac, Diyi Yang, and Junjie Hu. 2024. Benchmarking machine translation with cultural awareness. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 13078–13096. [find](https://scholar.google.com/scholar?q=Binwei+Yao%2C+Ming+Jiang%2C+Tara+Bobinac%2C+Diyi+Yang%2C+and+Junjie+Hu%2E+2024%2E+Benchmarking+machine+translation+with+cultural+awareness%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+EMNLP+2024) [our card](https://md.research.elamur.ai/free/en/papers/yao-2023-benchmarking-machine-translation-cultural-awareness/)
38. Min Zhang, Limin Liu, Zhao Yanqing, Xiaosong Qiao, Su Chang, Xiaofeng Zhao, Junhao Zhu, Ming Zhu, Song Peng, Yinglu Li, et al. 2023. Leveraging multilingual knowledge graph to boost domain-specific entity translation of chatgpt. In Proceedings of Machine Translation Summit XIX, Vol. 2: Users Track,… [find](https://scholar.google.com/scholar?q=Min+Zhang%2C+Limin+Liu%2C+Zhao+Yanqing%2C+Xiaosong+Qiao%2C+Su+Chang%2C+Xiaofeng+Zhao%2C+Junhao+Zhu%2C+Ming+Zhu%2C+Song+Peng%2C+Yinglu+Li%2C+et+al%2E+2023%2E+Leveraging+multilingual+knowledge+graph+to+boost+domain%2Dspecific+en)