---
title: "Parallel Universes, Parallel Languages: A Comprehensive Study"
description: "The second creates English counterfactuals and has the same LLM translate them. 76 references."
authors: ["Qianli Wang", "Van Bach Nguyen", "Yihong Liu", "Fedor Splitt", "Nils Feldhus", "Christin Seifert", "Hinrich Schuetze", "Sebastian Möller", "Vera Schmitt"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2026.acl-long.12/"
doi: "10.18653/v1/2026.acl-long.12"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/wang-2026-parallel-universes-parallel-languages-comprehensive/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wang-2026-parallel-universes-parallel-languages-comprehensive/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/39/) / Parallel Universes, Parallel Languages: A Comprehensive Study on LLM-based Multilingual Counterfactual Example Generation

# Parallel Universes, Parallel Languages: A Comprehensive Study on LLM-based Multilingual Counterfactual Example Generation

**Authors:** [Qianli Wang](https://md.research.elamur.ai/free/en/authors/qianli-wang/), [Van Bach Nguyen](https://md.research.elamur.ai/free/en/authors/van-bach-nguyen/), [Yihong Liu](https://md.research.elamur.ai/free/en/authors/yihong-liu/), Fedor Splitt, [Nils Feldhus](https://md.research.elamur.ai/free/en/authors/nils-feldhus/), [Christin Seifert](https://md.research.elamur.ai/free/en/authors/christin-seifert/), [Hinrich Schuetze](https://md.research.elamur.ai/free/en/authors/hinrich-schuetze/), [Sebastian Möller](https://md.research.elamur.ai/free/en/authors/sebastian-moller/) and [Vera Schmitt](https://md.research.elamur.ai/free/en/authors/vera-schmitt/) · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-long.12/) · [PDF](https://aclanthology.org/2026.acl-long.12.pdf) · [DOI 10.18653/v1/2026.acl-long.12](https://doi.org/10.18653/v1/2026.acl-long.12) · [OpenAlex](https://openalex.org/W7166879882)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Counterfactual explanations are small edits to an input that flip a classifier's prediction. LLMs produce them well in English, but their quality in other languages had not been studied. To examine this, the authors evaluate three open instruction-tuned LLMs on XNLI and SIB200, two multilingual classification datasets, covering Arabic, English, German, Hindi, Spanish and Swahili (six languages in total). The model being explained is a fine-tuned multilingual BERT.

They compare two approaches. The first writes counterfactuals directly in the target language. The second creates English counterfactuals and has the same LLM translate them. Both use an existing one-shot Chain-of-Thought method with English prompts. Translated counterfactuals flip labels more often but require far larger edits, and they still lag behind the English originals. Direct generation works best for high-resource European languages.

The study also compares edit patterns across languages, catalogues recurring errors, and tests counterfactuals as training data. The work shows how far LLM-based explanations transfer beyond English and where they break down.

## Key points
- Setup: Qwen2.5-7B, Gemma3-27B and Llama3.3-70B were evaluated with label flip rate (LFR), perplexity and similarity based on multilingual sentence embeddings. Code and results are at github.com/qiaw99/multicfe.
- Translation-based counterfactuals beat direct ones on LFR. However, translation quality does not strongly predict validity, so machine translation is not presented as the ideal route.
- Edits in English, German and Spanish counterfactuals target very similar words, suggesting shared perturbation strategies across languages.
- Four error types recur across languages: copy-paste, negation, inconsistency and language confusion. Copy-paste is the most frequent.
- In counterfactual data augmentation (CDA), multilingual CDA outperforms cross-lingual CDA, most clearly for lower-resource languages. Noisy counterfactuals limit consistent gains in accuracy and robustness.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Ludwig-Maximilians-Universität München](https://md.research.elamur.ai/free/en/universities/ludwig-maximilians-universitat-munchen/) — University, Munich, Germany · 107 works · 56,478 citations
- [German Research Centre for Artificial Intelligence](https://md.research.elamur.ai/free/en/labs/german-research-centre-for-artificial-intelligence/) — Research institute, Kaiserslautern, Germany · 77 works · 29,479 citations
- [Munich Center for Machine Learning](https://md.research.elamur.ai/free/en/universities/munich-center-for-machine-learning/) — University, Munich, Germany · 57 works · 1,094 citations
- [Technische Universität Berlin](https://md.research.elamur.ai/free/en/universities/technische-universitat-berlin/) — University, Berlin, Germany · 22 works · 957 citations
- [Philipps University of Marburg](https://md.research.elamur.ai/free/en/universities/philipps-university-of-marburg/) — University, Marburg, Germany · 8 works · 226 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

🧭 Topics (1): [🌍 Multilingual & cross-lingual NLP](https://md.research.elamur.ai/free/en/topics/multilingual-nlp/) · 828 works

## Cite

Cite as: Qianli Wang, Van Bach Nguyen, Yihong Liu, Fedor Splitt, Nils Feldhus, Christin Seifert, Hinrich Schuetze, Sebastian Möller and Vera Schmitt. 2026. Parallel Universes, Parallel Languages: A Comprehensive Study on LLM-based Multilingual Counterfactual Example Generation. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{wang2026parallel,
  title = {{Parallel Universes, Parallel Languages: A Comprehensive Study on LLM-based Multilingual Counterfactual Example Generation}},
  author = {Qianli Wang, Van Bach Nguyen, Yihong Liu, Fedor Splitt, Nils Feldhus, Christin Seifert, Hinrich Schuetze, Sebastian Möller and Vera Schmitt},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-long.12},
  url = {https://doi.org/10.18653/v1/2026.acl-long.12}
}
```

- [← previous Parallel Corpus Filtering Based on Semantic Similarity and Surface Dissimilarity for Japanese Text Simplification with LLMs](https://md.research.elamur.ai/free/en/papers/maekawa-2026-parallel-corpus-filtering-based-semantic/)
- [next → Parameter-Efficient Adaptation of Self-Supervised Models for Arabic Speech Recognition](https://md.research.elamur.ai/free/en/papers/alshehri-2026-parameter-efficient-adaptation-self-supervised/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/39/)

## References

76 references, 27 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. David Ifeoluwa Adelani, Hannah Liu, Xiaoyu Shen, Nikita Vassilyev, Jesujoba O. Alabi, Yanke Mao, Haonan Gao, and En-Shiun Annie Lee. 2024. [SIB-200: A simple, inclusive, and big evaluation dataset for topic classification in 200+ languages and dialects](https://md.research.elamur.ai/free/en/papers/adelani-2023-sib-200-simple-inclusive-big/). In Proceedings of the 18th Conference of the Eu…
2. Kabir Ahuja, Harshita Diddee, Rishav Hada, Millicent Ochieng, Krithika Ramesh, Prachi Jain, Akshay Nambi, Tanuja Ganu, Sameer Segal, Mohamed Ahmed, Kalika Bali, and Sunayana Sitaram. 2023. [find](https://scholar.google.com/scholar?q=Kabir+Ahuja%2C+Harshita+Diddee%2C+Rishav+Hada%2C+Millicent+Ochieng%2C+Krithika+Ramesh%2C+Prachi+Jain%2C+Akshay+Nambi%2C+Tanuja+Ganu%2C+Sameer+Segal%2C+Mohamed+Ahmed%2C+Kalika+Bali%2C+and+Sunayana+Sitaram%2E+2023%2E)
3. [MEGA: Multilingual evaluation of generative AI](https://md.research.elamur.ai/free/en/papers/ahuja-2023-mega-multilingual-evaluation-generative-ai/). In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 4232–4267, Singapore. Association for Computational Linguistics.
4. Valentin Barriere and Sebastian Cifuentes. 2024. A study of nationality bias in names and perplexity using off-the-shelf affect-related tweet classifiers. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 569– 579, Miami, Florida, USA. Association for C… [find](https://scholar.google.com/scholar?q=Valentin+Barriere+and+Sebastian+Cifuentes%2E+2024%2E+A+study+of+nationality+bias+in+names+and+perplexity+using+off%2Dthe%2Dshelf+affect%2Drelated+tweet+classifiers%2E+In+Proceedings+of+the+2024+Conference+on+Empi)
5. Milan Bhan, Jean-noel Vittaut, Nicolas Chesneau, and Marie-jeanne Lesot. 2023a. Enhancing textual counterfactual explanation intelligibility through counterfactual feature importance. In Proceedings of the 3rd Workshop on Trustworthy Natural Language Processing (TrustNLP 2023), pages 221–231, Toront… [find](https://scholar.google.com/scholar?q=Milan+Bhan%2C+Jean%2Dnoel+Vittaut%2C+Nicolas+Chesneau%2C+and+Marie%2Djeanne+Lesot%2E+2023a%2E+Enhancing+textual+counterfactual+explanation+intelligibility+through+counterfactual+feature+importance%2E+In+Proceedings+o)
6. Milan Bhan, Jean-Noël Vittaut, Nicolas Chesneau, and Marie-Jeanne Lesot. 2023b. Tigtec: Token importance guided text counterfactuals. In Machine Learning and Knowledge Discovery in Databases: Research Track, pages 496–512, Cham. Springer Nature Switzerland. [find](https://scholar.google.com/scholar?q=Milan+Bhan%2C+Jean%2DNo%C3%ABl+Vittaut%2C+Nicolas+Chesneau%2C+and+Marie%2DJeanne+Lesot%2E+2023b%2E+Tigtec%3A+Token+importance+guided+text+counterfactuals%2E+In+Machine+Learning+and+Knowledge+Discovery+in+Databases%3A+Research)
7. Amrita Bhattacharjee, Raha Moraffah, Joshua Garland, and Huan Liu. 2024a. Zero-shot LLM-guided Counterfactual Generation: A Case Study on NLP Model Evaluation . In 2024 IEEE International Conference on Big Data (BigData), pages 1243–1248, Los Alamitos, CA, USA. IEEE Computer Society. [find](https://scholar.google.com/scholar?q=Amrita+Bhattacharjee%2C+Raha+Moraffah%2C+Joshua+Garland%2C+and+Huan+Liu%2E+2024a%2E+Zero%2Dshot+LLM%2Dguided+Counterfactual+Generation%3A+A+Case+Study+on+NLP+Model+Evaluation+%2E+In+2024+IEEE+International+Conference+o)
8. Amrita Bhattacharjee, Raha Moraffah, Joshua Garland, and Huan Liu. 2024b. Towards llm-guided causal explainability for black-box text classifiers. In AAAI 2024 Workshop on Responsible Language Models, Vancouver, BC, Canada. [find](https://scholar.google.com/scholar?q=Amrita+Bhattacharjee%2C+Raha+Moraffah%2C+Joshua+Garland%2C+and+Huan+Liu%2E+2024b%2E+Towards+llm%2Dguided+causal+explainability+for+black%2Dbox+text+classifiers%2E+In+AAAI+2024+Workshop+on+Responsible+Language+Models%2C)
9. Samuel R. Bowman, Gabor Angeli, Christopher Potts, and Christopher D. Manning. 2015. [A large annotated corpus for learning natural language inference](https://md.research.elamur.ai/free/en/papers/bowman-2015-large-annotated-corpus-learning-natural/). In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 632–642, Lisbon, Portugal. Association for Computati…
10. Zeming Chen, Qiyue Gao, Antoine Bosselut, Ashish Sabharwal, and Kyle Richardson. 2023. DISCO: Distilling counterfactuals with large language models. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 5514–5528, Toronto, Canada. A… [find](https://scholar.google.com/scholar?q=Zeming+Chen%2C+Qiyue+Gao%2C+Antoine+Bosselut%2C+Ashish+Sabharwal%2C+and+Kyle+Richardson%2E+2023%2E+DISCO%3A+Distilling+counterfactuals+with+large+language+models%2E+In+Proceedings+of+the+61st+Annual+Meeting+of+the+As)
11. Alexis Conneau, Ruty Rinott, Guillaume Lample, Adina Williams, Samuel Bowman, Holger Schwenk, and Veselin Stoyanov. 2018. XNLI: Evaluating cross-lingual sentence representations. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2475–2485, Brussels, Bel… [find](https://scholar.google.com/scholar?q=Alexis+Conneau%2C+Ruty+Rinott%2C+Guillaume+Lample%2C+Adina+Williams%2C+Samuel+Bowman%2C+Holger+Schwenk%2C+and+Veselin+Stoyanov%2E+2018%2E+XNLI%3A+Evaluating+cross%2Dlingual+sentence+representations%2E+In+Proceedings+of+the)
12. Yiming Cui, Wei-Nan Zhang, Wanxiang Che, Ting Liu, Zhigang Chen, and Shijin Wang. 2022. Multilingual multi-aspect explainability analyses on machine reading comprehension models. iScience, 25(5):104176. [find](https://scholar.google.com/scholar?q=Yiming+Cui%2C+Wei%2DNan+Zhang%2C+Wanxiang+Che%2C+Ting+Liu%2C+Zhigang+Chen%2C+and+Shijin+Wang%2E+2022%2E+Multilingual+multi%2Daspect+explainability+analyses+on+machine+reading+comprehension+models%2E+iScience%2C+25%285%29%3A10417)
13. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. [BERT: Pre-training of deep bidirectional transformers for language understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/). In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,…
14. Tanay Dixit, Bhargavi Paranjape, Hannaneh Hajishirzi, and Luke Zettlemoyer. 2022. CORE: A retrieve-then-edit framework for counterfactual data generation. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 2964–2984, Abu Dhabi, United Arab Emirates. Association for Compu… [find](https://scholar.google.com/scholar?q=Tanay+Dixit%2C+Bhargavi+Paranjape%2C+Hannaneh+Hajishirzi%2C+and+Luke+Zettlemoyer%2E+2022%2E+CORE%3A+A+retrieve%2Dthen%2Dedit+framework+for+counterfactual+data+generation%2E+In+Findings+of+the+Association+for+Computatio)
15. Marharyta Domnich, Julius Välja, Rasmus Moorits Veski, Giacomo Magnifico, Kadi Tulver, Eduard Barbu, and Raul Vicente. 2025. Towards unifying evaluation of counterfactual explanations: Leveraging large language models for human-centric assessments. Proceedings of the AAAI Conference on Artificial In… [find](https://scholar.google.com/scholar?q=Marharyta+Domnich%2C+Julius+V%C3%A4lja%2C+Rasmus+Moorits+Veski%2C+Giacomo+Magnifico%2C+Kadi+Tulver%2C+Eduard+Barbu%2C+and+Raul+Vicente%2E+2025%2E+Towards+unifying+evaluation+of+counterfactual+explanations%3A+Leveraging+larg)
16. Clément Dumas, Chris Wendler, Veniamin Veselovsky, Giovanni Monea, and Robert West. 2025. [Separating tongue from thought: Activation patching reveals language-agnostic concept representations in transformers](https://md.research.elamur.ai/free/en/papers/dumas-2025-separating-tongue-thought-activation-patching/). In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics…
17. Angela Fan, Mike Lewis, and Yann Dauphin. 2018. [Hierarchical neural story generation](https://md.research.elamur.ai/free/en/papers/fan-2018-hierarchical-neural-story-generation/). In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 889–898, Melbourne, Australia. Association for Computational Linguistics.
18. Changjiang Gao, Xu Huang, Wenhao Zhu, Shujian Huang, Lei Li, and Fei Yuan. 2025. [Could thinking multilingually empower llm reasoning?](https://md.research.elamur.ai/free/en/papers/gao-2025-could-thinking-multilingually-empower-llm/) Preprint, arXiv:2504.11833.
19. Matt Gardner, Yoav Artzi, Victoria Basmov, Jonathan Berant, Ben Bogin, Sihao Chen, Pradeep Dasigi, Dheeru Dua, Yanai Elazar, Ananth Gottumukkala, Nitish Gupta, Hannaneh Hajishirzi, Gabriel Ilharco, Daniel Khashabi, Kevin Lin, Jiangming Liu, Nelson F. Liu, Phoebe Mulcaire, Qiang Ning, and 7 others. 2… — [Evaluating Models' Local Decision Boundaries via Contrast Sets](https://md.research.elamur.ai/free/en/papers/gardner-2020-evaluating-models-local-decision-boundaries/)
20. Yingqiang Ge, Shuchang Liu, Zelong Li, Shuyuan Xu, Shijie Geng, Yunqi Li, Juntao Tan, Fei Sun, and Yongfeng Zhang. 2021. Counterfactual evaluation for explainable ai. Preprint, arXiv:2109.01962. — [arXiv:2109.01962](https://arxiv.org/abs/2109.01962) [find](https://scholar.google.com/scholar?q=Yingqiang+Ge%2C+Shuchang+Liu%2C+Zelong+Li%2C+Shuyuan+Xu%2C+Shijie+Geng%2C+Yunqi+Li%2C+Juntao+Tan%2C+Fei+Sun%2C+and+Yongfeng+Zhang%2E+2021%2E+Counterfactual+evaluation+for+explainable+ai%2E+Preprint%2C+arXiv%3A2109%2E01962%2E+%E2%80%94+%5Bar)
21. Yvette Graham, Timothy Baldwin, Alistair Moffat, and Justin Zobel. 2013. Continuous measurement scales in human evaluation of machine translation. In Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse, pages 33–41, Sofia, Bulgaria. Association for Computational… [find](https://scholar.google.com/scholar?q=Yvette+Graham%2C+Timothy+Baldwin%2C+Alistair+Moffat%2C+and+Justin+Zobel%2E+2013%2E+Continuous+measurement+scales+in+human+evaluation+of+machine+translation%2E+In+Proceedings+of+the+7th+Linguistic+Annotation+Works)
22. Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Alex Vaughan, Amy Yang, Angela Fan, Anirudh Goyal, Anthony Hartshorn, Aobo Yang, Archi Mitra, Archie Sravankumar, Artem Korenev, Arthur Hinsvark, and 542 o… — [The Llama 3 Herd of Models](https://md.research.elamur.ai/free/en/papers/grattafiori-2024-llama-3-herd-models/)
23. Nuno M. Guerreiro, Ricardo Rei, Daan van Stigt, Luisa Coheur, Pierre Colombo, and André F. T. Martins. 2024. [xcomet: Transparent machine translation evaluation through fine-grained error detection](https://md.research.elamur.ai/free/en/papers/guerreiro-2024-xcomet-transparent-machine-translation-evaluation/). Transactions of the Association for Computational Linguistics, 12:979–995.
24. Martin Haspelmath. 2005. The world atlas of language structures. Oxford University Press. [find](https://scholar.google.com/scholar?q=Martin+Haspelmath%2E+2005%2E+The+world+atlas+of+language+structures%2E+Oxford+University+Press%2E)
25. Eric W Holman, Cecil H Brown, Søren Wichmann, André Müller, Viveka Velupillai, Harald Hammarström, Sebastian Sauppe, Hagen Jung, Dik Bakker, Pamela Brown, and 1 others. 2011. Automated dating of the world’s language families based on lexical similarity. Current Anthropology, 52(6):841–875. [find](https://scholar.google.com/scholar?q=Eric+W+Holman%2C+Cecil+H+Brown%2C+S%C3%B8ren+Wichmann%2C+Andr%C3%A9+M%C3%BCller%2C+Viveka+Velupillai%2C+Harald+Hammarstr%C3%B6m%2C+Sebastian+Sauppe%2C+Hagen+Jung%2C+Dik+Bakker%2C+Pamela+Brown%2C+and+1+others%2E+2011%2E+Automated+dating+of+the+w)
26. Kaiyu Huang, Fengran Mo, Xinyu Zhang, Hongliang Li, You Li, Yuanchi Zhang, Weijian Yi, Yulong Mao, Jinchen Liu, Yuzhuang Xu, Jinan Xu, Jian-Yun Nie, and Yang Liu. 2025. A survey on large language models with multilingualism: Recent advances and new frontiers. Preprint, arXiv:2405.10936. — [arXiv:2405.10936](https://arxiv.org/abs/2405.10936) [find](https://scholar.google.com/scholar?q=Kaiyu+Huang%2C+Fengran+Mo%2C+Xinyu+Zhang%2C+Hongliang+Li%2C+You+Li%2C+Yuanchi+Zhang%2C+Weijian+Yi%2C+Yulong+Mao%2C+Jinchen+Liu%2C+Yuzhuang+Xu%2C+Jinan+Xu%2C+Jian%2DYun+Nie%2C+and+Yang+Liu%2E+2025%2E+A+survey+on+large+language+mode)
27. Jaedong Hwang, Kumar Tanmay, Seok-Jin Lee, Ayush Agrawal, Hamid Palangi, Kumar Ayush, Ila Fiete, and Paul Pu Liang. 2025. Learn globally, speak locally: Bridging the gaps in multilingual reasoning. Preprint, arXiv:2507.05418. — [arXiv:2507.05418](https://arxiv.org/abs/2507.05418) [find](https://scholar.google.com/scholar?q=Jaedong+Hwang%2C+Kumar+Tanmay%2C+Seok%2DJin+Lee%2C+Ayush+Agrawal%2C+Hamid+Palangi%2C+Kumar+Ayush%2C+Ila+Fiete%2C+and+Paul+Pu+Liang%2E+2025%2E+Learn+globally%2C+speak+locally%3A+Bridging+the+gaps+in+multilingual+reasoning%2E+Pr)
28. Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, Lélio Renard Lavaud, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix,… [find](https://scholar.google.com/scholar?q=Albert+Q%2E+Jiang%2C+Alexandre+Sablayrolles%2C+Arthur+Mensch%2C+Chris+Bamford%2C+Devendra+Singh+Chaplot%2C+Diego+de+las+Casas%2C+Florian+Bressand%2C+Gianna+Lengyel%2C+Guillaume+Lample%2C+Lucile+Saulnier%2C+L%C3%A9lio+Renard+Lav)
29. Divyansh Kaushik, Eduard Hovy, and Zachary Lipton. 2020. Learning the difference that makes a difference with counterfactually-augmented data. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Divyansh+Kaushik%2C+Eduard+Hovy%2C+and+Zachary+Lipton%2E+2020%2E+Learning+the+difference+that+makes+a+difference+with+counterfactually%2Daugmented+data%2E+In+International+Conference+on+Learning+Representations%2E)
30. Viet Dac Lai, Nghia Ngo, Amir Pouran Ben Veyseh, Hieu Man, Franck Dernoncourt, Trung Bui, and Thien Huu Nguyen. 2023. [ChatGPT beyond English: Towards a comprehensive evaluation of large language models in multilingual learning](https://md.research.elamur.ai/free/en/papers/lai-2023-chatgpt-beyond-english-comprehensive-evaluation/). In Findings of the Association for Computational Linguistics: EMNLP 2023…
31. Tiep Le, Vasudev Lal, and Phillip Howard. 2023. COCO-counterfactuals: Automatically constructed counterfactual examples for image-text pairs. In Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track. [find](https://scholar.google.com/scholar?q=Tiep+Le%2C+Vasudev+Lal%2C+and+Phillip+Howard%2E+2023%2E+COCO%2Dcounterfactuals%3A+Automatically+constructed+counterfactual+examples+for+image%2Dtext+pairs%2E+In+Thirty%2Dseventh+Conference+on+Neural+Information+Process)
32. Chaoqun Liu, Wenxuan Zhang, Yiran Zhao, Anh Tuan Luu, and Lidong Bing. 2025. [Is translation all you need? a study on solving multilingual tasks with large language models](https://md.research.elamur.ai/free/en/papers/liu-2025-is-translation-all-you-need/). In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: H…
33. Qi Liu, Matt Kusner, and Phil Blunsom. 2021. Counterfactual data augmentation for neural machine translation. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 187–197, Online. Association for Comp… [find](https://scholar.google.com/scholar?q=Qi+Liu%2C+Matt+Kusner%2C+and+Phil+Blunsom%2E+2021%2E+Counterfactual+data+augmentation+for+neural+machine+translation%2E+In+Proceedings+of+the+2021+Conference+of+the+North+American+Chapter+of+the+Association+for)
34. Nishtha Madaan, Inkit Padhi, Naveen Panwar, and Dip-tikalyan Saha. 2021. Generate your counterfactuals: Towards controlled counterfactual generation for text. Proceedings of the AAAI Conference on Artificial Intelligence, 35(15):13516–13524. [find](https://scholar.google.com/scholar?q=Nishtha+Madaan%2C+Inkit+Padhi%2C+Naveen+Panwar%2C+and+Dip%2Dtikalyan+Saha%2E+2021%2E+Generate+your+counterfactuals%3A+Towards+controlled+counterfactual+generation+for+text%2E+Proceedings+of+the+AAAI+Conference+on+Art)
35. Kelly Marchisio, Wei-Yin Ko, Alexandre Berard, Théo Dehaze, and Sebastian Ruder. 2024. [Understanding and mitigating language confusion in LLMs](https://md.research.elamur.ai/free/en/papers/marchisio-2024-understanding-mitigating-language-confusion-llms/). In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 6653– 6677, Miami, Florida, USA. Association for Computatio…
36. Stephen McAleese and Mark Keane. 2024. A comparative analysis of counterfactual explanation methods for text classifiers. Preprint, arXiv:2411.02643. — [arXiv:2411.02643](https://arxiv.org/abs/2411.02643) [find](https://scholar.google.com/scholar?q=Stephen+McAleese+and+Mark+Keane%2E+2024%2E+A+comparative+analysis+of+counterfactual+explanation+methods+for+text+classifiers%2E+Preprint%2C+arXiv%3A2411%2E02643%2E+%E2%80%94+%5BarXiv%3A2411%2E02643%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2411%2E02)
37. Jihyung Moon, Hyunchang Cho, and Eunjeong L. Park. 2020. Revisiting round-trip translation for quality estimation. In Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, pages 91–104, Lisboa, Portugal. European Association for Machine Translation. [find](https://scholar.google.com/scholar?q=Jihyung+Moon%2C+Hyunchang+Cho%2C+and+Eunjeong+L%2E+Park%2E+2020%2E+Revisiting+round%2Dtrip+translation+for+quality+estimation%2E+In+Proceedings+of+the+22nd+Annual+Conference+of+the+European+Association+for+Machine+)
38. Van Bach Nguyen, Christin Seifert, and Jörg Schlötterer. 2024a. CEval: A benchmark for evaluating counterfactual text generation. In Proceedings of the 17th International Natural Language Generation Conference, pages 55–69, Tokyo, Japan. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Van+Bach+Nguyen%2C+Christin+Seifert%2C+and+J%C3%B6rg+Schl%C3%B6tterer%2E+2024a%2E+CEval%3A+A+benchmark+for+evaluating+counterfactual+text+generation%2E+In+Proceedings+of+the+17th+International+Natural+Language+Generation+C)
39. Van Bach Nguyen, Paul Youssef, Christin Seifert, and Jörg Schlötterer. 2024b. LLMs for generating and evaluating counterfactuals: A comprehensive study. [find](https://scholar.google.com/scholar?q=Van+Bach+Nguyen%2C+Paul+Youssef%2C+Christin+Seifert%2C+and+J%C3%B6rg+Schl%C3%B6tterer%2E+2024b%2E+LLMs+for+generating+and+evaluating+counterfactuals%3A+A+comprehensive+study%2E)
40. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 14809–14824, Miami, Florida, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=In+Findings+of+the+Association+for+Computational+Linguistics%3A+EMNLP+2024%2C+pages+14809%E2%80%9314824%2C+Miami%2C+Florida%2C+USA%2E+Association+for+Computational+Linguistics%2E)
41. OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, Red Avila, Igor Babuschkin, Suchir Balaji, Valerie Balcom, Paul Baltescu, Haiming Bao, Mohammad Bavarian, Jeff Belgum, and 262 others.… — [GPT-4 Technical Report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/)
42. Jianhui Pang, Fanghua Ye, Derek Fai Wong, Dian Yu, Shuming Shi, Zhaopeng Tu, and Longyue Wang. 2025. [Salute the classic: Revisiting challenges of machine translation in the age of large language models](https://md.research.elamur.ai/free/en/papers/pang-2025-salute-classic-revisiting-challenges-machine/). Transactions of the Association for Computational Linguistics, 13:73–95.
43. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. [Bleu: a method for automatic evaluation of machine translation](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/). In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pages 311–318, Philadelphia, Pennsylvania, USA. Association for Computational…
44. Renhao Pei, Yihong Liu, Peiqin Lin, François Yvon, and Hinrich Schuetze. 2025. Understanding in-context machine translation for low-resource languages: A case study on Manchu. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 87… [find](https://scholar.google.com/scholar?q=Renhao+Pei%2C+Yihong+Liu%2C+Peiqin+Lin%2C+Fran%C3%A7ois+Yvon%2C+and+Hinrich+Schuetze%2E+2025%2E+Understanding+in%2Dcontext+machine+translation+for+low%2Dresource+languages%3A+A+case+study+on+Manchu%2E+In+Proceedings+of+the+63)
45. Wessel Poelman and Miryam de Lhoneux. 2025. The roles of English in evaluating multilingual language models. In Proceedings of the Joint 25th Nordic Conference on Computational Linguistics and 11th Baltic Conference on Human Language Technologies (NoDaLiDa/Baltic-HLT 2025), pages 492–498, Tallinn, E… [find](https://scholar.google.com/scholar?q=Wessel+Poelman+and+Miryam+de+Lhoneux%2E+2025%2E+The+roles+of+English+in+evaluating+multilingual+language+models%2E+In+Proceedings+of+the+Joint+25th+Nordic+Conference+on+Computational+Linguistics+and+11th+Ba)
46. Maja Popović. 2015. [chrF: character n-gram F-score for automatic MT evaluation](https://md.research.elamur.ai/free/en/papers/popovic-2015-chrf-character-n-gram-f/). In Proceedings of the Tenth Workshop on Statistical Machine Translation, pages 392–395, Lisbon, Portugal. Association for Computational Linguistics.
47. Jirui Qi, Raquel Fernández, and Arianna Bisazza. 2023. [Cross-lingual consistency of factual knowledge in multilingual language models](https://md.research.elamur.ai/free/en/papers/qi-2023-cross-lingual-consistency-factual-knowledge/). In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 10650–10666, Singapore. Association for Computational Linguistics.
48. Qwen, An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, Huan Lin, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Yang, Jiaxi Yang, Jingren Zhou, Junyang Lin, and 23 others. 2024. Qwen2.5 technical report. Preprint, arXiv:2412.15… [find](https://scholar.google.com/scholar?q=Qwen%2C+An+Yang%2C+Baosong+Yang%2C+Beichen+Zhang%2C+Binyuan+Hui%2C+Bo+Zheng%2C+Bowen+Yu%2C+Chengyuan+Li%2C+Dayiheng+Liu%2C+Fei+Huang%2C+Haoran+Wei%2C+Huan+Lin%2C+Jian+Yang%2C+Jianhong+Tu%2C+Jianwei+Zhang%2C+Jianxin+Yang%2C+Jiaxi+Yan)
49. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, and 1 others. 2019. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9. [find](https://scholar.google.com/scholar?q=Alec+Radford%2C+Jeffrey+Wu%2C+Rewon+Child%2C+David+Luan%2C+Dario+Amodei%2C+Ilya+Sutskever%2C+and+1+others%2E+2019%2E+Language+models+are+unsupervised+multitask+learners%2E+OpenAI+blog%2C+1%288%29%3A9%2E)
50. Lucas Resck, Isabelle Augenstein, and Anna Korhonen. 2025. [Explainability and interpretability of multilingual large language models: A survey](https://md.research.elamur.ai/free/en/papers/resck-2025-explainability-interpretability-multilingual-large-language/). In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 20465–20497, Suzhou, China. Association for Computational L…
51. Marcel Robeer, Floris Bex, and Ad Feelders. 2021. Generating realistic natural language counterfactuals. In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 3611–3625, Punta Cana, Dominican Republic. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Marcel+Robeer%2C+Floris+Bex%2C+and+Ad+Feelders%2E+2021%2E+Generating+realistic+natural+language+counterfactuals%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+EMNLP+2021%2C+pages+3611%E2%80%933625%2C+Punt)
52. Alexis Ross, Ana Marasović, and Matthew Peters. 2021. [Explaining NLP models via minimal contrastive editing (MiCE)](https://md.research.elamur.ai/free/en/papers/ross-2021-explaining-nlp-models-minimal-contrastive/). In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 3840–3852, Online. Association for Computational Linguistics.
53. Rishiraj Saha Roy, Joel Schlotthauer, Chris Hinze, Andreas Foltyn, Luzian Hahn, and Fabian Kuech. 2025. Evidence contextualization and counterfactual attribution for conversational qa over heterogeneous data with rag systems. In Proceedings of the Eighteenth ACM International Conference on Web Searc… [find](https://scholar.google.com/scholar?q=Rishiraj+Saha+Roy%2C+Joel+Schlotthauer%2C+Chris+Hinze%2C+Andreas+Foltyn%2C+Luzian+Hahn%2C+and+Fabian+Kuech%2E+2025%2E+Evidence+contextualization+and+counterfactual+attribution+for+conversational+qa+over+heterogeneo)
54. Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016. Improving neural machine translation models with monolingual data. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 86–96, Berlin, Germany. Association for Computational L… [find](https://scholar.google.com/scholar?q=Rico+Sennrich%2C+Barry+Haddow%2C+and+Alexandra+Birch%2E+2016%2E+Improving+neural+machine+translation+models+with+monolingual+data%2E+In+Proceedings+of+the+54th+Annual+Meeting+of+the+Association+for+Computationa)
55. Shuaijie She, Wei Zou, Shujian Huang, Wenhao Zhu, Xiang Liu, Xiang Geng, and Jiajun Chen. 2024. [MAPO: Advancing multilingual reasoning through multilingual-alignment-as-preference optimization](https://md.research.elamur.ai/free/en/papers/she-2024-mapo-advancing-multilingual-reasoning-through/). In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long…
56. Oleh Shliazhko, Alena Fenogenova, Maria Tikhonova, Anastasia Kozlova, Vladislav Mikhailov, and Tatiana Shavrina. 2024. [mGPT: Few-shot learners go multilingual](https://md.research.elamur.ai/free/en/papers/shliazhko-2022-mgpt-few-shot-learners-go/). Transactions of the Association for Computational Linguistics, 12:58–79.
57. Harold Somers. 2005. Round-trip translation: What is it good for? In Proceedings of the Australasian Language Technology Workshop 2005, pages 127– 133, Sydney, Australia. [find](https://scholar.google.com/scholar?q=Harold+Somers%2E+2005%2E+Round%2Dtrip+translation%3A+What+is+it+good+for%3F+In+Proceedings+of+the+Australasian+Language+Technology+Workshop+2005%2C+pages+127%E2%80%93+133%2C+Sydney%2C+Australia%2E)
58. Hwanjun Song, Minseok Kim, Dongmin Park, Yooju Shin, and Jae-Gil Lee. 2023. Learning from noisy labels with deep neural networks: A survey. IEEE transactions on neural networks and learning systems, 34(11):8135—8153. [find](https://scholar.google.com/scholar?q=Hwanjun+Song%2C+Minseok+Kim%2C+Dongmin+Park%2C+Yooju+Shin%2C+and+Jae%2DGil+Lee%2E+2023%2E+Learning+from+noisy+labels+with+deep+neural+networks%3A+A+survey%2E+IEEE+transactions+on+neural+networks+and+learning+systems%2C+3)
59. Gemma Team. 2025. Gemma 3 technical report. Preprint, arXiv:2503.19786. [find](https://scholar.google.com/scholar?q=Gemma+Team%2E+2025%2E+Gemma+3+technical+report%2E+Preprint%2C+arXiv%3A2503%2E19786%2E)
60. Marcos Treviso, Alexis Ross, Nuno M. Guerreiro, and André Martins. 2023. CREST: A joint framework for rationalization and counterfactual text generation. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 15109–15126, Toronto, Ca… [find](https://scholar.google.com/scholar?q=Marcos+Treviso%2C+Alexis+Ross%2C+Nuno+M%2E+Guerreiro%2C+and+Andr%C3%A9+Martins%2E+2023%2E+CREST%3A+A+joint+framework+for+rationalization+and+counterfactual+text+generation%2E+In+Proceedings+of+the+61st+Annual+Meeting+of+t)
61. Ahmet Üstün, Viraat Aryabumi, Zheng Yong, Wei-Yin Ko, Daniel D’souza, Gbemileke Onilude, Neel Bhandari, Shivalika Singh, Hui-Lee Ooi, Amr Kayid, Freddie Vargus, Phil Blunsom, Shayne Longpre, Niklas Muennighoff, Marzieh Fadaee, Julia Kreutzer, and Sara Hooker. 2024. Aya model: An instruction fine-tun… [find](https://scholar.google.com/scholar?q=Ahmet+%C3%9Cst%C3%BCn%2C+Viraat+Aryabumi%2C+Zheng+Yong%2C+Wei%2DYin+Ko%2C+Daniel+D%E2%80%99souza%2C+Gbemileke+Onilude%2C+Neel+Bhandari%2C+Shivalika+Singh%2C+Hui%2DLee+Ooi%2C+Amr+Kayid%2C+Freddie+Vargus%2C+Phil+Blunsom%2C+Shayne+Longpre%2C+Niklas+Mu)
62. Qianli Wang, Tatiana Anikina, Nils Feldhus, Simon Ostermann, Fedor Splitt, Jiaao Li, Yoana Tsoneva, Sebastian Möller, and Vera Schmitt. 2025a. Multilingual datasets for custom input extraction and explanation requests parsing in conversational XAI systems. In Findings of the Association for Computat… [find](https://scholar.google.com/scholar?q=Qianli+Wang%2C+Tatiana+Anikina%2C+Nils+Feldhus%2C+Simon+Ostermann%2C+Fedor+Splitt%2C+Jiaao+Li%2C+Yoana+Tsoneva%2C+Sebastian+M%C3%B6ller%2C+and+Vera+Schmitt%2E+2025a%2E+Multilingual+datasets+for+custom+input+extraction+and+exp)
63. Qianli Wang, Nils Feldhus, Pepa Atanasova, Fedor Splitt, Simon Ostermann, Sebastian Möller, and Vera Schmitt. 2026a. Can large language models still explain themselves? investigating the impact of quantization on self-explanations. Preprint, arXiv:2601.00282. — [arXiv:2601.00282](https://arxiv.org/abs/2601.00282) [find](https://scholar.google.com/scholar?q=Qianli+Wang%2C+Nils+Feldhus%2C+Pepa+Atanasova%2C+Fedor+Splitt%2C+Simon+Ostermann%2C+Sebastian+M%C3%B6ller%2C+and+Vera+Schmitt%2E+2026a%2E+Can+large+language+models+still+explain+themselves%3F+investigating+the+impact+of+qua)
64. Qianli Wang, Nils Feldhus, Simon Ostermann, Luis Felipe Villa-Arenas, Sebastian Möller, and Vera Schmitt. 2025b. FitCF: A framework for automatic feature importance-guided counterfactual example generation. In Findings of the Association for Computational Linguistics: ACL 2025, pages 1176–1191, Vien… [find](https://scholar.google.com/scholar?q=Qianli+Wang%2C+Nils+Feldhus%2C+Simon+Ostermann%2C+Luis+Felipe+Villa%2DArenas%2C+Sebastian+M%C3%B6ller%2C+and+Vera+Schmitt%2E+2025b%2E+FitCF%3A+A+framework+for+automatic+feature+importance%2Dguided+counterfactual+example+gener)
65. Qianli Wang, Van Bach Nguyen, Nils Feldhus, Luis Felipe Villa-Arenas, Christin Seifert, Sebastian Möller, and Vera Schmitt. 2025c. Truth or twist? optimal model selection for reliable label flipping evaluation in llm-based counterfactuals. In Proceedings of the 18th International Natural Language Ge… [find](https://scholar.google.com/scholar?q=Qianli+Wang%2C+Van+Bach+Nguyen%2C+Nils+Feldhus%2C+Luis+Felipe+Villa%2DArenas%2C+Christin+Seifert%2C+Sebastian+M%C3%B6ller%2C+and+Vera+Schmitt%2E+2025c%2E+Truth+or+twist%3F+optimal+model+selection+for+reliable+label+flipping+e)
66. Yilong Wang, Qianli Wang, and Nils Feldhus. 2026b. iflip: Iterative feedback-driven counterfactual example refinement. Preprint, arXiv:2601.01446. — [arXiv:2601.01446](https://arxiv.org/abs/2601.01446) [find](https://scholar.google.com/scholar?q=Yilong+Wang%2C+Qianli+Wang%2C+and+Nils+Feldhus%2E+2026b%2E+iflip%3A+Iterative+feedback%2Ddriven+counterfactual+example+refinement%2E+Preprint%2C+arXiv%3A2601%2E01446%2E+%E2%80%94+%5BarXiv%3A2601%2E01446%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2601%2E01446)
67. Yongjie Wang, Xiaoqi Qiu, Yu Yue, Xu Guo, Zhiwei Zeng, Yuhong Feng, and Zhiqi Shen. 2024. A survey on natural language counterfactual generation. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 4798–4818, Miami, Florida, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Yongjie+Wang%2C+Xiaoqi+Qiu%2C+Yu+Yue%2C+Xu+Guo%2C+Zhiwei+Zeng%2C+Yuhong+Feng%2C+and+Zhiqi+Shen%2E+2024%2E+A+survey+on+natural+language+counterfactual+generation%2E+In+Findings+of+the+Association+for+Computational+Lingu)
68. Dawei Zhu, Michael A. Hedderich, Fangzhou Zhai, David Ifeoluwa Adelani, and Dietrich Klakow. 2022. Is BERT robust to label noise? a study on learning with noisy labels in text classification. In Proceedings of the Third Workshop on Insights from Negative Results in NLP, pages 62–67, Dublin, Ireland.… [find](https://scholar.google.com/scholar?q=Dawei+Zhu%2C+Michael+A%2E+Hedderich%2C+Fangzhou+Zhai%2C+David+Ifeoluwa+Adelani%2C+and+Dietrich+Klakow%2E+2022%2E+Is+BERT+robust+to+label+noise%3F+a+study+on+learning+with+noisy+labels+in+text+classification%2E+In+Proce)
69. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed H. Chi, Quoc V. Le, and Denny Zhou. 2022. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). In Proceedings of the 36th International Conference on Neural Information Processing Systems, NIPS ’22, R…
70. Terry Yue Zhuo, Qiongkai Xu, Xuanli He, and Trevor Cohn. 2023. Rethinking round-trip translation for machine translation evaluation. In Findings of the Association for Computational Linguistics: ACL 2023, pages 319–337, Toronto, Canada. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Terry+Yue+Zhuo%2C+Qiongkai+Xu%2C+Xuanli+He%2C+and+Trevor+Cohn%2E+2023%2E+Rethinking+round%2Dtrip+translation+for+machine+translation+evaluation%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+ACL+2)
71. Adina Williams, Nikita Nangia, and Samuel Bowman. 2018. [A broad-coverage challenge corpus for sentence understanding through inference](https://md.research.elamur.ai/free/en/papers/williams-2018-broad-coverage-challenge-corpus-sentence/). In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Pa…
72. Tongshuang Wu, Marco Tulio Ribeiro, Jeffrey Heer, and Daniel Weld. 2021. [Polyjuice: Generating counterfactuals for explaining, evaluating, and improving models](https://md.research.elamur.ai/free/en/papers/wu-2021-polyjuice-generating-counterfactuals-explaining-evaluating/). In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on N…
73. Biao Zhang, Barry Haddow, and Alexandra Birch. 2023a. [Prompting large language model for machine translation: a case study](https://md.research.elamur.ai/free/en/papers/zhang-2023-prompting-large-language-model-machine/). In Proceedings of the 40th International Conference on Machine Learning, ICML’23. JMLR.org.
74. Xiang Zhang, Senyu Li, Bradley Hauer, Ning Shi, and Grzegorz Kondrak. 2023b. Don’t trust ChatGPT when your question is not in English: A study of multilingual abilities and types of LLMs. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 7915–7927, Sing… [find](https://scholar.google.com/scholar?q=Xiang+Zhang%2C+Senyu+Li%2C+Bradley+Hauer%2C+Ning+Shi%2C+and+Grzegorz+Kondrak%2E+2023b%2E+Don%E2%80%99t+trust+ChatGPT+when+your+question+is+not+in+English%3A+A+study+of+multilingual+abilities+and+types+of+LLMs%2E+In+Proceedin)
75. Haiyan Zhao, Hanjie Chen, Fan Yang, Ninghao Liu, Huiqi Deng, Hengyi Cai, Shuaiqiang Wang, Dawei Yin, and Mengnan Du. 2024. [Explainability for large language models: A survey](https://md.research.elamur.ai/free/en/papers/zhao-2023-explainability-large-language-models-survey/). ACM Trans. Intell. Syst. Technol., 15(2).
76. Zhixue Zhao and Nikolaos Aletras. 2024. Comparing explanation faithfulness between multilingual and monolingual fine-tuned language models. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Lon… [find](https://scholar.google.com/scholar?q=Zhixue+Zhao+and+Nikolaos+Aletras%2E+2024%2E+Comparing+explanation+faithfulness+between+multilingual+and+monolingual+fine%2Dtuned+language+models%2E+In+Proceedings+of+the+2024+Conference+of+the+North+American+)

*Updated 1 November 2026*