---
title: "Improving the OOD Performance of Closed-Source LLMs on NLI"
description: "Fine-tuning LLMs for Natural Language Inference (NLI) raises in-distribution accuracy but often lowers… 125 references, cited by 1 paper here."
authors: ["Joe Stacey", "Lisa Alazraki", "Aran Ubhi", "Beyza Ermis", "Aaron Mueller", "Marek Rei"]
year: 2026
venue: "Findings of the Association for Computational Linguistics: EACL 2026"
source: "https://aclanthology.org/2026.findings-eacl.286/"
doi: "10.18653/v1/2026.findings-eacl.286"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/stacey-2026-improving-ood-performance-closed-source/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/stacey-2026-improving-ood-performance-closed-source/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/13/) / Improving the OOD Performance of Closed-Source LLMs on NLI Through Strategic Data Selection

# Improving the OOD Performance of Closed-Source LLMs on NLI Through Strategic Data Selection

**Authors:** [Joe Stacey](https://md.research.elamur.ai/free/en/authors/joe-stacey/), Lisa Alazraki, Aran Ubhi, [Beyza Ermis](https://md.research.elamur.ai/free/en/authors/beyza-ermis/), [Aaron Mueller](https://md.research.elamur.ai/free/en/authors/aaron-mueller/) and [Marek Rei](https://md.research.elamur.ai/free/en/authors/marek-rei/) · **Year:** 2026 · **Venue:** [Findings of the Association for Computational Linguistics: EACL 2026](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.findings-eacl.286/) · [PDF](https://aclanthology.org/2026.findings-eacl.286.pdf) · [DOI 10.18653/v1/2026.findings-eacl.286](https://doi.org/10.18653/v1/2026.findings-eacl.286) · [OpenAlex](https://openalex.org/W7140144739)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · [1](https://md.research.elamur.ai/free/en/papers/stacey-2026-improving-ood-performance-closed-source/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Fine-tuning LLMs for Natural Language Inference (NLI) raises in-distribution accuracy but often lowers out-of-distribution (OOD) accuracy. Existing robustness fixes require changes to the training procedure or large-scale data augmentation. Neither is practical for closed-source models that can only be fine-tuned through an API. The authors therefore keep a fixed budget of 10,000 training instances and test data-centric strategies that only change which examples go into it.

They try two families of methods:
- **Selecting harder SNLI/MNLI examples**, using uncertainty, LLM-assigned difficulty scores, misclassifications, or concatenated hypotheses.
- **Swapping part of the training set for LLM-generated examples** from other domains.

They evaluate both on Standard-OOD and Challenge-OOD benchmarks with GPT-4o-mini, Gemini and Command R. Harder real examples help mainly on challenging OOD sets. Synthetic data helps mainly on easier OOD sets, partly because generated items tend to be too simple. Prompting the generator for longer, more complex items improves results on both kinds of OOD data. The study also finds that autoregressive LLMs are far more robust than encoder models, so it argues they should replace encoders as baselines.

## Key points
- The fixed budget is 10,000 instances, and one GPT-4o-mini fine-tuning run costs roughly $5. Training data comes from SNLI or MNLI. Uncertainty Sampling requires output probabilities, which were available only for GPT-4o-mini.
- Average LLM-rated difficulty differs by data source:

  | Data source | Difficulty | Annotation errors |
  |---|---|---|
  | Original SNLI data | 3.84 | 4% |
  | Short & Simple Generation | 3.40 | 4% |
  | Long & Complex Generation | 4.52 | 12% |

- Generating synthetic data for a test set's own domains (MNLI Domains Generation) brought no extra gain on that test set. Its improvement was even larger on MNLI-mismatched than on MNLI-matched.
- Fine-tuned LLMs beat encoder models such as RoBERTa and DeBERTa on OOD NLI, even when trained on less than 2% of the data.
- Code is released at github.com/joestacey/LLM_robustness_NLI. A preliminary Uncertainty Sampling test on mathematics datasets suggests the approach may carry over to other tasks.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Sheffield](https://md.research.elamur.ai/free/en/universities/university-of-sheffield/) — University, Sheffield, United Kingdom · 113 works · 21,542 citations
- [Imperial College London](https://md.research.elamur.ai/free/en/universities/imperial-college-london/) — University, London, United Kingdom · 48 works · 12,181 citations
- [Boston University](https://md.research.elamur.ai/free/en/universities/boston-university/) — University, Boston, United States · 26 works · 4,022 citations
- [Cohere](https://md.research.elamur.ai/free/en/companies/cohere/) — Company, San Francisco, United States · 15 works · 1,223 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

🧭 Topics (1): [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 1,426 works

## Cite

Cite as: Joe Stacey, Lisa Alazraki, Aran Ubhi, Beyza Ermis, Aaron Mueller and Marek Rei. 2026. Improving the OOD Performance of Closed-Source LLMs on NLI Through Strategic Data Selection. Findings of the Association for Computational Linguistics: EACL 2026.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{stacey2026improving,
  title = {{Improving the OOD Performance of Closed-Source LLMs on NLI Through Strategic Data Selection}},
  author = {Joe Stacey, Lisa Alazraki, Aran Ubhi, Beyza Ermis, Aaron Mueller and Marek Rei},
  booktitle = {Findings of the Association for Computational Linguistics: EACL 2026},
  year = {2026},
  doi = {10.18653/v1/2026.findings-eacl.286},
  url = {https://doi.org/10.18653/v1/2026.findings-eacl.286}
}
```

- [← previous Improving Public Health Safety in Low-Resource Languages Using a Human-Verified Health Misinformation Corpus and Large Language Models](https://md.research.elamur.ai/free/en/papers/maharjan-2026-improving-public-health-safety-low/)
- [next → In Generative AI We (Dis)Trust? Computational Analysis of Trust and Distrust in Reddit Discussions](https://md.research.elamur.ai/free/en/papers/pessianzadeh-2026-generative-ai-we-dis-trust/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/13/)

## References

125 references, 40 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Toufique Ahmed, Premkumar T. Devanbu, Christoph Treude, and Michael Pradel. 2024. Can llms replace manual annotation of software engineering artifacts? CoRR, abs/2408.05534. — [arXiv:2408.05534](https://arxiv.org/abs/2408.05534) [find](https://scholar.google.com/scholar?q=Toufique+Ahmed%2C+Premkumar+T%2E+Devanbu%2C+Christoph+Treude%2C+and+Michael+Pradel%2E+2024%2E+Can+llms+replace+manual+annotation+of+software+engineering+artifacts%3F+CoRR%2C+abs%2F2408%2E05534%2E+%E2%80%94+%5BarXiv%3A2408%2E05534%5D%28https)
2. Meysam Alizadeh, Maël Kubli, Zeynab Samei, Shirin Dehghani, Mohammadmasiha Zahedivafa, Juan Diego Bermeo, Maria Korobeynikova, and Fabrizio Gilardi. 2025. Open-source llms for text annotation: a practical guide for model setting and fine-tuning. J. Comput. Soc. Sci., 8(1):17. [find](https://scholar.google.com/scholar?q=Meysam+Alizadeh%2C+Ma%C3%ABl+Kubli%2C+Zeynab+Samei%2C+Shirin+Dehghani%2C+Mohammadmasiha+Zahedivafa%2C+Juan+Diego+Bermeo%2C+Maria+Korobeynikova%2C+and+Fabrizio+Gilardi%2E+2025%2E+Open%2Dsource+llms+for+text+annotation%3A+a+pract)
3. Dhananjay Ashok and Jonathan May. 2024. A little human data goes a long way. arXiv preprint arXiv:2410.13098. [find](https://scholar.google.com/scholar?q=Dhananjay+Ashok+and+Jonathan+May%2E+2024%2E+A+little+human+data+goes+a+long+way%2E+arXiv+preprint+arXiv%3A2410%2E13098%2E)
4. Laura Banarescu, Claire Bonial, Shu Cai, Madalina Georgescu, Kira Griffitt, Ulf Hermjakob, Kevin Knight, Philipp Koehn, Martha Palmer, and Nathan Schneider. 2013. [Abstract Meaning Representation for sembanking](https://md.research.elamur.ai/free/en/papers/banarescu-2013-abstract-meaning-representation-sembanking/). In Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discou…
5. Sourav Banerjee, Anush Mahajan, Ayushi Agarwal, and Eishkaran Singh. 2024. First train to generate, then generate to train: Unitedsynt5 for few-shot NLI. CoRR, abs/2412.09263. — [arXiv:2412.09263](https://arxiv.org/abs/2412.09263) [find](https://scholar.google.com/scholar?q=Sourav+Banerjee%2C+Anush+Mahajan%2C+Ayushi+Agarwal%2C+and+Eishkaran+Singh%2E+2024%2E+First+train+to+generate%2C+then+generate+to+train%3A+Unitedsynt5+for+few%2Dshot+NLI%2E+CoRR%2C+abs%2F2412%2E09263%2E+%E2%80%94+%5BarXiv%3A2412%2E09263%5D%28htt)
6. Yujia Bao and Regina Barzilay. 2022. Learning to split for automatic bias detection. CoRR, abs/2204.13749. [find](https://scholar.google.com/scholar?q=Yujia+Bao+and+Regina+Barzilay%2E+2022%2E+Learning+to+split+for+automatic+bias+detection%2E+CoRR%2C+abs%2F2204%2E13749%2E)
7. Yujia Bao, Shiyu Chang, and Regina Barzilay. 2021. Predict then interpolate: A simple algorithm to learn stable classifiers. In Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event, volume 139 of Proceedings of Machine Learning Research, pag… [find](https://scholar.google.com/scholar?q=Yujia+Bao%2C+Shiyu+Chang%2C+and+Regina+Barzilay%2E+2021%2E+Predict+then+interpolate%3A+A+simple+algorithm+to+learn+stable+classifiers%2E+In+Proceedings+of+the+38th+International+Conference+on+Machine+Learning%2C+IC)
8. Yonatan Belinkov, Adam Poliak, Stuart Shieber, Benjamin Van Durme, and Alexander Rush. 2019a. [Don‘t take the premise for granted: Mitigating artifacts in natural language inference](https://md.research.elamur.ai/free/en/papers/belinkov-2019-don-t-take-premise-granted/). In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 877–891, Florence, I…
9. Yonatan Belinkov, Adam Poliak, Stuart Shieber, Benjamin Van Durme, and Alexander Rush. 2019b. [On adversarial removal of hypothesis-only bias in natural language inference](https://md.research.elamur.ai/free/en/papers/belinkov-2019-adversarial-removal-hypothesis-only-bias/). In Proceedings of the Eighth Joint Conference on Lexical and Computational Semantics (*SEM 2019), pages 256–262, Minneapolis, Mi…
10. Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, and 12 others. 2020. [Language models are few-shot learners](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/). In Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual.
11. Nitay Calderon, Roi Reichart, and Rotem Dror. 2025. [The alternative annotator test for llm-as-a-judge: How to statistically justify replacing human annotators with llms](https://md.research.elamur.ai/free/en/papers/calderon-2025-alternative-annotator-test-llm-as/). CoRR, abs/2501.10970.
12. Oana-Maria Camburu, Tim Rocktäschel, Thomas Lukasiewicz, and Phil Blunsom. 2018. [e-snli: Natural language inference with natural language explanations](https://md.research.elamur.ai/free/en/papers/camburu-2018-e-snli-natural-language-inference/). In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3-8…
13. Zeming Chen, Qiyue Gao, Antoine Bosselut, Ashish Sabharwal, and Kyle Richardson. 2023. DISCO: Distilling counterfactuals with large language models. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 5514–5528, Toronto, Canada. A… [find](https://scholar.google.com/scholar?q=Zeming+Chen%2C+Qiyue+Gao%2C+Antoine+Bosselut%2C+Ashish+Sabharwal%2C+and+Kyle+Richardson%2E+2023%2E+DISCO%3A+Distilling+counterfactuals+with+large+language+models%2E+In+Proceedings+of+the+61st+Annual+Meeting+of+the+As)
14. Lukas Berglund, Meg Tong, Maximilian Kaufmann, Mikita Balesni, Asa Cooper Stickland, Tomasz Korbak, and Owain Evans. 2024. The reversal curse: Llms trained on "a is b" fail to learn "b is a". In The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2… [find](https://scholar.google.com/scholar?q=Lukas+Berglund%2C+Meg+Tong%2C+Maximilian+Kaufmann%2C+Mikita+Balesni%2C+Asa+Cooper+Stickland%2C+Tomasz+Korbak%2C+and+Owain+Evans%2E+2024%2E+The+reversal+curse%3A+Llms+trained+on+%22a+is+b%22+fail+to+learn+%22b+is+a%22%2E+In+The+T)
15. Jiali Cheng and Hadi Amiri. 2024. FairFlow: Mitigating dataset biases through undecided learning for natural language understanding. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 21960–21975, Miami, Florida, USA. Association for Computational Lingui… [find](https://scholar.google.com/scholar?q=Jiali+Cheng+and+Hadi+Amiri%2E+2024%2E+FairFlow%3A+Mitigating+dataset+biases+through+undecided+learning+for+natural+language+understanding%2E+In+Proceedings+of+the+2024+Conference+on+Empirical+Methods+in+Natur)
16. Samuel R. Bowman, Gabor Angeli, Christopher Potts, and Christopher D. Manning. 2015. [A large annotated corpus for learning natural language inference](https://md.research.elamur.ai/free/en/papers/bowman-2015-large-annotated-corpus-learning-natural/). In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 632–642, Lisbon, Portugal. Association for Computati…
17. Christopher Clark, Mark Yatskar, and Luke Zettlemoyer. 2019. Don‘t take the easy way out: Ensemble based methods for avoiding known dataset biases. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language… [find](https://scholar.google.com/scholar?q=Christopher+Clark%2C+Mark+Yatskar%2C+and+Luke+Zettlemoyer%2E+2019%2E+Don%E2%80%98t+take+the+easy+way+out%3A+Ensemble+based+methods+for+avoiding+known+dataset+biases%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+M)
18. Ronan Le Bras, Swabha Swayamdipta, Chandra Bhagavatula, Rowan Zellers, Matthew E. Peters, Ashish Sabharwal, and Yejin Choi. 2020. Adversarial filters of dataset biases. In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event, volume 119 of P… [find](https://scholar.google.com/scholar?q=Ronan+Le+Bras%2C+Swabha+Swayamdipta%2C+Chandra+Bhagavatula%2C+Rowan+Zellers%2C+Matthew+E%2E+Peters%2C+Ashish+Sabharwal%2C+and+Yejin+Choi%2E+2020%2E+Adversarial+filters+of+dataset+biases%2E+In+Proceedings+of+the+37th+Inte)
19. Ana Brassard, Benjamin Heinzerling, Pride Kavumba, and Kentaro Inui. 2022. COPA-SSE: Semi-structured explanations for commonsense reasoning. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 3994–4000, Marseille, France. European Language Resources Association. [find](https://scholar.google.com/scholar?q=Ana+Brassard%2C+Benjamin+Heinzerling%2C+Pride+Kavumba%2C+and+Kentaro+Inui%2E+2022%2E+COPA%2DSSE%3A+Semi%2Dstructured+explanations+for+commonsense+reasoning%2E+In+Proceedings+of+the+Thirteenth+Language+Resources+and+Eva)
20. Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Christopher Clark, Mark Yatskar, and Luke Zettlemoyer. 2020. L… [find](https://scholar.google.com/scholar?q=Tom+B%2E+Brown%2C+Benjamin+Mann%2C+Nick+Ryder%2C+Melanie+Subbiah%2C+Jared+Kaplan%2C+Prafulla+Dhariwal%2C+Arvind+Neelakantan%2C+Pranav+Shyam%2C+Girish+Sastry%2C+Amanda+Askell%2C+Sandhini+Agarwal%2C+Ariel+Herbert%2DVoss%2C+Gretche)
21. Team Cohere, :, Aakanksha, Arash Ahmadian, Marwan Ahmed, Jay Alammar, Milad Alizadeh, Yazeed Alnumay, Sophia Althammer, Arkady Arkhangorodsky, Viraat Aryabumi, Dennis Aumiller, Raphaël Avalos, Zahara Aviv, Sammie Bae, Saurabh Baji, Alexandre Barbet, Max Bartolo, Björn Bebensee, and 211 others. 2025.… — [arXiv:2504.00698](https://arxiv.org/abs/2504.00698) [find](https://scholar.google.com/scholar?q=Team+Cohere%2C+%3A%2C+Aakanksha%2C+Arash+Ahmadian%2C+Marwan+Ahmed%2C+Jay+Alammar%2C+Milad+Alizadeh%2C+Yazeed+Alnumay%2C+Sophia+Althammer%2C+Arkady+Arkhangorodsky%2C+Viraat+Aryabumi%2C+Dennis+Aumiller%2C+Rapha%C3%ABl+Avalos%2C+Zahara+)
22. Adrian Cosma, Stefan Ruseti, Mihai Dascalu, and Cornelia Caragea. 2024. [How hard is this test set? NLI characterization by exploiting training dynamics](https://md.research.elamur.ai/free/en/papers/cosma-2024-how-hard-is-this-test/).
23. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 2990–3001, Miami, Florida, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=In+Proceedings+of+the+2024+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+2990%E2%80%933001%2C+Miami%2C+Florida%2C+USA%2E+Association+for+Computational+Linguistics%2E)
24. Mengnan Du, Varun Manjunatha, Rajiv Jain, Ruchi Deshpande, Franck Dernoncourt, Jiuxiang Gu, Tong Sun, and Xia Hu. 2021. Towards interpreting and mitigating shortcut learning behavior of NLU models. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computation… [find](https://scholar.google.com/scholar?q=Mengnan+Du%2C+Varun+Manjunatha%2C+Rajiv+Jain%2C+Ruchi+Deshpande%2C+Franck+Dernoncourt%2C+Jiuxiang+Gu%2C+Tong+Sun%2C+and+Xia+Hu%2E+2021%2E+Towards+interpreting+and+mitigating+shortcut+learning+behavior+of+NLU+models%2E+In)
25. Mengnan Du, Subhabrata Mukherjee, Yu Cheng, Milad Shokouhi, Xia Hu, and Ahmed Hassan Awadallah. 2023a. Robustness challenges in model distillation and pruning for natural language understanding. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Lingui… [find](https://scholar.google.com/scholar?q=Mengnan+Du%2C+Subhabrata+Mukherjee%2C+Yu+Cheng%2C+Milad+Shokouhi%2C+Xia+Hu%2C+and+Ahmed+Hassan+Awadallah%2E+2023a%2E+Robustness+challenges+in+model+distillation+and+pruning+for+natural+language+understanding%2E+In+Pr)
26. Yanrui Du, Jing Yan, Yan Chen, Jing Liu, Sendong Zhao, Qiaoqiao She, Hua Wu, Haifeng Wang, and Bing Qin. 2023b. Less learn shortcut: Analyzing and mitigating learning of spurious feature-label correlation. In Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence,… [find](https://scholar.google.com/scholar?q=Yanrui+Du%2C+Jing+Yan%2C+Yan+Chen%2C+Jing+Liu%2C+Sendong+Zhao%2C+Qiaoqiao+She%2C+Hua+Wu%2C+Haifeng+Wang%2C+and+Bing+Qin%2E+2023b%2E+Less+learn+shortcut%3A+Analyzing+and+mitigating+learning+of+spurious+feature%2Dlabel+correla)
27. Bradley Efron and R Tibshirani. 1993. An introduction to the bootstrap. [find](https://scholar.google.com/scholar?q=Bradley+Efron+and+R+Tibshirani%2E+1993%2E+An+introduction+to+the+bootstrap%2E)
28. Bofei Gao, Feifan Song, Zhe Yang, Zefan Cai, Yibo Miao, Qingxiu Dong, Lei Li, Chenghao Ma, Liang Chen, Runxin Xu, Zhengyang Tang, Benyou Wang, Daoguang Zan, Shanghaoran Quan, Ge Zhang, Lei Sha, Yichang Zhang, Xuancheng Ren, Tianyu Liu, and Baobao Chang. 2025. [Omni-MATH: A universal olympiad level ma…](https://md.research.elamur.ai/free/en/papers/gao-2024-omni-math-universal-olympiad-level/)
29. Matt Gardner, William Merrill, Jesse Dodge, Matthew Peters, Alexis Ross, Sameer Singh, and Noah A. Smith. 2021. Competency problems: On finding and removing artifacts in language data. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 1801–1813, Online… [find](https://scholar.google.com/scholar?q=Matt+Gardner%2C+William+Merrill%2C+Jesse+Dodge%2C+Matthew+Peters%2C+Alexis+Ross%2C+Sameer+Singh%2C+and+Noah+A%2E+Smith%2E+2021%2E+Competency+problems%3A+On+finding+and+removing+artifacts+in+language+data%2E+In+Proceedings+)
30. Abbas Ghaddar, Phillippe Langlais, Mehdi Rezagholizadeh, and Ahmad Rashid. 2021. End-to-end self-debiasing framework for robust NLU training. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 1923–1929, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Abbas+Ghaddar%2C+Phillippe+Langlais%2C+Mehdi+Rezagholizadeh%2C+and+Ahmad+Rashid%2E+2021%2E+End%2Dto%2Dend+self%2Ddebiasing+framework+for+robust+NLU+training%2E+In+Findings+of+the+Association+for+Computational+Linguisti)
31. Fabrizio Gilardi, Meysam Alizadeh, and Maël Kubli. 2023. [Chatgpt outperforms crowd-workers for text-annotation tasks](https://md.research.elamur.ai/free/en/papers/gilardi-2023-chatgpt-outperforms-crowd-workers-text/). CoRR, abs/2303.15056.
32. Andrew Gordon, Zornitsa Kozareva, and Melissa Roemmele. 2012. [SemEval-2012 task 7: Choice of plausible alternatives: An evaluation of commonsense causal reasoning](https://md.research.elamur.ai/free/en/papers/gordon-2012-semeval-2012-task-7-choice/). In *SEM 2012: The First Joint Conference on Lexical and Computational Semantics – Volume 1: Proceedings of the main conference and the s…
33. Xu Guo, Zilin Du, Boyang Li, and Chunyan Miao. 2024. Generating synthetic datasets for few-shot prompt tuning. CoRR, abs/2410.10865. — [arXiv:2410.10865](https://arxiv.org/abs/2410.10865) [find](https://scholar.google.com/scholar?q=Xu+Guo%2C+Zilin+Du%2C+Boyang+Li%2C+and+Chunyan+Miao%2E+2024%2E+Generating+synthetic+datasets+for+few%2Dshot+prompt+tuning%2E+CoRR%2C+abs%2F2410%2E10865%2E+%E2%80%94+%5BarXiv%3A2410%2E10865%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2410%2E10865%29)
34. Suchin Gururangan, Swabha Swayamdipta, Omer Levy, Roy Schwartz, Samuel Bowman, and Noah A. Smith. 2018. [Annotation artifacts in natural language inference data](https://md.research.elamur.ai/free/en/papers/gururangan-2018-annotation-artifacts-natural-language-inference/). In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Techno…
35. Md Akmal Haidar, Mehdi Rezagholizadeh, Abbas Ghaddar, Khalil Bibi, Phillippe Langlais, and Pascal Poupart. 2022. CILDA: Contrastive data augmentation using intermediate layer knowledge distillation. In Proceedings of the 29th International Conference on Computational Linguistics, pages 4707– 4713, G… [find](https://scholar.google.com/scholar?q=Md+Akmal+Haidar%2C+Mehdi+Rezagholizadeh%2C+Abbas+Ghaddar%2C+Khalil+Bibi%2C+Phillippe+Langlais%2C+and+Pascal+Poupart%2E+2022%2E+CILDA%3A+Contrastive+data+augmentation+using+intermediate+layer+knowledge+distillation%2E+I)
36. Shreya Havaldar, Hamidreza Alvari, John Palowitch, Mohammad Javad Hosseini, Senaka Buthpitiya, and Alex Fabrikant. 2025. [Entailed between the lines: Incorporating implication into nli](https://md.research.elamur.ai/free/en/papers/havaldar-2025-entailed-between-lines-incorporating-implication/). Preprint, arXiv:2501.07719.
37. Chaoqun He, Renjie Luo, Yuzhuo Bai, Shengding Hu, Zhen Thai, Junhao Shen, Jinyi Hu, Xu Han, Yujie Huang, Yuxiang Zhang, Jie Liu, Lei Qi, Zhiyuan Liu, and Maosong Sun. 2024a. [OlympiadBench: A challenging benchmark for promoting AGI with olympiad-level bilingual multimodal scientific problems](https://md.research.elamur.ai/free/en/papers/he-2024-olympiadbench-challenging-benchmark-promoting-agi/). In Proc…
38. He He, Sheng Zha, and Haohan Wang. 2019. [Unlearn dataset bias in natural language inference by fitting the residual](https://md.research.elamur.ai/free/en/papers/he-2019-unlearn-dataset-bias-natural-language/). In Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019), pages 132–142, Hong Kong, China. Association for Computational Linguistics.
39. Pengcheng He, Jianfeng Gao, and Weizhu Chen. 2023a. [Debertav3: Improving deberta using electra-style pre-training with gradient-disentangled embedding sharing](https://md.research.elamur.ai/free/en/papers/he-2021-debertav3-improving-deberta-using-electra/). In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net.
40. Pengcheng He, Xiaodong Liu, Jianfeng Gao, and Weizhu Chen. 2021. [Deberta: decoding-enhanced bert with disentangled attention](https://md.research.elamur.ai/free/en/papers/he-2020-deberta-decoding-enhanced-bert-disentangled/). In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net.
41. Xuanli He, Yuxiang Wu, Oana-Maria Camburu, Pasquale Minervini, and Pontus Stenetorp. 2024b. Using natural language explanations to improve robustness of in-context learning. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1347… [find](https://scholar.google.com/scholar?q=Xuanli+He%2C+Yuxiang+Wu%2C+Oana%2DMaria+Camburu%2C+Pasquale+Minervini%2C+and+Pontus+Stenetorp%2E+2024b%2E+Using+natural+language+explanations+to+improve+robustness+of+in%2Dcontext+learning%2E+In+Proceedings+of+the+62nd)
42. Zexue He, Marco Tulio Ribeiro, and Fereshte Khani. 2023b. Targeted data generation: Finding and fixing model weaknesses. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 8506– 8520, Toronto, Canada. Association for Computationa… [find](https://scholar.google.com/scholar?q=Zexue+He%2C+Marco+Tulio+Ribeiro%2C+and+Fereshte+Khani%2E+2023b%2E+Targeted+data+generation%3A+Finding+and+fixing+model+weaknesses%2E+In+Proceedings+of+the+61st+Annual+Meeting+of+the+Association+for+Computational+)
43. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation, 9(8):1735– 1780. [find](https://scholar.google.com/scholar?q=Sepp+Hochreiter+and+J%C3%BCrgen+Schmidhuber%2E+1997%2E+Long+short%2Dterm+memory%2E+Neural+computation%2C+9%288%29%3A1735%E2%80%93+1780%2E)
44. Ukyo Honda, Tatsushi Oka, Peinan Zhang, and Masato Mita. 2024. Not eliminate but aggregate: Post-hoc control over mixture-of-experts to address shortcut shifts in natural language understanding. Transactions of the Association for Computational Linguistics, 12:1268–1289. [find](https://scholar.google.com/scholar?q=Ukyo+Honda%2C+Tatsushi+Oka%2C+Peinan+Zhang%2C+and+Masato+Mita%2E+2024%2E+Not+eliminate+but+aggregate%3A+Post%2Dhoc+control+over+mixture%2Dof%2Dexperts+to+address+shortcut+shifts+in+natural+language+understanding%2E+Trans)
45. Mohammad Javad Hosseini, Andrey Petrov, Alex Fabrikant, and Annie Louis. 2024. A synthetic data approach for domain generalization of NLI models. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2212–2226, Bangkok, Thailand. As… [find](https://scholar.google.com/scholar?q=Mohammad+Javad+Hosseini%2C+Andrey+Petrov%2C+Alex+Fabrikant%2C+and+Annie+Louis%2E+2024%2E+A+synthetic+data+approach+for+domain+generalization+of+NLI+models%2E+In+Proceedings+of+the+62nd+Annual+Meeting+of+the+Assoc)
46. Jucheng Hu, Surong Yang, Lijun Wu, and Dongzhan Zhou. 2025. Donod: Efficient and generalizable instruction fine-tuning for llms via model-intrinsic dataset pruning. Preprint, arXiv:2504.14810. — [arXiv:2504.14810](https://arxiv.org/abs/2504.14810) [find](https://scholar.google.com/scholar?q=Jucheng+Hu%2C+Surong+Yang%2C+Lijun+Wu%2C+and+Dongzhan+Zhou%2E+2025%2E+Donod%3A+Efficient+and+generalizable+instruction+fine%2Dtuning+for+llms+via+model%2Dintrinsic+dataset+pruning%2E+Preprint%2C+arXiv%3A2504%2E14810%2E+%E2%80%94+%5BarXi)
47. Badr Youbi Idrissi, Martín Arjovsky, Mohammad Pezeshki, and David Lopez-Paz. 2021. Simple data balancing achieves competitive worst-group-accuracy. CoRR, abs/2110.14503. — [arXiv:2110.14503](https://arxiv.org/abs/2110.14503) [find](https://scholar.google.com/scholar?q=Badr+Youbi+Idrissi%2C+Mart%C3%ADn+Arjovsky%2C+Mohammad+Pezeshki%2C+and+David+Lopez%2DPaz%2E+2021%2E+Simple+data+balancing+achieves+competitive+worst%2Dgroup%2Daccuracy%2E+CoRR%2C+abs%2F2110%2E14503%2E+%E2%80%94+%5BarXiv%3A2110%2E14503%5D%28https%3A%2F%2Fa)
48. Aref Jafari, Mehdi Rezagholizadeh, Pranav Sharma, and Ali Ghodsi. 2021. Annealing knowledge distillation. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 2493–2504, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Aref+Jafari%2C+Mehdi+Rezagholizadeh%2C+Pranav+Sharma%2C+and+Ali+Ghodsi%2E+2021%2E+Annealing+knowledge+distillation%2E+In+Proceedings+of+the+16th+Conference+of+the+European+Chapter+of+the+Association+for+Computati)
49. Marek Kadlčík, Michal Štefánik, Ondřej Sotolář, and Vlastimil Martinek. 2023. Calc-x and calcformers: Empowering arithmetical chain-of-thought through interaction with symbolic systems. In Proceedings of the The 2023 Conference on Empirical Methods in Natural Language Processing: Main track, Sing… [find](https://scholar.google.com/scholar?q=Marek+Kadlc%CC%8C%C3%ADk%2C+Michal+%C5%A0tef%C3%A1nik%2C+Ondr%CC%8Cej+Sotol%C3%A1r%CC%8C%2C+and+Vlastimil+Martinek%2E+2023%2E+Calc%2Dx+and+calcformers%3A+Empowering+arithmetical+chain%2Dof%2Dthought+through+interaction+with+symbolic+systems%2E+In+Proceedi)
50. Aikaterini-Lida Kalouli, Richard Crouch, and Valeria de Paiva. 2020. Hy-NLI: a hybrid system for natural language inference. In Proceedings of the 28th International Conference on Computational Linguistics, pages 5235–5249, Barcelona, Spain (Online). International Committee on Computational Linguist… [find](https://scholar.google.com/scholar?q=Aikaterini%2DLida+Kalouli%2C+Richard+Crouch%2C+and+Valeria+de+Paiva%2E+2020%2E+Hy%2DNLI%3A+a+hybrid+system+for+natural+language+inference%2E+In+Proceedings+of+the+28th+International+Conference+on+Computational+Lingui)
51. Divyansh Kaushik, Eduard H. Hovy, and Zachary Chase Lipton. 2020. Learning the difference that makes A difference with counterfactually-augmented data. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenReview.net. [find](https://scholar.google.com/scholar?q=Divyansh+Kaushik%2C+Eduard+H%2E+Hovy%2C+and+Zachary+Chase+Lipton%2E+2020%2E+Learning+the+difference+that+makes+A+difference+with+counterfactually%2Daugmented+data%2E+In+8th+International+Conference+on+Learning+Repr)
52. Pride Kavumba, Naoya Inoue, Benjamin Heinzerling, Keshav Singh, Paul Reisert, and Kentaro Inui. 2019. When choosing plausible alternatives, clever hans can be clever. In Proceedings of the First Workshop on Commonsense Inference in Natural Language Processing, pages 33–42, Hong Kong, China. Associat… [find](https://scholar.google.com/scholar?q=Pride+Kavumba%2C+Naoya+Inoue%2C+Benjamin+Heinzerling%2C+Keshav+Singh%2C+Paul+Reisert%2C+and+Kentaro+Inui%2E+2019%2E+When+choosing+plausible+alternatives%2C+clever+hans+can+be+clever%2E+In+Proceedings+of+the+First+Works)
53. Tushar Khot, Ashish Sabharwal, and Peter Clark. 2018. Scitail: A textual entailment dataset from science question answering. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th A… [find](https://scholar.google.com/scholar?q=Tushar+Khot%2C+Ashish+Sabharwal%2C+and+Peter+Clark%2E+2018%2E+Scitail%3A+A+textual+entailment+dataset+from+science+question+answering%2E+In+Proceedings+of+the+Thirty%2DSecond+AAAI+Conference+on+Artificial+Intellige)
54. Michalis Korakakis and Andreas Vlachos. 2023. Improving the robustness of NLI models with minimax training. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 14322–14339, Toronto, Canada. Association for Computational Linguistic… [find](https://scholar.google.com/scholar?q=Michalis+Korakakis+and+Andreas+Vlachos%2E+2023%2E+Improving+the+robustness+of+NLI+models+with+minimax+training%2E+In+Proceedings+of+the+61st+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28)
55. Michalis Korakakis, Andreas Vlachos, and Adrian Weller. 2025. Mitigating shortcut learning with InterpoLated learning. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 9191–9206, Vienna, Austria. Association for Computational L… [find](https://scholar.google.com/scholar?q=Michalis+Korakakis%2C+Andreas+Vlachos%2C+and+Adrian+Weller%2E+2025%2E+Mitigating+shortcut+learning+with+InterpoLated+learning%2E+In+Proceedings+of+the+63rd+Annual+Meeting+of+the+Association+for+Computational+Li)
56. Alexandros Koulakos, Maria Lymperaiou, Giorgos Filandrianos, and Giorgos Stamou. 2024. Enhancing adversarial robustness in natural language inference using explanations. In Proceedings of the 7th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP, pages 105–117, Miami, Florida,… [find](https://scholar.google.com/scholar?q=Alexandros+Koulakos%2C+Maria+Lymperaiou%2C+Giorgos+Filandrianos%2C+and+Giorgos+Stamou%2E+2024%2E+Enhancing+adversarial+robustness+in+natural+language+inference+using+explanations%2E+In+Proceedings+of+the+7th+Blac)
57. Sawan Kumar and Partha Talukdar. 2020. [NILE : Natural language inference with faithful natural language explanations](https://md.research.elamur.ai/free/en/papers/kumar-2020-nile-natural-language-inference-faithful/). In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 8730–8742, Online. Association for Computational Linguistics.
58. Andrew K. Lampinen, Arslan Chaudhry, Stephanie C. Y. Chan, Cody Wild, Diane Wan, Alex Ku, Jörg Bornschein, Razvan Pascanu, Murray Shanahan, and James L. McClelland. 2025. On the generalization of language models from in-context learning and finetuning: a controlled study. Preprint, arXiv:2505.00661. — [arXiv:2505.00661](https://arxiv.org/abs/2505.00661) [find](https://scholar.google.com/scholar?q=Andrew+K%2E+Lampinen%2C+Arslan+Chaudhry%2C+Stephanie+C%2E+Y%2E+Chan%2C+Cody+Wild%2C+Diane+Wan%2C+Alex+Ku%2C+J%C3%B6rg+Bornschein%2C+Razvan+Pascanu%2C+Murray+Shanahan%2C+and+James+L%2E+McClelland%2E+2025%2E+On+the+generalization+of+lang)
59. Mingyu Lee, Junho Kim, Jun-Hyung Park, and SangKeun Lee. 2025. Continual debiasing: A bias mitigation framework for natural language understanding systems. Expert Syst. Appl., 271:126593. [find](https://scholar.google.com/scholar?q=Mingyu+Lee%2C+Junho+Kim%2C+Jun%2DHyung+Park%2C+and+SangKeun+Lee%2E+2025%2E+Continual+debiasing%3A+A+bias+mitigation+framework+for+natural+language+understanding+systems%2E+Expert+Syst%2E+Appl%2E%2C+271%3A126593%2E)
60. Aitor Lewkowycz, Anders Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, Yuhuai Wu, Behnam Neyshabur, Guy Gur-Ari, and Vedant Misra. 2022. [Solving quantitative reasoning problems with language models](https://md.research.elamur.ai/free/en/papers/lewkowycz-2022-solving-quantitative-reasoning-problems-language/). In Proceedings of…
61. Tianda Li, Ahmad Rashid, Aref Jafari, Pranav Sharma, Ali Ghodsi, and Mehdi Rezagholizadeh. 2021. How to select one among all ? an empirical study towards the robustness of knowledge distillation in natural language understanding. In Findings of the Association for Computational Linguistics: EMNLP 20… [find](https://scholar.google.com/scholar?q=Tianda+Li%2C+Ahmad+Rashid%2C+Aref+Jafari%2C+Pranav+Sharma%2C+Ali+Ghodsi%2C+and+Mehdi+Rezagholizadeh%2E+2021%2E+How+to+select+one+among+all+%3F+an+empirical+study+towards+the+robustness+of+knowledge+distillation+in+na)
62. Hunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe. 2024. [Let’s verify step by step](https://md.research.elamur.ai/free/en/papers/lightman-2023-let-s-verify-step-step/). In The Twelfth International Conference on Learning Representations.
63. Wang Ling, Dani Yogatama, Chris Dyer, and Phil Blunsom. 2017. Program induction by rationale generation: Learning to solve and explain algebraic word problems. ACL. [find](https://scholar.google.com/scholar?q=Wang+Ling%2C+Dani+Yogatama%2C+Chris+Dyer%2C+and+Phil+Blunsom%2E+2017%2E+Program+induction+by+rationale+generation%3A+Learning+to+solve+and+explain+algebraic+word+problems%2E+ACL%2E)
64. Alisa Liu, Swabha Swayamdipta, Noah A. Smith, and Yejin Choi. 2022. [WANLI: Worker and AI collaboration for natural language inference dataset creation](https://md.research.elamur.ai/free/en/papers/liu-2022-wanli-worker-ai-collaboration-natural/). In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 6826–6847, Abu Dhabi, United Arab Emirates. Association for Computat…
65. Evan Zheran Liu, Behzad Haghgoo, Annie S. Chen, Aditi Raghunathan, Pang Wei Koh, Shiori Sagawa, Percy Liang, and Chelsea Finn. 2021. Just train twice: Improving group robustness without training group information. In Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18… [find](https://scholar.google.com/scholar?q=Evan+Zheran+Liu%2C+Behzad+Haghgoo%2C+Annie+S%2E+Chen%2C+Aditi+Raghunathan%2C+Pang+Wei+Koh%2C+Shiori+Sagawa%2C+Percy+Liang%2C+and+Chelsea+Finn%2E+2021%2E+Just+train+twice%3A+Improving+group+robustness+without+training+group)
66. Tianyu Liu, Zheng Xin, Xiaoan Ding, Baobao Chang, and Zhifang Sui. 2020. [An empirical study on model-agnostic debiasing strategies for robust natural language inference](https://md.research.elamur.ai/free/en/papers/liu-2020-empirical-study-model-agnostic-debiasing/). In Proceedings of the 24th Conference on Computational Natural Language Learning, pages 596–608, Online. Association for Computati…
67. Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. [Roberta: A robustly optimized bert pretraining approach](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/). Preprint, arXiv:1907.11692.
68. Yuxuan Lu, Bingsheng Yao, Shao Zhang, Yun Wang, Peng Zhang, Tun Lu, Toby Jia-Jun Li, and Dakuo Wang. 2023. Human still wins over LLM: an empirical study of active learning on domain-specific annotation tasks. CoRR, abs/2311.09825. — [arXiv:2311.09825](https://arxiv.org/abs/2311.09825) [find](https://scholar.google.com/scholar?q=Yuxuan+Lu%2C+Bingsheng+Yao%2C+Shao+Zhang%2C+Yun+Wang%2C+Peng+Zhang%2C+Tun+Lu%2C+Toby+Jia%2DJun+Li%2C+and+Dakuo+Wang%2E+2023%2E+Human+still+wins+over+LLM%3A+an+empirical+study+of+active+learning+on+domain%2Dspecific+annotatio)
69. Josh Magnus Ludan, Yixuan Meng, Tai Nguyen, Saurabh Shah, Qing Lyu, Marianna Apidianaki, and Chris Callison-Burch. 2023. Explanation-based fine-tuning makes models more robust to spurious cues. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long… [find](https://scholar.google.com/scholar?q=Josh+Magnus+Ludan%2C+Yixuan+Meng%2C+Tai+Nguyen%2C+Saurabh+Shah%2C+Qing+Lyu%2C+Marianna+Apidianaki%2C+and+Chris+Callison%2DBurch%2E+2023%2E+Explanation%2Dbased+fine%2Dtuning+makes+models+more+robust+to+spurious+cues%2E+In+Pro)
70. Junyu Luo, Xiao Luo, Xiusi Chen, Zhiping Xiao, Wei Ju, and Ming Zhang. 2025. Semi-supervised fine-tuning for large language models. In Findings of the Association for Computational Linguistics: NAACL 2025, pages 2795–2808, Albuquerque, New Mexico. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Junyu+Luo%2C+Xiao+Luo%2C+Xiusi+Chen%2C+Zhiping+Xiao%2C+Wei+Ju%2C+and+Ming+Zhang%2E+2025%2E+Semi%2Dsupervised+fine%2Dtuning+for+large+language+models%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+NAACL+)
71. Rabeeh Karimi Mahabadi, Yonatan Belinkov, and James Henderson. 2020. [End-to-end bias mitigation by modelling biases in corpora](https://md.research.elamur.ai/free/en/papers/mahabadi-2020-end-end-bias-mitigation-modelling/). In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 8706–8716, Online. Association for Computational Linguistics.
72. Rabeeh Karimi Mahabadi, Yonatan Belinkov, and James Henderson. 2021. Variational information bottleneck for effective low-resource fine-tuning. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net. [find](https://scholar.google.com/scholar?q=Rabeeh+Karimi+Mahabadi%2C+Yonatan+Belinkov%2C+and+James+Henderson%2E+2021%2E+Variational+information+bottleneck+for+effective+low%2Dresource+fine%2Dtuning%2E+In+9th+International+Conference+on+Learning+Representati)
73. Thomas McCoy, Junghyun Min, and Tal Linzen. 2020. BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performance. In Proceedings of the Third BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP, pages 217–227,… [find](https://scholar.google.com/scholar?q=Thomas+McCoy%2C+Junghyun+Min%2C+and+Tal+Linzen%2E+2020%2E+BERTs+of+a+feather+do+not+generalize+together%3A+Large+variability+in+generalization+across+models+with+similar+test+set+performance%2E+In+Proceedings+of+)
74. Thomas McCoy, Ellie Pavlick, and Tal Linzen. 2019. [Right for the wrong reasons: Diagnosing syntactic heuristics in natural language inference](https://md.research.elamur.ai/free/en/papers/mccoy-2019-right-wrong-reasons-diagnosing-syntactic/). In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3428–3448, Florence, Italy. Association for Computational L…
75. Junghyun Min, Thomas McCoy, Dipanjan Das, Emily Pitler, and Tal Linzen. 2020. [Syntactic data augmentation increases robustness to inference heuristics](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/). In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 2339–2352, Online. Association for Computational L…
76. Pasquale Minervini and Sebastian Riedel. 2018. Adversarially regularising neural NLI models to integrate logical background knowledge. In Proceedings of the 22nd Conference on Computational Natural Language Learning, pages 65–74, Brussels, Belgium. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Pasquale+Minervini+and+Sebastian+Riedel%2E+2018%2E+Adversarially+regularising+neural+NLI+models+to+integrate+logical+background+knowledge%2E+In+Proceedings+of+the+22nd+Conference+on+Computational+Natural+La)
77. Juri Opitz, Shira Wein, Julius Steen, Anette Frank, and Nathan Schneider. 2023. AMR4NLI: Interpretable and robust NLI measures from semantic graphs. In Proceedings of the 15th International Conference on Computational Semantics, pages 275–283, Nancy, France. Association for Computational Linguistics… [find](https://scholar.google.com/scholar?q=Juri+Opitz%2C+Shira+Wein%2C+Julius+Steen%2C+Anette+Frank%2C+and+Nathan+Schneider%2E+2023%2E+AMR4NLI%3A+Interpretable+and+robust+NLI+measures+from+semantic+graphs%2E+In+Proceedings+of+the+15th+International+Conference)
78. Jay Mohta, Kenan E. Ak, Yan Xu, and Mingwei Shen. 2023. Are large language models good annotators? In Proceedings on "I Can’t Believe It’s Not Better: Failure Modes in the Age of Foundation Models" at NeurIPS 2023 Workshops, 16 December 2023, New Orleans, Louisiana, USA, volume 239 of Proceedings of… [find](https://scholar.google.com/scholar?q=Jay+Mohta%2C+Kenan+E%2E+Ak%2C+Yan+Xu%2C+and+Mingwei+Shen%2E+2023%2E+Are+large+language+models+good+annotators%3F+In+Proceedings+on+%22I+Can%E2%80%99t+Believe+It%E2%80%99s+Not+Better%3A+Failure+Modes+in+the+Age+of+Foundation+Models%22+at)
79. Jinlong Pang, Na Di, Zhaowei Zhu, Jiaheng Wei, Hao Cheng, Chen Qian, and Yang Liu. 2025. Token cleaning: Fine-grained data selection for LLM supervised fine-tuning. In Forty-second International Conference on Machine Learning. [find](https://scholar.google.com/scholar?q=Jinlong+Pang%2C+Na+Di%2C+Zhaowei+Zhu%2C+Jiaheng+Wei%2C+Hao+Cheng%2C+Chen+Qian%2C+and+Yang+Liu%2E+2025%2E+Token+cleaning%3A+Fine%2Dgrained+data+selection+for+LLM+supervised+fine%2Dtuning%2E+In+Forty%2Dsecond+International+Confe)
80. Marius Mosbach, Tiago Pimentel, Shauli Ravfogel, Dietrich Klakow, and Yanai Elazar. 2023. [Few-shot fine-tuning vs. in-context learning: A fair comparison and evaluation](https://md.research.elamur.ai/free/en/papers/mosbach-2023-few-shot-fine-tuning-vs/). In Findings of the Association for Computational Linguistics: ACL 2023, pages 12284– 12314, Toronto, Canada. Association for Compu…
81. Aaron Mueller, Albert Webson, Jackson Petty, and Tal Linzen. 2024. In-context learning generalizes, but not always robustly: The case of syntax. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1… [find](https://scholar.google.com/scholar?q=Aaron+Mueller%2C+Albert+Webson%2C+Jackson+Petty%2C+and+Tal+Linzen%2E+2024%2E+In%2Dcontext+learning+generalizes%2C+but+not+always+robustly%3A+The+case+of+syntax%2E+In+Proceedings+of+the+2024+Conference+of+the+North+Amer)
82. Vlad-Andrei Negru, Robert Vacareanu, Camelia Lemnaru, Mihai Surdeanu, and Rodica Potolea. 2025. Morphnli: A stepwise approach to natural language inference using text morphing. CoRR, abs/2502.09567. [find](https://scholar.google.com/scholar?q=Vlad%2DAndrei+Negru%2C+Robert+Vacareanu%2C+Camelia+Lemnaru%2C+Mihai+Surdeanu%2C+and+Rodica+Potolea%2E+2025%2E+Morphnli%3A+A+stepwise+approach+to+natural+language+inference+using+text+morphing%2E+CoRR%2C+abs%2F2502%2E09567%2E)
83. Yixin Nie, Haonan Chen, and Mohit Bansal. 2019. Combining fact extraction and verification with neural semantic matching networks. In The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, The Thirty-First Innovative Applications of Artificial Intelligence Conference, IAAI 2019, The… [find](https://scholar.google.com/scholar?q=Yixin+Nie%2C+Haonan+Chen%2C+and+Mohit+Bansal%2E+2019%2E+Combining+fact+extraction+and+verification+with+neural+semantic+matching+networks%2E+In+The+Thirty%2DThird+AAAI+Conference+on+Artificial+Intelligence%2C+AAAI+)
84. Yixin Nie, Adina Williams, Emily Dinan, Mohit Bansal, Jason Weston, and Douwe Kiela. 2020. [Adversarial NLI: A new benchmark for natural language understanding](https://md.research.elamur.ai/free/en/papers/nie-2020-adversarial-nli-new-benchmark-natural/). In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 4885–4901, Online. Association for Computa…
85. OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, Red Avila, Igor Babuschkin, Suchir Balaji, Valerie Balcom, Paul Baltescu, Haiming Bao, Mohammad Bavarian, Jeff Belgum, and Bhargavi Pa… [find](https://scholar.google.com/scholar?q=OpenAI%2C+Josh+Achiam%2C+Steven+Adler%2C+Sandhini+Agarwal%2C+Lama+Ahmad%2C+Ilge+Akkaya%2C+Florencia+Leoni+Aleman%2C+Diogo+Almeida%2C+Janko+Altenschmidt%2C+Sam+Altman%2C+Shyamal+Anadkat%2C+Red+Avila%2C+Igor+Babuschkin%2C+Suchir)
86. Adam Poliak, Jason Naradowsky, Aparajita Haldar, Rachel Rudinger, and Benjamin Van Durme. 2018. [Hypothesis only baselines in natural language inference](https://md.research.elamur.ai/free/en/papers/poliak-2018-hypothesis-only-baselines-natural-language/). In Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics, pages 180–191, New Orleans, Louisiana. Association for Compu…
87. Frano Rajic, Ivan Stresec, Axel Marmet, and Tim Postuvan. 2022. Using focal loss to fight shallow heuristics: An empirical analysis of modulated cross-entropy in natural language inference. CoRR, abs/2211.13331. — [arXiv:2211.13331](https://arxiv.org/abs/2211.13331) [find](https://scholar.google.com/scholar?q=Frano+Rajic%2C+Ivan+Stresec%2C+Axel+Marmet%2C+and+Tim+Postuvan%2E+2022%2E+Using+focal+loss+to+fight+shallow+heuristics%3A+An+empirical+analysis+of+modulated+cross%2Dentropy+in+natural+language+inference%2E+CoRR%2C+abs%2F)
88. Ahmad Rashid, Vasileios Lioutas, and Mehdi Rezagholizadeh. 2021. MATE-KD: Masked adversarial TExt, a companion to knowledge distillation. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Process… [find](https://scholar.google.com/scholar?q=Ahmad+Rashid%2C+Vasileios+Lioutas%2C+and+Mehdi+Rezagholizadeh%2E+2021%2E+MATE%2DKD%3A+Masked+adversarial+TExt%2C+a+companion+to+knowledge+distillation%2E+In+Proceedings+of+the+59th+Annual+Meeting+of+the+Association+f)
89. Abhilasha Ravichander, Joe Stacey, and Marek Rei. 2023. When and why does bias mitigation work? In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 9233–9247, Singapore. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Abhilasha+Ravichander%2C+Joe+Stacey%2C+and+Marek+Rei%2E+2023%2E+When+and+why+does+bias+mitigation+work%3F+In+Findings+of+the+Association+for+Computational+Linguistics%3A+EMNLP+2023%2C+pages+9233%E2%80%939247%2C+Singapore%2E+As)
90. Alexis Ross, Matthew Peters, and Ana Marasovic. 2022. Does self-rationalization improve robustness to spurious correlations? In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 7403–7416, Abu Dhabi, United Arab Emirates. Association for Computational Ling… [find](https://scholar.google.com/scholar?q=Alexis+Ross%2C+Matthew+Peters%2C+and+Ana+Marasovic%2E+2022%2E+Does+self%2Drationalization+improve+robustness+to+spurious+correlations%3F+In+Proceedings+of+the+2022+Conference+on+Empirical+Methods+in+Natural+Langu)
91. Aymeric Roucher, Albert Villanova del Moral, Thomas Wolf, Leandro von Werra, and Erik Kaunismäki. 2025. ‘smolagents‘: a smol library to build great agentic systems. [https://github.com/](https://github.com/) huggingface/smolagents. [↗](https://github.com/)
92. Shiori Sagawa, Pang Wei Koh, Tatsunori B. Hashimoto, and Percy Liang. 2020. Distributionally robust neural networks. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenReview.net. and diagnosing datasets with training dynamics. In Pr… [find](https://scholar.google.com/scholar?q=Shiori+Sagawa%2C+Pang+Wei+Koh%2C+Tatsunori+B%2E+Hashimoto%2C+and+Percy+Liang%2E+2020%2E+Distributionally+robust+neural+networks%2E+In+8th+International+Conference+on+Learning+Representations%2C+ICLR+2020%2C+Addis+Ababa)
93. Victor Sanh, Thomas Wolf, Yonatan Belinkov, and Alexander M. Rush. 2021. Learning from others’ mistakes: Avoiding dataset biases without modeling them. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net. [find](https://scholar.google.com/scholar?q=Victor+Sanh%2C+Thomas+Wolf%2C+Yonatan+Belinkov%2C+and+Alexander+M%2E+Rush%2E+2021%2E+Learning+from+others%E2%80%99+mistakes%3A+Avoiding+dataset+biases+without+modeling+them%2E+In+9th+International+Conference+on+Learning+Repr)
94. Gemini Team, Rohan Anil, Sebastian Borgeaud, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M. Dai, Anja Hauth, Katie Millican, David Silver, Melvin Johnson, Ioannis Antonoglou, Julian Schrittwieser, Amelia Glaese, Jilin Chen, Emily Pitler, Timothy Lillicrap, Angeliki Lazari… — [Gemini: A Family of Highly Capable Multimodal Models](https://md.research.elamur.ai/free/en/papers/gemini-team-2023-gemini-family-highly-capable-multimodal/)
95. Joe Stacey, Yonatan Belinkov, and Marek Rei. 2022a. Supervising model attention with human explanations for robust natural language inference. Proceedings of the AAAI Conference on Artificial Intelligence, 36(10):11349–11357. [find](https://scholar.google.com/scholar?q=Joe+Stacey%2C+Yonatan+Belinkov%2C+and+Marek+Rei%2E+2022a%2E+Supervising+model+attention+with+human+explanations+for+robust+natural+language+inference%2E+Proceedings+of+the+AAAI+Conference+on+Artificial+Intellig)
96. Joe Stacey, Jianpeng Cheng, John Torr, Tristan Guigue, Joris Driesen, Alexandru Coca, Mark Gaynor, and Anders Johannsen. 2024a. LUCID: LLM-generated utterances for complex and interesting dialogues. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computatio… [find](https://scholar.google.com/scholar?q=Joe+Stacey%2C+Jianpeng+Cheng%2C+John+Torr%2C+Tristan+Guigue%2C+Joris+Driesen%2C+Alexandru+Coca%2C+Mark+Gaynor%2C+and+Anders+Johannsen%2E+2024a%2E+LUCID%3A+LLM%2Dgenerated+utterances+for+complex+and+interesting+dialogues%2E+I)
97. Joe Stacey, Pasquale Minervini, Haim Dubossarsky, Oana-Maria Camburu, and Marek Rei. 2024b. Atomic inference for NLI with generated facts as atoms. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 10188–10204, Miami, Florida, USA. Association for Compu… [find](https://scholar.google.com/scholar?q=Joe+Stacey%2C+Pasquale+Minervini%2C+Haim+Dubossarsky%2C+Oana%2DMaria+Camburu%2C+and+Marek+Rei%2E+2024b%2E+Atomic+inference+for+NLI+with+generated+facts+as+atoms%2E+In+Proceedings+of+the+2024+Conference+on+Empirical+M)
98. Joe Stacey, Pasquale Minervini, Haim Dubossarsky, and Marek Rei. 2022b. Logical reasoning with span-level predictions for interpretable and robust NLI models. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 3809–3823, Abu Dhabi, United Arab Emirates.… [find](https://scholar.google.com/scholar?q=Joe+Stacey%2C+Pasquale+Minervini%2C+Haim+Dubossarsky%2C+and+Marek+Rei%2E+2022b%2E+Logical+reasoning+with+span%2Dlevel+predictions+for+interpretable+and+robust+NLI+models%2E+In+Proceedings+of+the+2022+Conference+on+)
99. Joe Stacey, Pasquale Minervini, Haim Dubossarsky, Sebastian Riedel, and Tim Rocktäschel. 2020. [Avoiding the Hypothesis-Only Bias in Natural Language Inference via Ensemble Adversarial Training](https://md.research.elamur.ai/free/en/papers/stacey-2020-avoiding-hypothesis-only-bias-natural/). In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 8…
100. Damien Teney, Ehsan Abbasnejad, and Anton van den Hengel. 2020. Learning what makes a difference from counterfactual examples and gradient supervision. In Computer Vision - ECCV 2020 - 16th European Conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part X, volume 12355 of Lecture Notes in Co… [find](https://scholar.google.com/scholar?q=Damien+Teney%2C+Ehsan+Abbasnejad%2C+and+Anton+van+den+Hengel%2E+2020%2E+Learning+what+makes+a+difference+from+counterfactual+examples+and+gradient+supervision%2E+In+Computer+Vision+%2D+ECCV+2020+%2D+16th+European+C)
101. James Thorne, Andreas Vlachos, Christos Christodoulopoulos, and Arpit Mittal. 2018. [FEVER: a large-scale dataset for fact extraction and VERification](https://md.research.elamur.ai/free/en/papers/thorne-2018-fever-large-scale-dataset-fact/). In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vo…
102. Bing Tian, Yixin Cao, Yong Zhang, and Chunxiao Xing. 2022. Debiasing nlu models via causal intervention and counterfactual reasoning. Proceedings of the AAAI Conference on Artificial Intelligence, 36(10):11376–11384. [find](https://scholar.google.com/scholar?q=Bing+Tian%2C+Yixin+Cao%2C+Yong+Zhang%2C+and+Chunxiao+Xing%2E+2022%2E+Debiasing+nlu+models+via+causal+intervention+and+counterfactual+reasoning%2E+Proceedings+of+the+AAAI+Conference+on+Artificial+Intelligence%2C+36%28)
103. Petter Törnberg. 2023. [Chatgpt-4 outperforms experts and crowd workers in annotating political twitter messages with zero-shot learning](https://md.research.elamur.ai/free/en/papers/tornberg-2023-chatgpt-4-outperforms-experts-crowd/). CoRR, abs/2304.06588.
104. Lifu Tu, Garima Lalwani, Spandana Gella, and He He. 2020. An empirical study on robustness to spurious correlations using pre-trained language models. Transactions of the Association for Computational Linguistics, 8:621–633. [find](https://scholar.google.com/scholar?q=Lifu+Tu%2C+Garima+Lalwani%2C+Spandana+Gella%2C+and+He+He%2E+2020%2E+An+empirical+study+on+robustness+to+spurious+correlations+using+pre%2Dtrained+language+models%2E+Transactions+of+the+Association+for+Computational)
105. Joe Stacey and Marek Rei. 2024. Distilling robustness into natural language inference models with domain-targeted augmentation. In Findings of the Association for Computational Linguistics: ACL 2024, pages 2239–2258, Bangkok, Thailand. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Joe+Stacey+and+Marek+Rei%2E+2024%2E+Distilling+robustness+into+natural+language+inference+models+with+domain%2Dtargeted+augmentation%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+ACL+2024%2C+)
106. Can Udomcharoenchaikit, Wuttikorn Ponwitayarat, Patomporn Payoungkhamdee, Kanruethai Masuk, Weerayut Buaphet, Ekapol Chuangsuwanich, and Sarana Nutanong. 2022. Mitigating spurious correlation in natural language understanding with counterfactual inference. In Proceedings of the 2022 Conference on Em… [find](https://scholar.google.com/scholar?q=Can+Udomcharoenchaikit%2C+Wuttikorn+Ponwitayarat%2C+Patomporn+Payoungkhamdee%2C+Kanruethai+Masuk%2C+Weerayut+Buaphet%2C+Ekapol+Chuangsuwanich%2C+and+Sarana+Nutanong%2E+2022%2E+Mitigating+spurious+correlation+in+natur)
107. Swabha Swayamdipta, Roy Schwartz, Nicholas Lourie, Yizhong Wang, Hannaneh Hajishirzi, Noah A. Smith, and Yejin Choi. 2020. [Dataset cartography: Mapping Prasetya Ajie Utama, Nafise Sadat Moosavi, and Iryna Gurevych](https://md.research.elamur.ai/free/en/papers/utama-2020-mind-trade-off-debiasing-nlu/). 2020a. Mind the trade-off: Debiasing NLU models without degrading the in-distribution…
108. Prasetya Ajie Utama, Nafise Sadat Moosavi, and Iryna Gurevych. 2020b. Towards debiasing NLU models from unknown biases. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 7597–7610, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Prasetya+Ajie+Utama%2C+Nafise+Sadat+Moosavi%2C+and+Iryna+Gurevych%2E+2020b%2E+Towards+debiasing+NLU+models+from+unknown+biases%2E+In+Proceedings+of+the+2020+Conference+on+Empirical+Methods+in+Natural+Language+P)
109. Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel Bowman. 2018. [GLUE: A multi-task benchmark and analysis platform for natural language understanding](https://md.research.elamur.ai/free/en/papers/wang-2018-glue-multi-task-benchmark-analysis/). In Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pages 353–355,…
110. Fei Wang, James Y. Huang, Tianyi Yan, Wenxuan Zhou, and Muhao Chen. 2023a. Robust natural language understanding with residual attention debiasing. In Findings of the Association for Computational Linguistics: ACL 2023, pages 504–519, Toronto, Canada. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Fei+Wang%2C+James+Y%2E+Huang%2C+Tianyi+Yan%2C+Wenxuan+Zhou%2C+and+Muhao+Chen%2E+2023a%2E+Robust+natural+language+understanding+with+residual+attention+debiasing%2E+In+Findings+of+the+Association+for+Computational+Lin)
111. Shaobo Wang, Xiangqi Jin, Ziming Wang, Jize Wang, Jiajun Zhang, Kaixin Li, Zichen Wen, Zhong Li, Conghui He, Xuming Hu, and Linfeng Zhang. 2025a. Data whisperer: Efficient data selection for task-specific LLM fine-tuning via few-shot in-context learning. In Proceedings of the 63rd Annual Meeting of… [find](https://scholar.google.com/scholar?q=Shaobo+Wang%2C+Xiangqi+Jin%2C+Ziming+Wang%2C+Jize+Wang%2C+Jiajun+Zhang%2C+Kaixin+Li%2C+Zichen+Wen%2C+Zhong+Li%2C+Conghui+He%2C+Xuming+Hu%2C+and+Linfeng+Zhang%2E+2025a%2E+Data+whisperer%3A+Efficient+data+selection+for+task%2Dspec)
112. Xiaoyue Wang, Xin Liu, Lijie Wang, Yaoxiang Wang, Jinsong Su, and Hua Wu. 2023b. IBADR: an iterative bias-aware dataset refinement framework for debiasing NLU models. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 9176–9186, Singapore. Association fo… [find](https://scholar.google.com/scholar?q=Xiaoyue+Wang%2C+Xin+Liu%2C+Lijie+Wang%2C+Yaoxiang+Wang%2C+Jinsong+Su%2C+and+Hua+Wu%2E+2023b%2E+IBADR%3A+an+iterative+bias%2Daware+dataset+refinement+framework+for+debiasing+NLU+models%2E+In+Proceedings+of+the+2023+Confer)
113. Xiaoyue Wang, Xin Liu, Lijie Wang, Suhang Wu, Jinsong Su, and Hua Wu. 2025b. A simple yet effective self-debiasing framework for transformer models. Artif. Intell., 339:104258. [find](https://scholar.google.com/scholar?q=Xiaoyue+Wang%2C+Xin+Liu%2C+Lijie+Wang%2C+Suhang+Wu%2C+Jinsong+Su%2C+and+Hua+Wu%2E+2025b%2E+A+simple+yet+effective+self%2Ddebiasing+framework+for+transformer+models%2E+Artif%2E+Intell%2E%2C+339%3A104258%2E)
114. Benjamin Warner, Antoine Chaffin, Benjamin Clavié, Orion Weller, Oskar Hallström, Said Taghadouini, Alexis Gallagher, Raja Biswas, Faisal Ladhak, Tom Aarsen, Nathan Cooper, Griffin Adams, Jeremy Howard, and Iacopo Poli. 2024. [Smarter, better, faster, longer: A modern bidirectional encoder for fast,…](https://md.research.elamur.ai/free/en/papers/warner-2024-smarter-better-faster-longer-modern/)
115. Jiaxin Wen, Yeshuang Zhu, Jinchao Zhang, Jie Zhou, and Minlie Huang. 2022. AutoCAD: Automatically generate counterfactuals for mitigating shortcut learning. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 2302–2317, Abu Dhabi, United Arab Emirates. Association for Com… [find](https://scholar.google.com/scholar?q=Jiaxin+Wen%2C+Yeshuang+Zhu%2C+Jinchao+Zhang%2C+Jie+Zhou%2C+and+Minlie+Huang%2E+2022%2E+AutoCAD%3A+Automatically+generate+counterfactuals+for+mitigating+shortcut+learning%2E+In+Findings+of+the+Association+for+Computat)
116. Adina Williams, Nikita Nangia, and Samuel Bowman. 2018. [A broad-coverage challenge corpus for sentence understanding through inference](https://md.research.elamur.ai/free/en/papers/williams-2018-broad-coverage-challenge-corpus-sentence/). In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Pa…
117. Yuxiang Wu, Matt Gardner, Pontus Stenetorp, and Pradeep Dasigi. 2022. [Generating data to mitigate spurious correlations in natural language inference datasets](https://md.research.elamur.ai/free/en/papers/wu-2022-generating-data-mitigate-spurious-correlations/). In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2660–2676, Dublin,…
118. Ruibin Xiong, Yimeng Chen, Liang Pang, Xueqi Cheng, Zhi-Ming Ma, and Yanyan Lan. 2021. Uncertainty calibration for ensemble-based debiasing methods. In Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14,… [find](https://scholar.google.com/scholar?q=Ruibin+Xiong%2C+Yimeng+Chen%2C+Liang+Pang%2C+Xueqi+Cheng%2C+Zhi%2DMing+Ma%2C+and+Yanyan+Lan%2E+2021%2E+Uncertainty+calibration+for+ensemble%2Dbased+debiasing+methods%2E+In+Advances+in+Neural+Information+Processing+System)
119. Yadollah Yaghoobzadeh, Soroush Mehri, Remi Tachet des Combes, T. J. Hazen, and Alessandro Sordoni. 2021. Increasing robustness to spurious correlations using forgettable examples. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Vol… [find](https://scholar.google.com/scholar?q=Yadollah+Yaghoobzadeh%2C+Soroush+Mehri%2C+Remi+Tachet+des+Combes%2C+T%2E+J%2E+Hazen%2C+and+Alessandro+Sordoni%2E+2021%2E+Increasing+robustness+to+spurious+correlations+using+forgettable+examples%2E+In+Proceedings+of+th)
120. Hitomi Yanaka, Koji Mineshima, Daisuke Bekki, Kentaro Inui, Satoshi Sekine, Lasha Abzianidze, and Johan Bos. 2019. HELP: A dataset for identifying shortcomings of neural models in monotonicity reasoning. In Proceedings of the Eighth Joint Conference on Lexical and Computational Semantics (*SEM 2019)… [find](https://scholar.google.com/scholar?q=Hitomi+Yanaka%2C+Koji+Mineshima%2C+Daisuke+Bekki%2C+Kentaro+Inui%2C+Satoshi+Sekine%2C+Lasha+Abzianidze%2C+and+Johan+Bos%2E+2019%2E+HELP%3A+A+dataset+for+identifying+shortcomings+of+neural+models+in+monotonicity+reasoni)
121. An Yang, Beichen Zhang, Binyuan Hui, Bofei Gao, Bowen Yu, Chengpeng Li, Dayiheng Liu, Jianhong Tu, Jingren Zhou, Junyang Lin, Keming Lu, Mingfeng Xue, Runji Lin, Tianyu Liu, Xingzhang Ren, and Zhenru Zhang. 2024. [Qwen2.5-math technical report: Toward mathematical expert model via self-improvement](https://md.research.elamur.ai/free/en/papers/yang-2024-qwen2-5-math-technical-report/). P…
122. Jianxiang Zang and Hui Liu. 2024. Explanation based bias decoupling regularization for natural language inference. In 2024 International Joint Conference on Neural Networks (IJCNN), pages 1–8. IEEE. [find](https://scholar.google.com/scholar?q=Jianxiang+Zang+and+Hui+Liu%2E+2024%2E+Explanation+based+bias+decoupling+regularization+for+natural+language+inference%2E+In+2024+International+Joint+Conference+on+Neural+Networks+%28IJCNN%29%2C+pages+1%E2%80%938%2E+IEEE%2E)
123. Jia Zhang, Chen-Xi Zhang, Yao Liu, Yi-Xuan Jin, Xiao-Wen Yang, Bo Zheng, Yi Liu, and Lan-Zhe Guo. 2025. D3: Diversity, difficulty, and dependability-aware data selection for sample-efficient llm instruction tuning. In Proceedings of the Thirty-Fourth International Joint Conference on Artificial Inte… [find](https://scholar.google.com/scholar?q=Jia+Zhang%2C+Chen%2DXi+Zhang%2C+Yao+Liu%2C+Yi%2DXuan+Jin%2C+Xiao%2DWen+Yang%2C+Bo+Zheng%2C+Yi+Liu%2C+and+Lan%2DZhe+Guo%2E+2025%2E+D3%3A+Diversity%2C+difficulty%2C+and+dependability%2Daware+data+selection+for+sample%2Defficient+llm+instr)
124. Xinyan Zhao and V. G. Vinod Vydiswaran. 2021. Lirex: Augmenting language inference with relevant explanations. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Ed… [find](https://scholar.google.com/scholar?q=Xinyan+Zhao+and+V%2E+G%2E+Vinod+Vydiswaran%2E+2021%2E+Lirex%3A+Augmenting+language+inference+with+relevant+explanations%2E+In+Thirty%2DFifth+AAAI+Conference+on+Artificial+Intelligence%2C+AAAI+2021%2C+Thirty%2DThird+Confe)
125. Xiang Zhou and Mohit Bansal. 2020. [Towards robustifying NLI models against lexical dataset biases](https://md.research.elamur.ai/free/en/papers/zhou-2020-robustifying-nli-models-against-lexical/). In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 8759– 8771, Online. Association for Computational Linguistics.

*Updated 31 October 2026*
