---
title: "Measure and Improve Robustness in NLP Models: A Survey — paper by Wang et al. (2022)"
description: "The paper offers no new dataset or experiments. 180 references, cited by 64 papers here."
authors: ["Xuezhi Wang", "Haohan Wang", "Diyi Yang"]
year: 2022
venue: "Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies"
source: "https://aclanthology.org/2022.naacl-main.339/"
doi: "10.18653/v1/2022.naacl-main.339"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/wang-2022-measure-improve-robustness-nlp-models/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wang-2022-measure-improve-robustness-nlp-models/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2022](https://md.research.elamur.ai/free/en/papers/2022/page/3/) / Measure and Improve Robustness in NLP Models: A Survey

# Measure and Improve Robustness in NLP Models: A Survey

**Authors:** [Xuezhi Wang](https://md.research.elamur.ai/free/en/authors/xuezhi-wang/), [Haohan Wang](https://md.research.elamur.ai/free/en/authors/haohan-wang/) and [Diyi Yang](https://md.research.elamur.ai/free/en/authors/diyi-yang/) · **Year:** 2022 · **Venue:** [Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies](https://md.research.elamur.ai/free/en/venues/naacl/) ([NAACL 2022](https://md.research.elamur.ai/free/en/venues/naacl/2022/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2022.naacl-main.339/) · [PDF](https://aclanthology.org/2022.naacl-main.339.pdf) · [DOI 10.18653/v1/2022.naacl-main.339](https://doi.org/10.18653/v1/2022.naacl-main.339) · [OpenAlex](https://openalex.org/W4226040778)

**Citations:** 84 citations (OpenAlex, 2026-10-14) · [64](https://md.research.elamur.ai/free/en/papers/wang-2022-measure-improve-robustness-nlp-models/cited-by/) in our library, of the 141,840 papers whose bibliographies we read

## Summary
NLP systems built on large pre-trained language models score well on benchmarks but still fail on out-of-domain text, adversarial inputs and small input perturbations. Research on this issue is scattered across communities that use different definitions and evaluation methods. This NAACL 2022 survey brings that work into one framework. It treats robustness as a model's performance on a test distribution D′ that differs from the training distribution D. D′ can come from synthetic changes (adversarial attacks) or from naturally occurring distribution shift. The authors link both types to models relying on spurious correlations, and they explain why methods from vision do not transfer directly to discrete text. They review how robustness failures are identified and evaluated. They then group mitigation strategies into data-driven, model-driven and inductive-prior-based approaches. The paper offers no new dataset or experiments. Its contribution is a conceptual map of the field and a list of open problems. These include automatically finding unknown failure modes, end-to-end mitigation, unified benchmarks and user-centred measures.

## Key points
- Robustness is measured as robust accuracy, the expected rate of correct predictions on samples from a shifted distribution D′ ≠ D. For text generation, robustness is harder to define and shows up as positional bias or hallucination.
- The survey separates label-preserving perturbations (y′ = y) from label-changing ones (y′ ≠ y). It also separates semantic-preserving from semantic-modifying edits. Wang et al. (2021b) found that many supposedly label-preserving perturbations actually change the label or cause disagreement among human raters.
- In vision, Taori et al. (2020) found that robustness to synthetic shift gives little or no benefit under natural shift. The authors note that this transfer question remains underexplored in NLP.
- Mitigations rely on pre-trained models, invariant representations across environments, or priors about known spurious patterns. These priors are applied through augmentation, reweighting, ensembles or causal intervention. Wang et al. (2021c) argue that many of these methods optimize the same generalization error bound.
- Unified evaluation tools highlighted in the survey are CheckList, Reliability Testing, Robustness Gym and Dynabench.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Google](https://md.research.elamur.ai/free/en/companies/google/) — Company, Mountain View, United States · 353 works · 364,806 citations
- [Carnegie Mellon University](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/) — University, Pittsburgh, United States · 365 works · 158,048 citations
- [Georgia Institute of Technology](https://md.research.elamur.ai/free/en/universities/georgia-institute-of-technology/) — University, Atlanta, United States · 69 works · 22,788 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,086 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,889 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works

## Cite

Cite as: Xuezhi Wang, Haohan Wang and Diyi Yang. 2022. Measure and Improve Robustness in NLP Models: A Survey. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{wang2022measure,
  title = {{Measure and Improve Robustness in NLP Models: A Survey}},
  author = {Xuezhi Wang, Haohan Wang and Diyi Yang},
  booktitle = {Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies},
  year = {2022},
  doi = {10.18653/v1/2022.naacl-main.339},
  url = {https://doi.org/10.18653/v1/2022.naacl-main.339}
}
```

- [← previous ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning](https://md.research.elamur.ai/free/en/papers/golovneva-2022-roscoe-suite-metrics-scoring-step/)
- [next → SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic](https://md.research.elamur.ai/free/en/papers/farha-2022-semeval-2022-task-6-isarcasmeval/)
- [↑ back to papers of 2022](https://md.research.elamur.ai/free/en/papers/2022/page/3/)

## References

180 references, 51 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Alberto Abad, Peter Bell, Andrea Carmantini, and Steve Renals. 2020. Cross lingual transfer learning for zero-resource domain adaptation. In ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 6909–6913. [find](https://scholar.google.com/scholar?q=Alberto+Abad%2C+Peter+Bell%2C+Andrea+Carmantini%2C+and+Steve+Renals%2E+2020%2E+Cross+lingual+transfer+learning+for+zero%2Dresource+domain+adaptation%2E+In+ICASSP+2020+%2D+2020+IEEE+International+Conference+on+Acousti)
2. Faruk Ahmed, Yoshua Bengio, Harm van Seijen, and Aaron Courville. 2020. Systematic generalisation with group invariant predictions. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Faruk+Ahmed%2C+Yoshua+Bengio%2C+Harm+van+Seijen%2C+and+Aaron+Courville%2E+2020%2E+Systematic+generalisation+with+group+invariant+predictions%2E+In+International+Conference+on+Learning+Representations%2E)
3. S. Aït-Mokhtar, J.-P. Chanod, and C. Roux. 2002. Robustness beyond shallowness: Incremental deep parsing. Nat. Lang. Eng., 8(3):121–144. [find](https://scholar.google.com/scholar?q=S%2E+A%C3%AFt%2DMokhtar%2C+J%2E%2DP%2E+Chanod%2C+and+C%2E+Roux%2E+2002%2E+Robustness+beyond+shallowness%3A+Incremental+deep+parsing%2E+Nat%2E+Lang%2E+Eng%2E%2C+8%283%29%3A121%E2%80%93144%2E)
4. Moustafa Alzantot, Yash Sharma, Ahmed Elgohary, Bo-Jhang Ho, Mani Srivastava, and Kai-Wei Chang. 2018. Generating natural language adversarial examples. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2890–2896, Brussels, Belgium. Association for Comp… [our card](https://md.research.elamur.ai/free/en/papers/alzantot-2018-generating-natural-language-adversarial-examples/)
5. Antonios Anastasopoulos, Alison Lui, Toan Q Nguyen, and David Chiang. 2019. Neural machine translation of text from non-native speakers. In Proceedings of NAACL-HLT, pages 3070–3080. [find](https://scholar.google.com/scholar?q=Antonios+Anastasopoulos%2C+Alison+Lui%2C+Toan+Q+Nguyen%2C+and+David+Chiang%2E+2019%2E+Neural+machine+translation+of+text+from+non%2Dnative+speakers%2E+In+Proceedings+of+NAACL%2DHLT%2C+pages+3070%E2%80%933080%2E)
6. Martin Arjovsky, Léon Bottou, Ishaan Gulrajani, and David Lopez-Paz. 2019. Invariant risk minimization. arXiv preprint arXiv:1907.02893. [our card](https://md.research.elamur.ai/free/en/papers/arjovsky-2019-invariant-risk-minimization/)
7. Ananth Balashankar, Xuezhi Wang, Ben Packer, Nithum Thain, Ed Chi, and Alex Beutel. 2021. Can we improve model robustness through secondary attribute counterfactuals? In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. [find](https://scholar.google.com/scholar?q=Ananth+Balashankar%2C+Xuezhi+Wang%2C+Ben+Packer%2C+Nithum+Thain%2C+Ed+Chi%2C+and+Alex+Beutel%2E+2021%2E+Can+we+improve+model+robustness+through+secondary+attribute+counterfactuals%3F+In+Proceedings+of+the+2021+Confer)
8. Max Bartolo, Alastair Roberts, Johannes Welbl, Sebastian Riedel, and Pontus Stenetorp. 2020. Beat the AI: Investigating Adversarial Human Annotation for Reading Comprehension. Transactions of the Association for Computational Linguistics, 8:662–678. [find](https://scholar.google.com/scholar?q=Max+Bartolo%2C+Alastair+Roberts%2C+Johannes+Welbl%2C+Sebastian+Riedel%2C+and+Pontus+Stenetorp%2E+2020%2E+Beat+the+AI%3A+Investigating+Adversarial+Human+Annotation+for+Reading+Comprehension%2E+Transactions+of+the+Asso)
9. Yonatan Belinkov and Yonatan Bisk. 2018. Synthetic and natural noise both break neural machine translation. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Yonatan+Belinkov+and+Yonatan+Bisk%2E+2018%2E+Synthetic+and+natural+noise+both+break+neural+machine+translation%2E+In+International+Conference+on+Learning+Representations%2E)
10. Aharon Ben-Tal, Dick Den Hertog, Anja De Waegenaere, Bertrand Melenberg, and Gijs Rennen. 2013. Robust solutions of optimization problems affected by uncertain probabilities. Management Science, 59(2):341–357. [find](https://scholar.google.com/scholar?q=Aharon+Ben%2DTal%2C+Dick+Den+Hertog%2C+Anja+De+Waegenaere%2C+Bertrand+Melenberg%2C+and+Gijs+Rennen%2E+2013%2E+Robust+solutions+of+optimization+problems+affected+by+uncertain+probabilities%2E+Management+Science%2C+59%282%29)
11. Su Lin Blodgett, Lisa Green, and Brendan O’Connor. 2016. Demographic dialectal variation in social media: A case study of African-American English. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1119–1130, Austin, Texas. Association for Computational… [our card](https://md.research.elamur.ai/free/en/papers/blodgett-2016-demographic-dialectal-variation-social-media/)
12. Charles Blundell, Julien Cornebise, Koray Kavukcuoglu, and Daan Wierstra. 2015. Weight uncertainty in neural network. In Proceedings of the 32nd International Conference on Machine Learning, volume 37 of Proceedings of Machine Learning Research, pages 1613–1622, Lille, France. PMLR. [find](https://scholar.google.com/scholar?q=Charles+Blundell%2C+Julien+Cornebise%2C+Koray+Kavukcuoglu%2C+and+Daan+Wierstra%2E+2015%2E+Weight+uncertainty+in+neural+network%2E+In+Proceedings+of+the+32nd+International+Conference+on+Machine+Learning%2C+volume+37)
13. N. Boucher, I. Shumailov, R. Anderson, and N. Papernot. 2022. Bad characters: Imperceptible nlp attacks. In 2022 2022 IEEE Symposium on Security and Privacy (SP), pages 773–790, Los Alamitos, CA, USA. IEEE Computer Society. [find](https://scholar.google.com/scholar?q=N%2E+Boucher%2C+I%2E+Shumailov%2C+R%2E+Anderson%2C+and+N%2E+Papernot%2E+2022%2E+Bad+characters%3A+Imperceptible+nlp+attacks%2E+In+2022+2022+IEEE+Symposium+on+Security+and+Privacy+%28SP%29%2C+pages+773%E2%80%93790%2C+Los+Alamitos%2C+CA%2C+USA%2E)
14. Ronan Le Bras, Swabha Swayamdipta, Chandra Bhagavatula, Rowan Zellers, Matthew Peters, Ashish Sabharwal, and Yejin Choi. 2020. Adversarial filters of dataset biases. In Proceedings of the 37th International Conference on Machine Learning, volume 119 of Proceedings of Machine Learning Research, pages… [find](https://scholar.google.com/scholar?q=Ronan+Le+Bras%2C+Swabha+Swayamdipta%2C+Chandra+Bhagavatula%2C+Rowan+Zellers%2C+Matthew+Peters%2C+Ashish+Sabharwal%2C+and+Yejin+Choi%2E+2020%2E+Adversarial+filters+of+dataset+biases%2E+In+Proceedings+of+the+37th+Interna)
15. Jiaao Chen, Dinghan Shen, Weizhu Chen, and Diyi Yang. 2021a. Hiddencut: Simple data augmentation for natural language understanding with better generalizability. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on… [find](https://scholar.google.com/scholar?q=Jiaao+Chen%2C+Dinghan+Shen%2C+Weizhu+Chen%2C+and+Diyi+Yang%2E+2021a%2E+Hiddencut%3A+Simple+data+augmentation+for+natural+language+understanding+with+better+generalizability%2E+In+Proceedings+of+the+59th+Annual+Meet)
16. Jiaao Chen, Zichao Yang, and Diyi Yang. 2020. Mix-Text: Linguistically-informed interpolation of hidden space for semi-supervised text classification. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 2147– 2157, Online. Association for Computational L… [find](https://scholar.google.com/scholar?q=Jiaao+Chen%2C+Zichao+Yang%2C+and+Diyi+Yang%2E+2020%2E+Mix%2DText%3A+Linguistically%2Dinformed+interpolation+of+hidden+space+for+semi%2Dsupervised+text+classification%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+the+)
17. Sihao Chen, Fan Zhang, Kazoo Sone, and Dan Roth. 2021b. Improving faithfulness in abstractive summarization with contrast candidate generation and selection. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technolog… [our card](https://md.research.elamur.ai/free/en/papers/chen-2021-improving-faithfulness-abstractive-summarization-contrast/)
18. Yangyi Chen, Jin Su, and Wei Wei. 2021c. Multi-granularity textual adversarial attack with behavior cloning. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 4511–4526, Online and Punta Cana, Dominican Republic. Association for Computational Linguistic… [find](https://scholar.google.com/scholar?q=Yangyi+Chen%2C+Jin+Su%2C+and+Wei+Wei%2E+2021c%2E+Multi%2Dgranularity+textual+adversarial+attack+with+behavior+cloning%2E+In+Proceedings+of+the+2021+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+)
19. Yo Joong Choe, Jiyeon Ham, and Kyubyong Park. 2020. An empirical study of invariant risk minimization. arXiv preprint arXiv:2004.05007. — [arXiv:2004.05007](https://arxiv.org/abs/2004.05007) [find](https://scholar.google.com/scholar?q=Yo+Joong+Choe%2C+Jiyeon+Ham%2C+and+Kyubyong+Park%2E+2020%2E+An+empirical+study+of+invariant+risk+minimization%2E+arXiv+preprint+arXiv%3A2004%2E05007%2E+%E2%80%94+%5BarXiv%3A2004%2E05007%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2004%2E05007%29)
20. Christopher Clark, Mark Yatskar, and Luke Zettlemoyer. 2019. Don’t take the easy way out: Ensemble based methods for avoiding known dataset biases. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language… [find](https://scholar.google.com/scholar?q=Christopher+Clark%2C+Mark+Yatskar%2C+and+Luke+Zettlemoyer%2E+2019%2E+Don%E2%80%99t+take+the+easy+way+out%3A+Ensemble+based+methods+for+avoiding+known+dataset+biases%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+M)
21. Christopher Clark, Mark Yatskar, and Luke Zettlemoyer. 2020. Learning to model and ignore dataset bias with mixed capacity ensembles. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings, pages 3031–3045. [find](https://scholar.google.com/scholar?q=Christopher+Clark%2C+Mark+Yatskar%2C+and+Luke+Zettlemoyer%2E+2020%2E+Learning+to+model+and+ignore+dataset+bias+with+mixed+capacity+ensembles%2E+In+Proceedings+of+the+2020+Conference+on+Empirical+Methods+in+Natu)
22. Holly Craig and Julie Washington. 2002. Oral language expectations for african american preschoolers and kindergartners. American Journal of Speech-Language Pathology, 11:59–70. [find](https://scholar.google.com/scholar?q=Holly+Craig+and+Julie+Washington%2E+2002%2E+Oral+language+expectations+for+african+american+preschoolers+and+kindergartners%2E+American+Journal+of+Speech%2DLanguage+Pathology%2C+11%3A59%E2%80%9370%2E)
23. Maria De-Arteaga, Alexey Romanov, Hanna Wallach, Jennifer Chayes, Christian Borgs, Alexandra Chouldechova, Sahin Geyik, Krishnaram Kenthapadi, and Adam Tauman Kalai. 2019. Bias in bios: A case study of semantic representation bias in a high-stakes setting. In Proceedings of the Conference on Fairnes… [find](https://scholar.google.com/scholar?q=Maria+De%2DArteaga%2C+Alexey+Romanov%2C+Hanna+Wallach%2C+Jennifer+Chayes%2C+Christian+Borgs%2C+Alexandra+Chouldechova%2C+Sahin+Geyik%2C+Krishnaram+Kenthapadi%2C+and+Adam+Tauman+Kalai%2E+2019%2E+Bias+in+bios%3A+A+case+study+o)
24. Dorottya Demszky, Devyani Sharma, Jonathan Clark, Vinodkumar Prabhakaran, and Jacob Eisenstein. 2021. Learning to recognize dialect features. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 2315–… [find](https://scholar.google.com/scholar?q=Dorottya+Demszky%2C+Devyani+Sharma%2C+Jonathan+Clark%2C+Vinodkumar+Prabhakaran%2C+and+Jacob+Eisenstein%2E+2021%2E+Learning+to+recognize+dialect+features%2E+In+Proceedings+of+the+2021+Conference+of+the+North+America)
25. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,… [our card](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/)
26. Terrance DeVries and Graham W Taylor. 2017. Improved regularization of convolutional neural networks with cutout. arXiv preprint arXiv:1708.04552. — [arXiv:1708.04552](https://arxiv.org/abs/1708.04552) [find](https://scholar.google.com/scholar?q=Terrance+DeVries+and+Graham+W+Taylor%2E+2017%2E+Improved+regularization+of+convolutional+neural+networks+with+cutout%2E+arXiv+preprint+arXiv%3A1708%2E04552%2E+%E2%80%94+%5BarXiv%3A1708%2E04552%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1708%2E04552)
27. Kaustubh D. Dhole, Varun Gangal, Sebastian Gehrmann, Aadesh Gupta, Zhenhao Li, Saad Mahamood, Abinaya Mahendiran, Simon Mille, Ashish Srivastava, and Samson Tan et al. 2021. Nl-augmenter: A framework for task-sensitive natural language augmentation. [our card](https://md.research.elamur.ai/free/en/papers/dhole-2023-nl-augmenter-framework-task-sensitive/)
28. Yana Dranker, He He, and Yonatan Belinkov. 2021. Irm - when it works and when it doesn’t: A test case of natural language inference. In Neural Information Processing Systems (NeurIPS). [find](https://scholar.google.com/scholar?q=Yana+Dranker%2C+He+He%2C+and+Yonatan+Belinkov%2E+2021%2E+Irm+%2D+when+it+works+and+when+it+doesn%E2%80%99t%3A+A+test+case+of+natural+language+inference%2E+In+Neural+Information+Processing+Systems+%28NeurIPS%29%2E)
29. John C Duchi, Peter W Glynn, and Hongseok Namkoong. 2021. Statistics of robust optimization: A generalized empirical likelihood approach. Mathematics of Operations Research. [find](https://scholar.google.com/scholar?q=John+C+Duchi%2C+Peter+W+Glynn%2C+and+Hongseok+Namkoong%2E+2021%2E+Statistics+of+robust+optimization%3A+A+generalized+empirical+likelihood+approach%2E+Mathematics+of+Operations+Research%2E)
30. Javid Ebrahimi, Anyi Rao, Daniel Lowd, and Dejing Dou. 2018. HotFlip: White-box adversarial examples for text classification. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 31–36, Melbourne, Australia. Association for Comput… [our card](https://md.research.elamur.ai/free/en/papers/ebrahimi-2018-hotflip-white-box-adversarial-examples/)
31. Jonathan St BT Evans. 2010. Intuition and reasoning: A dual-process perspective. Psychological Inquiry, 21(4):313–326. [find](https://scholar.google.com/scholar?q=Jonathan+St+BT+Evans%2E+2010%2E+Intuition+and+reasoning%3A+A+dual%2Dprocess+perspective%2E+Psychological+Inquiry%2C+21%284%29%3A313%E2%80%93326%2E)
32. Shi Feng, Eric Wallace, Alvin Grissom II, Mohit Iyyer, Pedro Rodriguez, and Jordan Boyd-Graber. 2018. Pathologies of neural models make interpretations difficult. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 3719–3728, Brussels, Belgium. Associatio… [find](https://scholar.google.com/scholar?q=Shi+Feng%2C+Eric+Wallace%2C+Alvin+Grissom+II%2C+Mohit+Iyyer%2C+Pedro+Rodriguez%2C+and+Jordan+Boyd%2DGraber%2E+2018%2E+Pathologies+of+neural+models+make+interpretations+difficult%2E+In+Proceedings+of+the+2018+Conference)
33. Steven Y. Feng, Varun Gangal, Jason Wei, Sarath Chandar, Soroush Vosoughi, Teruko Mitamura, and Eduard Hovy. 2021. A survey of data augmentation approaches for NLP. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 968–988, Online. Association for Computational Lin… [our card](https://md.research.elamur.ai/free/en/papers/feng-2021-survey-data-augmentation-approaches-nlp/)
34. Joel Escudé Font and Marta R. Costa-jussà. 2019. Equalizing gender biases in neural machine translation with word embeddings techniques. CoRR, abs/1901.03116. — [arXiv:1901.03116](https://arxiv.org/abs/1901.03116) [find](https://scholar.google.com/scholar?q=Joel+Escud%C3%A9+Font+and+Marta+R%2E+Costa%2Djuss%C3%A0%2E+2019%2E+Equalizing+gender+biases+in+neural+machine+translation+with+word+embeddings+techniques%2E+CoRR%2C+abs%2F1901%2E03116%2E+%E2%80%94+%5BarXiv%3A1901%2E03116%5D%28https%3A%2F%2Farxiv%2Eorg%2Fab)
35. David F. Fouhey, Weicheng Kuo, Alexei A. Efros, and Jitendra Malik. 2018. From lifestyle vlogs to everyday interactions. In CVPR. [find](https://scholar.google.com/scholar?q=David+F%2E+Fouhey%2C+Weicheng+Kuo%2C+Alexei+A%2E+Efros%2C+and+Jitendra+Malik%2E+2018%2E+From+lifestyle+vlogs+to+everyday+interactions%2E+In+CVPR%2E)
36. Yarin Gal and Zoubin Ghahramani. 2016. Dropout as a bayesian approximation: Representing model uncertainty in deep learning. In International Conference on Machine Learning, pages 1050–1059. [find](https://scholar.google.com/scholar?q=Yarin+Gal+and+Zoubin+Ghahramani%2E+2016%2E+Dropout+as+a+bayesian+approximation%3A+Representing+model+uncertainty+in+deep+learning%2E+In+International+Conference+on+Machine+Learning%2C+pages+1050%E2%80%931059%2E)
37. Wee Chung Gan and Hwee Tou Ng. 2019. Improving the robustness of question answering systems to question paraphrasing. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 6065–6075, Florence, Italy. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Wee+Chung+Gan+and+Hwee+Tou+Ng%2E+2019%2E+Improving+the+robustness+of+question+answering+systems+to+question+paraphrasing%2E+In+Proceedings+of+the+57th+Annual+Meeting+of+the+Association+for+Computational+Lin)
38. Yaroslav Ganin, Evgeniya Ustinova, Hana Ajakan, Pascal Germain, Hugo Larochelle, François Laviolette, Mario Marchand, and Victor S. Lempitsky. 2016. Domain-adversarial training of neural networks. J. Mach. Learn. Res., 17:59:1–59:35. [find](https://scholar.google.com/scholar?q=Yaroslav+Ganin%2C+Evgeniya+Ustinova%2C+Hana+Ajakan%2C+Pascal+Germain%2C+Hugo+Larochelle%2C+Fran%C3%A7ois+Laviolette%2C+Mario+Marchand%2C+and+Victor+S%2E+Lempitsky%2E+2016%2E+Domain%2Dadversarial+training+of+neural+networks%2E+J%2E+)
39. Ji Gao, Jack Lanchantin, Mary Lou Soffa, and Yanjun Qi. 2018. Black-box generation of adversarial text sequences to evade deep learning classifiers. In 2018 IEEE Security and Privacy Workshops (SPW), pages 50–56. IEEE. [our card](https://md.research.elamur.ai/free/en/papers/gao-2018-black-box-generation-adversarial-text/)
40. Matt Gardner, Yoav Artzi, Victoria Basmov, Jonathan Berant, Ben Bogin, Sihao Chen, Pradeep Dasigi, Dheeru Dua, Yanai Elazar, Ananth Gottumukkala, Nitish Gupta, Hannaneh Hajishirzi, Gabriel Ilharco, Daniel Khashabi, Kevin Lin, Jiangming Liu, Nelson F. Liu, Phoebe Mulcaire, Qiang Ning, Sameer Singh, N… [our card](https://md.research.elamur.ai/free/en/papers/gardner-2020-evaluating-models-local-decision-boundaries/)
41. Siddhant Garg and Goutham Ramakrishnan. 2020. BAE: BERT-based adversarial examples for text classification. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 6174–6181, Online. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/garg-2020-bae-bert-based-adversarial-examples/)
42. Robert Geirhos, Jörn-Henrik Jacobsen, Claudio Michaelis, Richard Zemel, Wieland Brendel, Matthias Bethge, and Felix A. Wichmann. 2020. Shortcut learning in deep neural networks. Nature Machine Intelligence, 2(11):665–673. [find](https://scholar.google.com/scholar?q=Robert+Geirhos%2C+J%C3%B6rn%2DHenrik+Jacobsen%2C+Claudio+Michaelis%2C+Richard+Zemel%2C+Wieland+Brendel%2C+Matthias+Bethge%2C+and+Felix+A%2E+Wichmann%2E+2020%2E+Shortcut+learning+in+deep+neural+networks%2E+Nature+Machine+Intelli)
43. Mor Geva, Yoav Goldberg, and Jonathan Berant. 2019. Are we modeling the task or the annotator? an investigation of annotator bias in natural language understanding datasets. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conf… [find](https://scholar.google.com/scholar?q=Mor+Geva%2C+Yoav+Goldberg%2C+and+Jonathan+Berant%2E+2019%2E+Are+we+modeling+the+task+or+the+annotator%3F+an+investigation+of+annotator+bias+in+natural+language+understanding+datasets%2E+In+Proceedings+of+the+2019)
44. Muhammad Ghifary, W Bastiaan Kleijn, Mengjie Zhang, David Balduzzi, and Wen Li. 2016. Deep reconstruction-classification networks for unsupervised domain adaptation. In European Conference on Computer Vision, pages 597–613. Springer. [find](https://scholar.google.com/scholar?q=Muhammad+Ghifary%2C+W+Bastiaan+Kleijn%2C+Mengjie+Zhang%2C+David+Balduzzi%2C+and+Wen+Li%2E+2016%2E+Deep+reconstruction%2Dclassification+networks+for+unsupervised+domain+adaptation%2E+In+European+Conference+on+Computer)
45. Karan Goel, Nazneen Fatema Rajani, Jesse Vig, Zachary Taschdjian, Mohit Bansal, and Christopher Ré. 2021. Robustness gym: Unifying the NLP evaluation landscape. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Techno… [find](https://scholar.google.com/scholar?q=Karan+Goel%2C+Nazneen+Fatema+Rajani%2C+Jesse+Vig%2C+Zachary+Taschdjian%2C+Mohit+Bansal%2C+and+Christopher+R%C3%A9%2E+2021%2E+Robustness+gym%3A+Unifying+the+NLP+evaluation+landscape%2E+In+Proceedings+of+the+2021+Conference+o)
46. Ian J Goodfellow, Jonathon Shlens, and Christian Szegedy. 2015. Explaining and harnessing adversarial examples (2014). In International Conference on Learning Representations. [our card](https://md.research.elamur.ai/free/en/papers/goodfellow-2014-explaining-harnessing-adversarial-examples/)
47. Alex Graves. 2011. Practical variational inference for neural networks. In Advances in Neural Information Processing Systems 24, pages 2348–2356. Curran Associates, Inc. [find](https://scholar.google.com/scholar?q=Alex+Graves%2E+2011%2E+Practical+variational+inference+for+neural+networks%2E+In+Advances+in+Neural+Information+Processing+Systems+24%2C+pages+2348%E2%80%932356%2E+Curran+Associates%2C+Inc%2E)
48. Ishaan Gulrajani and David Lopez-Paz. 2021. In search of lost domain generalization. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Ishaan+Gulrajani+and+David+Lopez%2DPaz%2E+2021%2E+In+search+of+lost+domain+generalization%2E+In+International+Conference+on+Learning+Representations%2E)
49. Chuan Guo, Geoff Pleiss, Yu Sun, and Kilian Q. Weinberger. 2017. On calibration of modern neural networks. In Proceedings of the 34th International Conference on Machine Learning - Volume 70, ICML’17, page 1321–1330. JMLR.org. [find](https://scholar.google.com/scholar?q=Chuan+Guo%2C+Geoff+Pleiss%2C+Yu+Sun%2C+and+Kilian+Q%2E+Weinberger%2E+2017%2E+On+calibration+of+modern+neural+networks%2E+In+Proceedings+of+the+34th+International+Conference+on+Machine+Learning+%2D+Volume+70%2C+ICML%E2%80%9917%2C)
50. Suchin Gururangan, Swabha Swayamdipta, Omer Levy, Roy Schwartz, Samuel Bowman, and Noah A Smith. 2018. Annotation artifacts in natural language inference data. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technol… [find](https://scholar.google.com/scholar?q=Suchin+Gururangan%2C+Swabha+Swayamdipta%2C+Omer+Levy%2C+Roy+Schwartz%2C+Samuel+Bowman%2C+and+Noah+A+Smith%2E+2018%2E+Annotation+artifacts+in+natural+language+inference+data%2E+In+Proceedings+of+the+2018+Conference+of)
51. He He, Sheng Zha, and Haohan Wang. 2019. Unlearn dataset bias in natural language inference by fitting the residual. In Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019), pages 132–142. [our card](https://md.research.elamur.ai/free/en/papers/he-2019-unlearn-dataset-bias-natural-language/)
52. Dan Hendrycks, Xiaoyuan Liu, Eric Wallace, Adam Dziedzic, Rishabh Krishnan, and Dawn Song. 2020a. Pretrained transformers improve out-of-distribution robustness. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/hendrycks-2020-pretrained-transformers-improve-out-distribution/)
53. Dan Hendrycks, Norman Mu, Ekin D. Cubuk, Barret Zoph, Justin Gilmer, and Balaji Lakshminarayanan. 2020b. AugMix: A simple data processing method to improve robustness and uncertainty. Proceedings of the International Conference on Learning Representations (ICLR). [find](https://scholar.google.com/scholar?q=Dan+Hendrycks%2C+Norman+Mu%2C+Ekin+D%2E+Cubuk%2C+Barret+Zoph%2C+Justin+Gilmer%2C+and+Balaji+Lakshminarayanan%2E+2020b%2E+AugMix%3A+A+simple+data+processing+method+to+improve+robustness+and+uncertainty%2E+Proceedings+of+t)
54. Dan Hendrycks, Kevin Zhao, Steven Basart, Jacob Steinhardt, and Dawn Song. 2021. Natural adversarial examples. In CVPR. [find](https://scholar.google.com/scholar?q=Dan+Hendrycks%2C+Kevin+Zhao%2C+Steven+Basart%2C+Jacob+Steinhardt%2C+and+Dawn+Song%2E+2021%2E+Natural+adversarial+examples%2E+In+CVPR%2E)
55. Shuo Huang, Zhuang Li, Lizhen Qu, and Lei Pan. 2021. On robustness of neural semantic parsers. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 3333–3342, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Shuo+Huang%2C+Zhuang+Li%2C+Lizhen+Qu%2C+and+Lei+Pan%2E+2021%2E+On+robustness+of+neural+semantic+parsers%2E+In+Proceedings+of+the+16th+Conference+of+the+European+Chapter+of+the+Association+for+Computational+Lingui)
56. William Huang, Haokun Liu, and Samuel R. Bowman. 2020. Counterfactually-augmented SNLI training data does not yield better generalization than unaugmented data. In Proceedings of the First Workshop on Insights from Negative Results in NLP, pages 82– 87, Online. Association for Computational Linguist… [our card](https://md.research.elamur.ai/free/en/papers/huang-2020-counterfactually-augmented-snli-training-data/)
57. Andrew Ilyas, Shibani Santurkar, Dimitris Tsipras, Logan Engstrom, Brandon Tran, and Aleksander Madry. 2019. Adversarial examples are not bugs, they are features. In Advances in Neural Information Processing Systems, pages 125–136. [find](https://scholar.google.com/scholar?q=Andrew+Ilyas%2C+Shibani+Santurkar%2C+Dimitris+Tsipras%2C+Logan+Engstrom%2C+Brandon+Tran%2C+and+Aleksander+Madry%2E+2019%2E+Adversarial+examples+are+not+bugs%2C+they+are+features%2E+In+Advances+in+Neural+Information+Pro)
58. Mohit Iyyer, John Wieting, Kevin Gimpel, and Luke Zettlemoyer. 2018. Adversarial example generation with syntactically controlled paraphrase networks. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vo… [our card](https://md.research.elamur.ai/free/en/papers/iyyer-2018-adversarial-example-generation-syntactically-controlled/)
59. Rohan Jha, Charles Lovering, and Ellie Pavlick. 2020. Does data augmentation improve generalization in nlp? [find](https://scholar.google.com/scholar?q=Rohan+Jha%2C+Charles+Lovering%2C+and+Ellie+Pavlick%2E+2020%2E+Does+data+augmentation+improve+generalization+in+nlp%3F)
60. Robin Jia and Percy Liang. 2017. Adversarial examples for evaluating reading comprehension systems. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 2021–2031, Copenhagen, Denmark. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/jia-2017-adversarial-examples-evaluating-reading-comprehension/)
61. Robin Jia, Aditi Raghunathan, Kerem Göksel, and Percy Liang. 2019. Certified robustness to adversarial word substitutions. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP… [our card](https://md.research.elamur.ai/free/en/papers/jia-2019-certified-robustness-adversarial-word-substitutions/)
62. Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, and Tuo Zhao. 2020. SMART: Robust and efficient fine-tuning for pre-trained natural language models through principled regularized optimization. In Proceedings of the 58th Annual Meeting of the Association for Computational Lingui… [our card](https://md.research.elamur.ai/free/en/papers/jiang-2020-smart-robust-efficient-fine-tuning/)
63. Di Jin, Zhijing Jin, Joey Zhou, and Peter Szolovits. 2020. Is BERT really robust? Natural language attack on text classification and entailment. In AAAI. [find](https://scholar.google.com/scholar?q=Di+Jin%2C+Zhijing+Jin%2C+Joey+Zhou%2C+and+Peter+Szolovits%2E+2020%2E+Is+BERT+really+robust%3F+Natural+language+attack+on+text+classification+and+entailment%2E+In+AAAI%2E)
64. Nitish Joshi and He He. 2021. An investigation of the (in)effectiveness of counterfactually augmented data. [find](https://scholar.google.com/scholar?q=Nitish+Joshi+and+He+He%2E+2021%2E+An+investigation+of+the+%28in%29effectiveness+of+counterfactually+augmented+data%2E)
65. Taehee Jung, Dongyeop Kang, Lucas Mentch, and Eduard Hovy. 2019. Earlier isn’t always better: Sub-aspect analysis on corpus and system biases in summarization. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natu… [find](https://scholar.google.com/scholar?q=Taehee+Jung%2C+Dongyeop+Kang%2C+Lucas+Mentch%2C+and+Eduard+Hovy%2E+2019%2E+Earlier+isn%E2%80%99t+always+better%3A+Sub%2Daspect+analysis+on+corpus+and+system+biases+in+summarization%2E+In+Proceedings+of+the+2019+Conference+on)
66. Vladimir Karpukhin, Omer Levy, Jacob Eisenstein, and Marjan Ghazvininejad. 2019. Training on synthetic noise improves robustness to natural noise in machine translation. In Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019), pages 42–47. [our card](https://md.research.elamur.ai/free/en/papers/karpukhin-2019-training-synthetic-noise-improves-robustness/)
67. Divyansh Kaushik, Eduard Hovy, and Zachary Lipton. 2019. Learning the difference that makes a difference with counterfactually-augmented data. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Divyansh+Kaushik%2C+Eduard+Hovy%2C+and+Zachary+Lipton%2E+2019%2E+Learning+the+difference+that+makes+a+difference+with+counterfactually%2Daugmented+data%2E+In+International+Conference+on+Learning+Representations%2E)
68. Daniel Khashabi, Tushar Khot, and Ashish Sabharwal. 2020. More bang for your buck: Natural perturbation for robust question answering. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 163– 170, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Daniel+Khashabi%2C+Tushar+Khot%2C+and+Ashish+Sabharwal%2E+2020%2E+More+bang+for+your+buck%3A+Natural+perturbation+for+robust+question+answering%2E+In+Proceedings+of+the+2020+Conference+on+Empirical+Methods+in+Nat)
69. Douwe Kiela, Max Bartolo, Yixin Nie, Divyansh Kaushik, Atticus Geiger, Zhengxuan Wu, Bertie Vidgen, Grusha Prasad, Amanpreet Singh, Pratik Ringshia, Zhiyi Ma, Tristan Thrush, Sebastian Riedel, Zeerak Waseem, Pontus Stenetorp, Robin Jia, Mohit Bansal, Christopher Potts, and Adina Williams. 2021. Dyna… [find](https://scholar.google.com/scholar?q=Douwe+Kiela%2C+Max+Bartolo%2C+Yixin+Nie%2C+Divyansh+Kaushik%2C+Atticus+Geiger%2C+Zhengxuan+Wu%2C+Bertie+Vidgen%2C+Grusha+Prasad%2C+Amanpreet+Singh%2C+Pratik+Ringshia%2C+Zhiyi+Ma%2C+Tristan+Thrush%2C+Sebastian+Riedel%2C+Zeerak+)
70. Durk P Kingma, Tim Salimans, and Max Welling. 2015. Variational dropout and the local reparameterization trick. In Advances in Neural Information Processing Systems, volume 28. Curran Associates, Inc. [find](https://scholar.google.com/scholar?q=Durk+P+Kingma%2C+Tim+Salimans%2C+and+Max+Welling%2E+2015%2E+Variational+dropout+and+the+local+reparameterization+trick%2E+In+Advances+in+Neural+Information+Processing+Systems%2C+volume+28%2E+Curran+Associates%2C+Inc%2E)
71. Wojciech Kryscinski, Nitish Shirish Keskar, Bryan Mc-Cann, Caiming Xiong, and Richard Socher. 2019. Neural text summarization: A critical evaluation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Langua… [our card](https://md.research.elamur.ai/free/en/papers/kryscinski-2019-neural-text-summarization-critical-evaluation/)
72. Volodymyr Kuleshov, Shantanu Thakoor, Tingfung Lau, and Stefano Ermon. 2018. Adversarial examples for natural language classification problems. [find](https://scholar.google.com/scholar?q=Volodymyr+Kuleshov%2C+Shantanu+Thakoor%2C+Tingfung+Lau%2C+and+Stefano+Ermon%2E+2018%2E+Adversarial+examples+for+natural+language+classification+problems%2E)
73. Keita Kurita, Paul Michel, and Graham Neubig. 2020. Weight poisoning attacks on pretrained models. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 2793– 2806, Online. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/kurita-2020-weight-poisoning-attacks-pretrained-models/)
74. Preethi Lahoti, Alex Beutel, Jilin Chen, Kang Lee, Flavien Prost, Nithum Thain, Xuezhi Wang, and Ed Chi. 2020. Fairness without demographics through adversarially reweighted learning. In Advances in Neural Information Processing Systems, volume 33, pages 728–740. Curran Associates, Inc. [find](https://scholar.google.com/scholar?q=Preethi+Lahoti%2C+Alex+Beutel%2C+Jilin+Chen%2C+Kang+Lee%2C+Flavien+Prost%2C+Nithum+Thain%2C+Xuezhi+Wang%2C+and+Ed+Chi%2E+2020%2E+Fairness+without+demographics+through+adversarially+reweighted+learning%2E+In+Advances+in+N)
75. Balaji Lakshminarayanan, Alexander Pritzel, and Charles Blundell. 2017. Simple and scalable predictive uncertainty estimation using deep ensembles. In Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS’17, page 6405–6416, Red Hook, NY, USA. Curran Associa… [find](https://scholar.google.com/scholar?q=Balaji+Lakshminarayanan%2C+Alexander+Pritzel%2C+and+Charles+Blundell%2E+2017%2E+Simple+and+scalable+predictive+uncertainty+estimation+using+deep+ensembles%2E+In+Proceedings+of+the+31st+International+Conference+)
76. Kong Joo Lee, Cheol Jung Kweon, Jungyun Seo, and Gil Chang Kim. 1995. A robust parser based on syntactic information. In Seventh Conference of the European Chapter of the Association for Computational Linguistics, Dublin, Ireland. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Kong+Joo+Lee%2C+Cheol+Jung+Kweon%2C+Jungyun+Seo%2C+and+Gil+Chang+Kim%2E+1995%2E+A+robust+parser+based+on+syntactic+information%2E+In+Seventh+Conference+of+the+European+Chapter+of+the+Association+for+Computational)
77. Qi Lei, Lingfei Wu, Pin-Yu Chen, Alex Dimakis, Inderjit S. Dhillon, and Michael J Witbrock. 2019. Discrete adversarial attacks and submodular optimization with applications to text classification. In Proceedings of Machine Learning and Systems, volume 1, pages 146–165. [find](https://scholar.google.com/scholar?q=Qi+Lei%2C+Lingfei+Wu%2C+Pin%2DYu+Chen%2C+Alex+Dimakis%2C+Inderjit+S%2E+Dhillon%2C+and+Michael+J+Witbrock%2E+2019%2E+Discrete+adversarial+attacks+and+submodular+optimization+with+applications+to+text+classification%2E+In+)
78. Patrick Lewis, Pontus Stenetorp, and Sebastian Riedel. 2021. Question and answer test-train overlap in open-domain question answering datasets. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 1000–1008, Online. Associ… [find](https://scholar.google.com/scholar?q=Patrick+Lewis%2C+Pontus+Stenetorp%2C+and+Sebastian+Riedel%2E+2021%2E+Question+and+answer+test%2Dtrain+overlap+in+open%2Ddomain+question+answering+datasets%2E+In+Proceedings+of+the+16th+Conference+of+the+European+Ch)
79. Dianqi Li, Yizhe Zhang, Hao Peng, Liqun Chen, Chris Brockett, Ming-Ting Sun, and Bill Dolan. 2021. Contextualized perturbation for textual adversarial attack. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technolo… [our card](https://md.research.elamur.ai/free/en/papers/li-2021-contextualized-perturbation-textual-adversarial-attack/)
80. Haoliang Li, Sinno Jialin Pan, Shiqi Wang, and Alex C Kot. 2018. Domain generalization with adversarial feature learning. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit.(CVPR). [find](https://scholar.google.com/scholar?q=Haoliang+Li%2C+Sinno+Jialin+Pan%2C+Shiqi+Wang%2C+and+Alex+C+Kot%2E+2018%2E+Domain+generalization+with+adversarial+feature+learning%2E+In+Proc%2E+IEEE+Conf%2E+Comput%2E+Vis%2E+Pattern+Recognit%2E%28CVPR%29%2E)
81. Jinfeng Li, Shouling Ji, Tianyu Du, Bo Li, and Ting Wang. 2019. Textbugger: Generating adversarial text against real-world applications. In 26th Annual Network and Distributed System Security Symposium, NDSS 2019, San Diego, California, USA, February 24-27, 2019. The Internet Society. [our card](https://md.research.elamur.ai/free/en/papers/li-2018-textbugger-generating-adversarial-text-against/)
82. Linyang Li, Ruotian Ma, Qipeng Guo, Xiangyang Xue, and Xipeng Qiu. 2020. BERT-ATTACK: Adversarial attack against BERT using BERT. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 6193–6202, Online. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/li-2020-bert-attack-adversarial-attack-against/)
83. Bill Yuchen Lin, Wenyang Gao, Jun Yan, Ryan Moreno, and Xiang Ren. 2021. RockNER: A simple method to create adversarial examples for evaluating the robustness of named entity recognition models. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 3728–373… [find](https://scholar.google.com/scholar?q=Bill+Yuchen+Lin%2C+Wenyang+Gao%2C+Jun+Yan%2C+Ryan+Moreno%2C+and+Xiang+Ren%2E+2021%2E+RockNER%3A+A+simple+method+to+create+adversarial+examples+for+evaluating+the+robustness+of+named+entity+recognition+models%2E+In+Pr)
84. Tal Linzen. 2020. How can we accelerate progress towards human-like linguistic generalization? In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5210– 5217. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/linzen-2020-how-can-we-accelerate-progress/)
85. Evan Z Liu, Behzad Haghgoo, Annie S Chen, Aditi Raghunathan, Pang Wei Koh, Shiori Sagawa, Percy Liang, and Chelsea Finn. 2021. Just train twice: Improving group robustness without training group information. In Proceedings of the 38th International Conference on Machine Learning, volume 139 of Proce… [find](https://scholar.google.com/scholar?q=Evan+Z+Liu%2C+Behzad+Haghgoo%2C+Annie+S+Chen%2C+Aditi+Raghunathan%2C+Pang+Wei+Koh%2C+Shiori+Sagawa%2C+Percy+Liang%2C+and+Chelsea+Finn%2E+2021%2E+Just+train+twice%3A+Improving+group+robustness+without+training+group+infor)
86. Nelson F. Liu, Roy Schwartz, and Noah A. Smith. 2019. Inoculation by fine-tuning: A method for analyzing challenge datasets. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Pap… [our card](https://md.research.elamur.ai/free/en/papers/liu-2019-inoculation-fine-tuning-method-analyzing/)
87. Xiaodong Liu, Hao Cheng, Pengcheng He, Weizhu Chen, Yu Wang, Hoifung Poon, and Jianfeng Gao. 2020. Adversarial training for large neural language models. arXiv preprint arXiv:2004.08994. — [arXiv:2004.08994](https://arxiv.org/abs/2004.08994) [find](https://scholar.google.com/scholar?q=Xiaodong+Liu%2C+Hao+Cheng%2C+Pengcheng+He%2C+Weizhu+Chen%2C+Yu+Wang%2C+Hoifung+Poon%2C+and+Jianfeng+Gao%2E+2020%2E+Adversarial+training+for+large+neural+language+models%2E+arXiv+preprint+arXiv%3A2004%2E08994%2E+%E2%80%94+%5BarXiv%3A2004)
88. Rabeeh Karimi Mahabadi, Yonatan Belinkov, and James Henderson. 2020. End-to-end bias mitigation by modelling biases in corpora. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Online, July 5-10, 2020, pages 8706–8716. Association for Computationa… [our card](https://md.research.elamur.ai/free/en/papers/mahabadi-2020-end-end-bias-mitigation-modelling/)
89. Gabriel Marzinotto, Géraldine Damnati, Frédéric Béchet, and Benoît Favre. 2019. Robust semantic parsing with adversarial learning for domain generalization. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologi… [find](https://scholar.google.com/scholar?q=Gabriel+Marzinotto%2C+G%C3%A9raldine+Damnati%2C+Fr%C3%A9d%C3%A9ric+B%C3%A9chet%2C+and+Beno%C3%AEt+Favre%2E+2019%2E+Robust+semantic+parsing+with+adversarial+learning+for+domain+generalization%2E+In+Proceedings+of+the+2019+Conference+of+th)
90. Joshua Maynez, Shashi Narayan, Bernd Bohnet, and Ryan McDonald. 2020. On faithfulness and factuality in abstractive summarization. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 1906–1919, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Joshua+Maynez%2C+Shashi+Narayan%2C+Bernd+Bohnet%2C+and+Ryan+McDonald%2E+2020%2E+On+faithfulness+and+factuality+in+abstractive+summarization%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+the+Association+for+Comp)
91. Tom McCoy, Ellie Pavlick, and Tal Linzen. 2019. Right for the wrong reasons: Diagnosing syntactic heuristics in natural language inference. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3428–3448, Florence, Italy. Association for Computational Ling… [our card](https://md.research.elamur.ai/free/en/papers/mccoy-2019-right-wrong-reasons-diagnosing-syntactic/)
92. Mahdi Milani Fard, Quentin Cormier, Kevin Canini, and Maya Gupta. 2016. Launch and iterate: Reducing prediction churn. In D. D. Lee, M. Sugiyama, U. V. Luxburg, I. Guyon, and R. Garnett, editors, Advances in Neural Information Processing Systems 29, pages 3179–3187. Curran Associates, Inc. [find](https://scholar.google.com/scholar?q=Mahdi+Milani+Fard%2C+Quentin+Cormier%2C+Kevin+Canini%2C+and+Maya+Gupta%2E+2016%2E+Launch+and+iterate%3A+Reducing+prediction+churn%2E+In+D%2E+D%2E+Lee%2C+M%2E+Sugiyama%2C+U%2E+V%2E+Luxburg%2C+I%2E+Guyon%2C+and+R%2E+Garnett%2C+editors%2C+Adva)
93. John Miller, Karl Krauth, Benjamin Recht, and Ludwig Schmidt. 2020. The effect of natural distribution shift on question answering models. In Proceedings of the 37th International Conference on Machine Learning, volume 119 of Proceedings of Machine Learning Research, pages 6905–6916. PMLR. [find](https://scholar.google.com/scholar?q=John+Miller%2C+Karl+Krauth%2C+Benjamin+Recht%2C+and+Ludwig+Schmidt%2E+2020%2E+The+effect+of+natural+distribution+shift+on+question+answering+models%2E+In+Proceedings+of+the+37th+International+Conference+on+Machin)
94. Takeru Miyato, Andrew M. Dai, and Ian Goodfellow. 2017. Adversarial training methods for semi-supervised text classification. In Proceedings of the International Conference on Learning Representations. [our card](https://md.research.elamur.ai/free/en/papers/miyato-2016-adversarial-training-methods-semi-supervised/)
95. John Morris, Eli Lifland, Jack Lanchantin, Yangfeng Ji, and Yanjun Qi. 2020a. Reevaluating adversarial examples in natural language. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 3829–3839, Online. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/morris-2020-reevaluating-adversarial-examples-natural-language/)
96. John Morris, Eli Lifland, Jin Yong Yoo, Jake Grigsby, Di Jin, and Yanjun Qi. 2020b. TextAttack: A framework for adversarial attacks, data augmentation, and adversarial training in NLP. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, p… [our card](https://md.research.elamur.ai/free/en/papers/morris-2020-textattack-framework-adversarial-attacks-data/)
97. Saeid Motiian, Marco Piccirilli, Donald A Adjeroh, and Gianfranco Doretto. 2017. Unified deep supervised domain adaptation and generalization. In The IEEE International Conference on Computer Vision (ICCV), volume 2, page 3. [find](https://scholar.google.com/scholar?q=Saeid+Motiian%2C+Marco+Piccirilli%2C+Donald+A+Adjeroh%2C+and+Gianfranco+Doretto%2E+2017%2E+Unified+deep+supervised+domain+adaptation+and+generalization%2E+In+The+IEEE+International+Conference+on+Computer+Vision+%28)
98. Krikamol Muandet, David Balduzzi, and Bernhard Schölkopf. 2013. Domain generalization via invariant feature representation. In Proceedings of the 30th International Conference on Machine Learning, volume 28 of Proceedings of Machine Learning Research, pages 10–18, Atlanta, Georgia, USA. PMLR. [find](https://scholar.google.com/scholar?q=Krikamol+Muandet%2C+David+Balduzzi%2C+and+Bernhard+Sch%C3%B6lkopf%2E+2013%2E+Domain+generalization+via+invariant+feature+representation%2E+In+Proceedings+of+the+30th+International+Conference+on+Machine+Learning%2C+vol)
99. Aakanksha Naik, Abhilasha Ravichander, Norman Sadeh, Carolyn Rose, and Graham Neubig. 2018. Stress test evaluation for natural language inference. In Proceedings of the 27th International Conference on Computational Linguistics, pages 2340–2353. [find](https://scholar.google.com/scholar?q=Aakanksha+Naik%2C+Abhilasha+Ravichander%2C+Norman+Sadeh%2C+Carolyn+Rose%2C+and+Graham+Neubig%2E+2018%2E+Stress+test+evaluation+for+natural+language+inference%2E+In+Proceedings+of+the+27th+International+Conference+o)
100. Junhyun Nam, Hyuntak Cha, Sungsoo Ahn, Jaeho Lee, and Jinwoo Shin. 2020. Learning from failure: Training debiased classifier from biased classifier. In Advances in Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Junhyun+Nam%2C+Hyuntak+Cha%2C+Sungsoo+Ahn%2C+Jaeho+Lee%2C+and+Jinwoo+Shin%2E+2020%2E+Learning+from+failure%3A+Training+debiased+classifier+from+biased+classifier%2E+In+Advances+in+Neural+Information+Processing+System)
101. Yixin Nie, Adina Williams, Emily Dinan, Mohit Bansal, Jason Weston, and Douwe Kiela. 2020. Adversarial NLI: A new benchmark for natural language understanding. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 4885–4901, Online. Association for Computa… [find](https://scholar.google.com/scholar?q=Yixin+Nie%2C+Adina+Williams%2C+Emily+Dinan%2C+Mohit+Bansal%2C+Jason+Weston%2C+and+Douwe+Kiela%2E+2020%2E+Adversarial+NLI%3A+A+new+benchmark+for+natural+language+understanding%2E+In+Proceedings+of+the+58th+Annual+Meetin)
102. Yonatan Oren, Shiori Sagawa, Tatsunori B Hashimoto, and Percy Liang. 2019. Distributionally robust language modeling. In EMNLP/IJCNLP (1). [find](https://scholar.google.com/scholar?q=Yonatan+Oren%2C+Shiori+Sagawa%2C+Tatsunori+B+Hashimoto%2C+and+Percy+Liang%2E+2019%2E+Distributionally+robust+language+modeling%2E+In+EMNLP%2FIJCNLP+%281%29%2E)
103. Yaniv Ovadia, Emily Fertig, Jie Ren, Zachary Nado, D. Sculley, Sebastian Nowozin, Joshua Dillon, Balaji Lakshminarayanan, and Jasper Snoek. 2019. Can you trust your model's uncertainty? evaluating predictive uncertainty under dataset shift. In Advances in Neural Information Processing Systems, volum… [find](https://scholar.google.com/scholar?q=Yaniv+Ovadia%2C+Emily+Fertig%2C+Jie+Ren%2C+Zachary+Nado%2C+D%2E+Sculley%2C+Sebastian+Nowozin%2C+Joshua+Dillon%2C+Balaji+Lakshminarayanan%2C+and+Jasper+Snoek%2E+2019%2E+Can+you+trust+your+model%27s+uncertainty%3F+evaluating+pre)
104. Sinno Jialin Pan and Qiang Yang. 2010. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10):1345–1359. [find](https://scholar.google.com/scholar?q=Sinno+Jialin+Pan+and+Qiang+Yang%2E+2010%2E+A+survey+on+transfer+learning%2E+IEEE+Transactions+on+Knowledge+and+Data+Engineering%2C+22%2810%29%3A1345%E2%80%931359%2E)
105. Ankur Parikh, Xuezhi Wang, Sebastian Gehrmann, Manaal Faruqui, Bhuwan Dhingra, Diyi Yang, and Dipanjan Das. 2020. ToTTo: A controlled table-to-text generation dataset. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1173–1186, Online. Associat… [our card](https://md.research.elamur.ai/free/en/papers/parikh-2020-totto-controlled-table-text-generation/)
106. Vishal M Patel, Raghuraman Gopalan, Ruonan Li, and Rama Chellappa. 2015. Visual domain adaptation: A survey of recent advances. IEEE Signal Processing Magazine, 32(3):53–69. [find](https://scholar.google.com/scholar?q=Vishal+M+Patel%2C+Raghuraman+Gopalan%2C+Ruonan+Li%2C+and+Rama+Chellappa%2E+2015%2E+Visual+domain+adaptation%3A+A+survey+of+recent+advances%2E+IEEE+Signal+Processing+Magazine%2C+32%283%29%3A53%E2%80%9369%2E)
107. Adam Poliak, Jason Naradowsky, Aparajita Haldar, Rachel Rudinger, and Benjamin Van Durme. 2018. Hypothesis only baselines in natural language inference. In Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics, pages 180–191. [find](https://scholar.google.com/scholar?q=Adam+Poliak%2C+Jason+Naradowsky%2C+Aparajita+Haldar%2C+Rachel+Rudinger%2C+and+Benjamin+Van+Durme%2E+2018%2E+Hypothesis+only+baselines+in+natural+language+inference%2E+In+Proceedings+of+the+Seventh+Joint+Conference+)
108. Marcelo Prates, Pedro Avelar, and Luís Lamb. 2019. Assessing gender bias in machine translation: a case study with google translate. Neural Computing and Applications, 32. [find](https://scholar.google.com/scholar?q=Marcelo+Prates%2C+Pedro+Avelar%2C+and+Lu%C3%ADs+Lamb%2E+2019%2E+Assessing+gender+bias+in+machine+translation%3A+a+case+study+with+google+translate%2E+Neural+Computing+and+Applications%2C+32%2E)
109. Danish Pruthi, Bhuwan Dhingra, and Zachary C. Lipton. 2019. Combating adversarial misspellings with robust word recognition. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 5582–5591, Florence, Italy. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/pruthi-2019-combating-adversarial-misspellings-robust-word/)
110. Shuhuai Ren, Yihe Deng, Kun He, and Wanxiang Che. 2019. Generating natural language adversarial examples through probability weighted word saliency. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 1085–1097, Florence, Italy. Association for Computati… [our card](https://md.research.elamur.ai/free/en/papers/ren-2019-generating-natural-language-adversarial-examples/)
111. Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2018. Semantically equivalent adversarial rules for debugging NLP models. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 856–865, Melbourne, Australia. Association for C… [find](https://scholar.google.com/scholar?q=Marco+Tulio+Ribeiro%2C+Sameer+Singh%2C+and+Carlos+Guestrin%2E+2018%2E+Semantically+equivalent+adversarial+rules+for+debugging+NLP+models%2E+In+Proceedings+of+the+56th+Annual+Meeting+of+the+Association+for+Compu)
112. Marco Tulio Ribeiro, Tongshuang Wu, Carlos Guestrin, and Sameer Singh. 2020. Beyond accuracy: Behavioral testing of NLP models with CheckList. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 4902– 4912, Online. Association for Computational Linguisti… [find](https://scholar.google.com/scholar?q=Marco+Tulio+Ribeiro%2C+Tongshuang+Wu%2C+Carlos+Guestrin%2C+and+Sameer+Singh%2E+2020%2E+Beyond+accuracy%3A+Behavioral+testing+of+NLP+models+with+CheckList%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+the+Associat)
113. Elan Rosenfeld, Pradeep Kumar Ravikumar, and Andrej Risteski. 2021. The risks of invariant risk minimization. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Elan+Rosenfeld%2C+Pradeep+Kumar+Ravikumar%2C+and+Andrej+Risteski%2E+2021%2E+The+risks+of+invariant+risk+minimization%2E+In+International+Conference+on+Learning+Representations%2E)
114. Alexis Ross, Tongshuang Wu, Hao Peng, Matthew E. Peters, and Matt Gardner. 2021. Tailor: Generating and perturbing text with semantic controls. [our card](https://md.research.elamur.ai/free/en/papers/ross-2022-tailor-generating-perturbing-text-semantic/)
115. Artem Rozantsev, Mathieu Salzmann, and Pascal Fua. 2018. Beyond sharing weights for deep domain adaptation. IEEE transactions on pattern analysis and machine intelligence, 41(4):801–814. [find](https://scholar.google.com/scholar?q=Artem+Rozantsev%2C+Mathieu+Salzmann%2C+and+Pascal+Fua%2E+2018%2E+Beyond+sharing+weights+for+deep+domain+adaptation%2E+IEEE+transactions+on+pattern+analysis+and+machine+intelligence%2C+41%284%29%3A801%E2%80%93814%2E)
116. Rachel Rudinger, Chandler May, and Benjamin Van Durme. 2017. Social bias in elicited natural language inferences. In Proceedings of the First ACL Workshop on Ethics in Natural Language Processing, pages 74–79, Valencia, Spain. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/rudinger-2017-social-bias-elicited-natural-language/)
117. Rachel Rudinger, Jason Naradowsky, Brian Leonard, and Benjamin Van Durme. 2018. Gender bias in coreference resolution. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, New Orleans, Louisiana. Associatio… [our card](https://md.research.elamur.ai/free/en/papers/rudinger-2018-gender-bias-coreference-resolution/)
118. Shiori Sagawa, Pang Wei Koh, Tatsunori B. Hashimoto, and Percy Liang. 2020a. Distributionally robust neural networks. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Shiori+Sagawa%2C+Pang+Wei+Koh%2C+Tatsunori+B%2E+Hashimoto%2C+and+Percy+Liang%2E+2020a%2E+Distributionally+robust+neural+networks%2E+In+International+Conference+on+Learning+Representations%2E)
119. Shiori Sagawa, Aditi Raghunathan, Pang Wei Koh, and Percy Liang. 2020b. An investigation of why overparameterization exacerbates spurious correlations. [find](https://scholar.google.com/scholar?q=Shiori+Sagawa%2C+Aditi+Raghunathan%2C+Pang+Wei+Koh%2C+and+Percy+Liang%2E+2020b%2E+An+investigation+of+why+overparameterization+exacerbates+spurious+correlations%2E)
120. Viktor Schlegel, Goran Nenadic, and Riza Batista-Navarro. 2021. Semantics altering modifications for evaluating comprehension in machine reading. In Thirty-Fifth AAAI Conference on Artificial Intelligence, pages 13762–13770. AAAI Press. [find](https://scholar.google.com/scholar?q=Viktor+Schlegel%2C+Goran+Nenadic%2C+and+Riza+Batista%2DNavarro%2E+2021%2E+Semantics+altering+modifications+for+evaluating+comprehension+in+machine+reading%2E+In+Thirty%2DFifth+AAAI+Conference+on+Artificial+Intellig)
121. Leo Schwinn, René Raab, An Nguyen, Dario Zanca, and Bjoern Eskofier. 2021. Exploring misclassifications of robust neural networks to enhance adversarial attacks. [find](https://scholar.google.com/scholar?q=Leo+Schwinn%2C+Ren%C3%A9+Raab%2C+An+Nguyen%2C+Dario+Zanca%2C+and+Bjoern+Eskofier%2E+2021%2E+Exploring+misclassifications+of+robust+neural+networks+to+enhance+adversarial+attacks%2E)
122. Thibault Sellam, Dipanjan Das, and Ankur Parikh. 2020. BLEURT: Learning robust metrics for text generation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7881–7892, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Thibault+Sellam%2C+Dipanjan+Das%2C+and+Ankur+Parikh%2E+2020%2E+BLEURT%3A+Learning+robust+metrics+for+text+generation%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+)
123. Zhouxing Shi and Minlie Huang. 2020. Robustness to modification with shared words in paraphrase identification. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 164–171, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Zhouxing+Shi+and+Minlie+Huang%2E+2020%2E+Robustness+to+modification+with+shared+words+in+paraphrase+identification%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+EMNLP+2020%2C+pages+164%E2%80%93171%2C)
124. Walter Simoncini and Gerasimos Spanakis. 2021. SeqAttack: On adversarial attacks for named entity recognition. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 308–318, Online and Punta Cana, Dominican Republic. Association for C… [find](https://scholar.google.com/scholar?q=Walter+Simoncini+and+Gerasimos+Spanakis%2E+2021%2E+SeqAttack%3A+On+adversarial+attacks+for+named+entity+recognition%2E+In+Proceedings+of+the+2021+Conference+on+Empirical+Methods+in+Natural+Language+Processing)
125. Liwei Song, Xinwei Yu, Hsuan-Tung Peng, and Karthik Narasimhan. 2021. Universal adversarial attacks with natural triggers for text classification. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages… [find](https://scholar.google.com/scholar?q=Liwei+Song%2C+Xinwei+Yu%2C+Hsuan%2DTung+Peng%2C+and+Karthik+Narasimhan%2E+2021%2E+Universal+adversarial+attacks+with+natural+triggers+for+text+classification%2E+In+Proceedings+of+the+2021+Conference+of+the+North+Am)
126. Megha Srivastava, Tatsunori Hashimoto, and Percy Liang. 2020. Robustness to spurious correlations via human annotations. In Proceedings of the 37th International Conference on Machine Learning, volume 119 of Proceedings of Machine Learning Research, pages 9109–9119. PMLR. [find](https://scholar.google.com/scholar?q=Megha+Srivastava%2C+Tatsunori+Hashimoto%2C+and+Percy+Liang%2E+2020%2E+Robustness+to+spurious+correlations+via+human+annotations%2E+In+Proceedings+of+the+37th+International+Conference+on+Machine+Learning%2C+volume)
127. Tony Sun, Andrew Gaut, Shirlyn Tang, Yuxin Huang, Mai ElSherief, Jieyu Zhao, Diba Mirza, Elizabeth Belding, Kai-Wei Chang, and William Yang Wang. 2019. Mitigating gender bias in natural language processing: Literature review. In Proceedings of the 57th Annual Meeting of the Association for Computati… [our card](https://md.research.elamur.ai/free/en/papers/sun-2019-mitigating-gender-bias-natural-language/)
128. Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow, and Rob Fergus. 2013. Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199. [our card](https://md.research.elamur.ai/free/en/papers/szegedy-2013-intriguing-properties-neural-networks/)
129. Samson Tan and Shafiq Joty. 2021. Code-mixing on sesame street: Dawn of the adversarial polyglots. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 3596–3616, Online. Association for Computational… [find](https://scholar.google.com/scholar?q=Samson+Tan+and+Shafiq+Joty%2E+2021%2E+Code%2Dmixing+on+sesame+street%3A+Dawn+of+the+adversarial+polyglots%2E+In+Proceedings+of+the+2021+Conference+of+the+North+American+Chapter+of+the+Association+for+Computatio)
130. Samson Tan, Shafiq Joty, Kathy Baxter, Araz Taeihagh, Gregory A. Bennett, and Min-Yen Kan. 2021. Reliability testing for natural language processing systems. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natu… [find](https://scholar.google.com/scholar?q=Samson+Tan%2C+Shafiq+Joty%2C+Kathy+Baxter%2C+Araz+Taeihagh%2C+Gregory+A%2E+Bennett%2C+and+Min%2DYen+Kan%2E+2021%2E+Reliability+testing+for+natural+language+processing+systems%2E+In+Proceedings+of+the+59th+Annual+Meeting+)
131. Samson Tan, Shafiq Joty, Min-Yen Kan, and Richard Socher. 2020a. It’s morphin’ time! Combating linguistic discrimination with inflectional perturbations. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 2920–2935, Online. Association for Computational… [our card](https://md.research.elamur.ai/free/en/papers/tan-2020-it-s-morphin-time-combating/)
132. Samson Tan, Shafiq Joty, Lav Varshney, and Min-Yen Kan. 2020b. Mind your inflections! Improving NLP for non-standard Englishes with Base-Inflection Encoding. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 5647–5663, Online. Association for Co… [find](https://scholar.google.com/scholar?q=Samson+Tan%2C+Shafiq+Joty%2C+Lav+Varshney%2C+and+Min%2DYen+Kan%2E+2020b%2E+Mind+your+inflections%21+Improving+NLP+for+non%2Dstandard+Englishes+with+Base%2DInflection+Encoding%2E+In+Proceedings+of+the+2020+Conference+on+E)
133. Rohan Taori, Achal Dave, Vaishaal Shankar, Nicholas Carlini, Benjamin Recht, and Ludwig Schmidt. 2020. Measuring robustness to natural distribution shifts in image classification. In Advances in Neural Information Processing Systems, volume 33, pages 18583–18599. Curran Associates, Inc. [find](https://scholar.google.com/scholar?q=Rohan+Taori%2C+Achal+Dave%2C+Vaishaal+Shankar%2C+Nicholas+Carlini%2C+Benjamin+Recht%2C+and+Ludwig+Schmidt%2E+2020%2E+Measuring+robustness+to+natural+distribution+shifts+in+image+classification%2E+In+Advances+in+Neura)
134. Dimitris Tsipras, Shibani Santurkar, Logan Engstrom, Alexander Turner, and Aleksander Madry. 2019. Robustness may be at odds with accuracy. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Dimitris+Tsipras%2C+Shibani+Santurkar%2C+Logan+Engstrom%2C+Alexander+Turner%2C+and+Aleksander+Madry%2E+2019%2E+Robustness+may+be+at+odds+with+accuracy%2E+In+International+Conference+on+Learning+Representations%2E)
135. Lifu Tu, Garima Lalwani, Spandana Gella, and He He. 2020. An empirical study on robustness to spurious correlations using pre-trained language models. Transactions of the Association for Computational Linguistics, 8:621–633. [find](https://scholar.google.com/scholar?q=Lifu+Tu%2C+Garima+Lalwani%2C+Spandana+Gella%2C+and+He+He%2E+2020%2E+An+empirical+study+on+robustness+to+spurious+correlations+using+pre%2Dtrained+language+models%2E+Transactions+of+the+Association+for+Computational)
136. Prasetya Ajie Utama, Nafise Sadat Moosavi, and Iryna Gurevych. 2020a. Mind the trade-off: Debiasing NLU models without degrading the in-distribution performance. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 8717–8729, Online. Association for Compu… [our card](https://md.research.elamur.ai/free/en/papers/utama-2020-mind-trade-off-debiasing-nlu/)
137. Prasetya Ajie Utama, Nafise Sadat Moosavi, and Iryna Gurevych. 2020b. Towards debiasing NLU models from unknown biases. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 7597–7610, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Prasetya+Ajie+Utama%2C+Nafise+Sadat+Moosavi%2C+and+Iryna+Gurevych%2E+2020b%2E+Towards+debiasing+NLU+models+from+unknown+biases%2E+In+Proceedings+of+the+2020+Conference+on+Empirical+Methods+in+Natural+Language+P)
138. Vaibhav Vaibhav, Sumeet Singh, Craig Stewart, and Graham Neubig. 2019. Improving robustness of machine translation with synthetic noise. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, volume 2019. [find](https://scholar.google.com/scholar?q=Vaibhav+Vaibhav%2C+Sumeet+Singh%2C+Craig+Stewart%2C+and+Graham+Neubig%2E+2019%2E+Improving+robustness+of+machine+translation+with+synthetic+noise%2E+In+Proceedings+of+the+2019+Conference+of+the+North+American+Cha)
139. Victor Veitch, Alexander D’Amour, Steve Yadlowsky, and Jacob Eisenstein. 2021. Counterfactual invariance to spurious correlations in text classification. In Advances in Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Victor+Veitch%2C+Alexander+D%E2%80%99Amour%2C+Steve+Yadlowsky%2C+and+Jacob+Eisenstein%2E+2021%2E+Counterfactual+invariance+to+spurious+correlations+in+text+classification%2E+In+Advances+in+Neural+Information+Processing+S)
140. Giorgos Vernikos, Katerina Margatina, Alexandra Chronopoulou, and Ion Androutsopoulos. 2020. Domain adversarial fine-tuning as an effective regularizer. CoRR, abs/2009.13366. [find](https://scholar.google.com/scholar?q=Giorgos+Vernikos%2C+Katerina+Margatina%2C+Alexandra+Chronopoulou%2C+and+Ion+Androutsopoulos%2E+2020%2E+Domain+adversarial+fine%2Dtuning+as+an+effective+regularizer%2E+CoRR%2C+abs%2F2009%2E13366%2E)
141. Eric Wallace, Shi Feng, Nikhil Kandpal, Matt Gardner, and Sameer Singh. 2019a. Universal adversarial triggers for attacking and analyzing NLP. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Proc… [find](https://scholar.google.com/scholar?q=Eric+Wallace%2C+Shi+Feng%2C+Nikhil+Kandpal%2C+Matt+Gardner%2C+and+Sameer+Singh%2E+2019a%2E+Universal+adversarial+triggers+for+attacking+and+analyzing+NLP%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Method)
142. Eric Wallace, Pedro Rodriguez, Shi Feng, Ikuya Yamada, and Jordan Boyd-Graber. 2019b. Trick Me If You Can: Human-in-the-Loop Generation of Adversarial Examples for Question Answering. Transactions of the Association for Computational Linguistics, 7:387–401. [our card](https://md.research.elamur.ai/free/en/papers/wallace-2019-trick-me-if-you-can/)
143. Eric Wallace, Jens Tuyls, Junlin Wang, Sanjay Subramanian, Matt Gardner, and Sameer Singh. 2019c. AllenNLP interpret: A framework for explaining predictions of NLP models. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Confer… [our card](https://md.research.elamur.ai/free/en/papers/wallace-2019-allennlp-interpret-framework-explaining-predictions/)
144. Eric Wallace, Tony Zhao, Shi Feng, and Sameer Singh. 2021. Concealed data poisoning attacks on NLP models. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 139–150, Online. Association for Computa… [find](https://scholar.google.com/scholar?q=Eric+Wallace%2C+Tony+Zhao%2C+Shi+Feng%2C+and+Sameer+Singh%2E+2021%2E+Concealed+data+poisoning+attacks+on+NLP+models%2E+In+Proceedings+of+the+2021+Conference+of+the+North+American+Chapter+of+the+Association+for+Co)
145. Boxin Wang, Shuohang Wang, Yu Cheng, Zhe Gan, Ruoxi Jia, Bo Li, and Jingjing Liu. 2021a. Infobert: Improving robustness of language models from an information theoretic perspective. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Boxin+Wang%2C+Shuohang+Wang%2C+Yu+Cheng%2C+Zhe+Gan%2C+Ruoxi+Jia%2C+Bo+Li%2C+and+Jingjing+Liu%2E+2021a%2E+Infobert%3A+Improving+robustness+of+language+models+from+an+information+theoretic+perspective%2E+In+International+C)
146. Boxin Wang, Chejian Xu, Shuohang Wang, Zhe Gan, Yu Cheng, Jianfeng Gao, Ahmed Hassan Awadallah, and Bo Li. 2021b. Adversarial glue: A multi-task benchmark for robustness evaluation of language models. [find](https://scholar.google.com/scholar?q=Boxin+Wang%2C+Chejian+Xu%2C+Shuohang+Wang%2C+Zhe+Gan%2C+Yu+Cheng%2C+Jianfeng+Gao%2C+Ahmed+Hassan+Awadallah%2C+and+Bo+Li%2E+2021b%2E+Adversarial+glue%3A+A+multi%2Dtask+benchmark+for+robustness+evaluation+of+language+models%2E)
147. Haohan Wang, Songwei Ge, Zachary C. Lipton, and Eric P. Xing. 2019a. Learning robust global representations by penalizing local predictive power. In Advances in Neural Information Processing Systems, pages 10506–10518. [find](https://scholar.google.com/scholar?q=Haohan+Wang%2C+Songwei+Ge%2C+Zachary+C%2E+Lipton%2C+and+Eric+P%2E+Xing%2E+2019a%2E+Learning+robust+global+representations+by+penalizing+local+predictive+power%2E+In+Advances+in+Neural+Information+Processing+Systems%2C+)
148. Haohan Wang, Zexue He, Zachary C. Lipton, and Eric P. Xing. 2019b. Learning robust representations by projecting superficial statistics out. In 7th International Conference on Learning Representations, ICLR 2019. [find](https://scholar.google.com/scholar?q=Haohan+Wang%2C+Zexue+He%2C+Zachary+C%2E+Lipton%2C+and+Eric+P%2E+Xing%2E+2019b%2E+Learning+robust+representations+by+projecting+superficial+statistics+out%2E+In+7th+International+Conference+on+Learning+Representations)
149. Haohan Wang, Zeyi Huang, Hanlin Zhang, and Eric Xing. 2021c. Toward learning human-aligned cross-domain robust models by countering misaligned features. [find](https://scholar.google.com/scholar?q=Haohan+Wang%2C+Zeyi+Huang%2C+Hanlin+Zhang%2C+and+Eric+Xing%2E+2021c%2E+Toward+learning+human%2Daligned+cross%2Ddomain+robust+models+by+countering+misaligned+features%2E)
150. Haohan Wang, Aaksha Meghawat, Louis-Philippe Morency, and Eric P. Xing. 2017. Select-additive learning: Improving generalization in multimodal sentiment analysis. In 2017 IEEE International Conference on Multimedia and Expo, ICME 2017, pages 949–954. IEEE Computer Society. [find](https://scholar.google.com/scholar?q=Haohan+Wang%2C+Aaksha+Meghawat%2C+Louis%2DPhilippe+Morency%2C+and+Eric+P%2E+Xing%2E+2017%2E+Select%2Dadditive+learning%3A+Improving+generalization+in+multimodal+sentiment+analysis%2E+In+2017+IEEE+International+Conference)
151. Haohan Wang, Xindi Wu, Zeyi Huang, and Eric P Xing. 2020a. High-frequency component helps explain the generalization of convolutional neural networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8684–8694. [find](https://scholar.google.com/scholar?q=Haohan+Wang%2C+Xindi+Wu%2C+Zeyi+Huang%2C+and+Eric+P+Xing%2E+2020a%2E+High%2Dfrequency+component+helps+explain+the+generalization+of+convolutional+neural+networks%2E+In+Proceedings+of+the+IEEE%2FCVF+Conference+on+Comp)
152. Haohan Wang, Zhenglin Wu, and Eric P. Xing. 2019c. Removing confounding factors associated weights in deep neural networks improves the prediction accuracy for healthcare applications. In Biocomputing 2019: Proceedings of the Pacific Symposium, pages 54–65. [find](https://scholar.google.com/scholar?q=Haohan+Wang%2C+Zhenglin+Wu%2C+and+Eric+P%2E+Xing%2E+2019c%2E+Removing+confounding+factors+associated+weights+in+deep+neural+networks+improves+the+prediction+accuracy+for+healthcare+applications%2E+In+Biocomputing)
153. Haohan Wang, Peiyan Zhang, and Eric P Xing. 2020b. Word shape matters: Robust machine translation with visual embedding. arXiv preprint arXiv:2010.09997. — [arXiv:2010.09997](https://arxiv.org/abs/2010.09997) [find](https://scholar.google.com/scholar?q=Haohan+Wang%2C+Peiyan+Zhang%2C+and+Eric+P+Xing%2E+2020b%2E+Word+shape+matters%3A+Robust+machine+translation+with+visual+embedding%2E+arXiv+preprint+arXiv%3A2010%2E09997%2E+%E2%80%94+%5BarXiv%3A2010%2E09997%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F201)
154. Huazheng Wang, Zhe Gan, Xiaodong Liu, Jingjing Liu, Jianfeng Gao, and Hongning Wang. 2019d. Adversarial domain adaptation for machine reading comprehension. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural… [find](https://scholar.google.com/scholar?q=Huazheng+Wang%2C+Zhe+Gan%2C+Xiaodong+Liu%2C+Jingjing+Liu%2C+Jianfeng+Gao%2C+and+Hongning+Wang%2E+2019d%2E+Adversarial+domain+adaptation+for+machine+reading+comprehension%2E+In+Proceedings+of+the+2019+Conference+on+Em)
155. Tianlu Wang, Xuezhi Wang, Yao Qin, Ben Packer, Kang Li, Jilin Chen, Alex Beutel, and Ed Chi. 2020c. CAT-gen: Improving robustness in NLP models via controlled adversarial text generation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 5141–51… [find](https://scholar.google.com/scholar?q=Tianlu+Wang%2C+Xuezhi+Wang%2C+Yao+Qin%2C+Ben+Packer%2C+Kang+Li%2C+Jilin+Chen%2C+Alex+Beutel%2C+and+Ed+Chi%2E+2020c%2E+CAT%2Dgen%3A+Improving+robustness+in+NLP+models+via+controlled+adversarial+text+generation%2E+In+Proceedin)
156. Tianlu Wang, Diyi Yang, and Xuezhi Wang. 2021d. Identifying and mitigating spurious correlations for improving robustness in nlp models. arXiv preprint arXiv:2110.07736. [find](https://scholar.google.com/scholar?q=Tianlu+Wang%2C+Diyi+Yang%2C+and+Xuezhi+Wang%2E+2021d%2E+Identifying+and+mitigating+spurious+correlations+for+improving+robustness+in+nlp+models%2E+arXiv+preprint+arXiv%3A2110%2E07736%2E)
157. Xiaosen Wang, Hao Jin, and Kun He. 2019e. Natural language adversarial attacks and defenses in word level. arXiv preprint arXiv:1909.06723. — [arXiv:1909.06723](https://arxiv.org/abs/1909.06723) [find](https://scholar.google.com/scholar?q=Xiaosen+Wang%2C+Hao+Jin%2C+and+Kun+He%2E+2019e%2E+Natural+language+adversarial+attacks+and+defenses+in+word+level%2E+arXiv+preprint+arXiv%3A1909%2E06723%2E+%E2%80%94+%5BarXiv%3A1909%2E06723%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1909%2E06723%29)
158. Zhao Wang and Aron Culotta. 2020a. Identifying spurious correlations for robust text classification. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 3431–3440, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Zhao+Wang+and+Aron+Culotta%2E+2020a%2E+Identifying+spurious+correlations+for+robust+text+classification%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+EMNLP+2020%2C+pages+3431%E2%80%933440%2C+Online%2E+)
159. Zhao Wang and Aron Culotta. 2020b. Robustness to spurious correlations in text classification via automatically generated counterfactuals. In AAAI. [find](https://scholar.google.com/scholar?q=Zhao+Wang+and+Aron+Culotta%2E+2020b%2E+Robustness+to+spurious+correlations+in+text+classification+via+automatically+generated+counterfactuals%2E+In+AAAI%2E)
160. Zhenyi Wang, Xiaoyang Wang, Bang An, Dong Yu, and Changyou Chen. 2020d. Towards faithful neural table-to-text generation with content-matching constraints. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 1072–1086, Online. Association for Computation… [find](https://scholar.google.com/scholar?q=Zhenyi+Wang%2C+Xiaoyang+Wang%2C+Bang+An%2C+Dong+Yu%2C+and+Changyou+Chen%2E+2020d%2E+Towards+faithful+neural+table%2Dto%2Dtext+generation+with+content%2Dmatching+constraints%2E+In+Proceedings+of+the+58th+Annual+Meeting+of)
161. Garrett Wilson and Diane J. Cook. 2020. A survey of unsupervised deep domain adaptation. ACM Trans. Intell. Syst. Technol., 11(5). [find](https://scholar.google.com/scholar?q=Garrett+Wilson+and+Diane+J%2E+Cook%2E+2020%2E+A+survey+of+unsupervised+deep+domain+adaptation%2E+ACM+Trans%2E+Intell%2E+Syst%2E+Technol%2E%2C+11%285%29%2E)
162. Tongshuang Wu, Marco Tulio Ribeiro, Jeffrey Heer, and Daniel Weld. 2021. Polyjuice: Generating counterfactuals for explaining, evaluating, and improving models. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on N… [our card](https://md.research.elamur.ai/free/en/papers/wu-2021-polyjuice-generating-counterfactuals-explaining-evaluating/)
163. Ruibin Xiong, Yimeng Chen, Liang Pang, Xueqi Cheng, Zhi-Ming Ma, and Yanyan Lan. 2021. Uncertainty calibration for ensemble-based debiasing methods. In Thirty-Fifth Conference on Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Ruibin+Xiong%2C+Yimeng+Chen%2C+Liang+Pang%2C+Xueqi+Cheng%2C+Zhi%2DMing+Ma%2C+and+Yanyan+Lan%2E+2021%2E+Uncertainty+calibration+for+ensemble%2Dbased+debiasing+methods%2E+In+Thirty%2DFifth+Conference+on+Neural+Information+Pr)
164. Yadollah Yaghoobzadeh, Soroush Mehri, Remi Tachet des Combes, T. J. Hazen, and Alessandro Sordoni. 2021. Increasing robustness to spurious correlations using forgettable examples. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Vol… [find](https://scholar.google.com/scholar?q=Yadollah+Yaghoobzadeh%2C+Soroush+Mehri%2C+Remi+Tachet+des+Combes%2C+T%2E+J%2E+Hazen%2C+and+Alessandro+Sordoni%2E+2021%2E+Increasing+robustness+to+spurious+correlations+using+forgettable+examples%2E+In+Proceedings+of+th)
165. Yao-Yuan Yang, Cyrus Rashtchian, Hongyang Zhang, Russ R Salakhutdinov, and Kamalika Chaudhuri. 2020. A closer look at accuracy vs. robustness. In Advances in Neural Information Processing Systems, volume 33, pages 8588–8601. Curran Associates, Inc. [find](https://scholar.google.com/scholar?q=Yao%2DYuan+Yang%2C+Cyrus+Rashtchian%2C+Hongyang+Zhang%2C+Russ+R+Salakhutdinov%2C+and+Kamalika+Chaudhuri%2E+2020%2E+A+closer+look+at+accuracy+vs%2E+robustness%2E+In+Advances+in+Neural+Information+Processing+Systems%2C+vol)
166. Yinfei Yang, Yuan Zhang, Chris Tar, and Jason Baldridge. 2019. PAWS-X: A cross-lingual adversarial dataset for paraphrase identification. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processin… [our card](https://md.research.elamur.ai/free/en/papers/yang-2019-paws-x-cross-lingual-adversarial/)
167. Liping Yuan, Xiaoqing Zheng, Yi Zhou, Cho-Jui Hsieh, and Kai-Wei Chang. 2021. On the transferability of adversarial attacks against neural text classifier. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 1612–1625, Online and Punta Cana, Dominican Rep… [find](https://scholar.google.com/scholar?q=Liping+Yuan%2C+Xiaoqing+Zheng%2C+Yi+Zhou%2C+Cho%2DJui+Hsieh%2C+and+Kai%2DWei+Chang%2E+2021%2E+On+the+transferability+of+adversarial+attacks+against+neural+text+classifier%2E+In+Proceedings+of+the+2021+Conference+on+Emp)
168. Yuan Zang, Fanchao Qi, Chenghao Yang, Zhiyuan Liu, Meng Zhang, Qun Liu, and Maosong Sun. 2020. Word-level textual adversarial attacking as combinatorial optimization. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 6066–6080, Online. Association for… [our card](https://md.research.elamur.ai/free/en/papers/zang-2020-word-level-textual-adversarial-attacking/)
169. Rowan Zellers, Yonatan Bisk, Roy Schwartz, and Yejin Choi. 2018. SWAG: A large-scale adversarial dataset for grounded commonsense inference. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 93– 104, Brussels, Belgium. Association for Computational Ling… [find](https://scholar.google.com/scholar?q=Rowan+Zellers%2C+Yonatan+Bisk%2C+Roy+Schwartz%2C+and+Yejin+Choi%2E+2018%2E+SWAG%3A+A+large%2Dscale+adversarial+dataset+for+grounded+commonsense+inference%2E+In+Proceedings+of+the+2018+Conference+on+Empirical+Methods+)
170. Dejiao Zhang, Ramesh Nallapati, Henghui Zhu, Feng Nan, Cicero dos Santos, Kathleen McKeown, and Bing Xiang. 2020a. Unsupervised domain adaptation for cross-lingual text labeling. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings, pages 3527–3536. [find](https://scholar.google.com/scholar?q=Dejiao+Zhang%2C+Ramesh+Nallapati%2C+Henghui+Zhu%2C+Feng+Nan%2C+Cicero+dos+Santos%2C+Kathleen+McKeown%2C+and+Bing+Xiang%2E+2020a%2E+Unsupervised+domain+adaptation+for+cross%2Dlingual+text+labeling%2E+In+Proceedings+of+the)
171. Hongyang Zhang, Yaodong Yu, Jiantao Jiao, Eric P. Xing, Laurent El Ghaoui, and Michael I. Jordan. 2019a. Theoretically principled trade-off between robustness and accuracy. In International Conference on Machine Learning. [find](https://scholar.google.com/scholar?q=Hongyang+Zhang%2C+Yaodong+Yu%2C+Jiantao+Jiao%2C+Eric+P%2E+Xing%2C+Laurent+El+Ghaoui%2C+and+Michael+I%2E+Jordan%2E+2019a%2E+Theoretically+principled+trade%2Doff+between+robustness+and+accuracy%2E+In+International+Conference)
172. Hongyi Zhang, Moustapha Cisse, Yann N. Dauphin, and David Lopez-Paz. 2018. mixup: Beyond empirical risk minimization. In International Conference on Learning Representations. [our card](https://md.research.elamur.ai/free/en/papers/zhang-2017-mixup-empirical-risk-minimization/)
173. Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger, and Yoav Artzi. 2020b. Bertscore: Evaluating text generation with bert. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Tianyi+Zhang%2C+Varsha+Kishore%2C+Felix+Wu%2C+Kilian+Q%2E+Weinberger%2C+and+Yoav+Artzi%2E+2020b%2E+Bertscore%3A+Evaluating+text+generation+with+bert%2E+In+International+Conference+on+Learning+Representations%2E)
174. Wei Emma Zhang, Quan Z Sheng, Ahoud Alhazmi, and Chenliang Li. 2020c. Adversarial attacks on deep-learning models in natural language processing: A survey. ACM Transactions on Intelligent Systems and Technology (TIST), 11(3):1–41. [find](https://scholar.google.com/scholar?q=Wei+Emma+Zhang%2C+Quan+Z+Sheng%2C+Ahoud+Alhazmi%2C+and+Chenliang+Li%2E+2020c%2E+Adversarial+attacks+on+deep%2Dlearning+models+in+natural+language+processing%3A+A+survey%2E+ACM+Transactions+on+Intelligent+Systems+and+)
175. Yu Zhang, Peter Tiňo, Aleš Leonardis, and Ke Tang. 2021. A survey on neural network interpretability. IEEE Transactions on Emerging Topics in Computational Intelligence, 5(5):726–742. [find](https://scholar.google.com/scholar?q=Yu+Zhang%2C+Peter+Tin%CC%8Co%2C+Ale%C5%A1+Leonardis%2C+and+Ke+Tang%2E+2021%2E+A+survey+on+neural+network+interpretability%2E+IEEE+Transactions+on+Emerging+Topics+in+Computational+Intelligence%2C+5%285%29%3A726%E2%80%93742%2E)
176. Yuan Zhang, Jason Baldridge, and Luheng He. 2019b. PAWS: Paraphrase adversaries from word scrambling. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 1298–1308,… [our card](https://md.research.elamur.ai/free/en/papers/zhang-2019-paws-paraphrase-adversaries-word-scrambling/)
177. Jieyu Zhao, Tianlu Wang, Mark Yatskar, Vicente Ordonez, and Kai-Wei Chang. 2018a. Gender bias in coreference resolution: Evaluation and debiasing methods. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies… [our card](https://md.research.elamur.ai/free/en/papers/zhao-2018-gender-bias-coreference-resolution-evaluation/)
178. Zhengli Zhao, Dheeru Dua, and Sameer Singh. 2018b. Generating natural adversarial examples. In ICLR. [find](https://scholar.google.com/scholar?q=Zhengli+Zhao%2C+Dheeru+Dua%2C+and+Sameer+Singh%2E+2018b%2E+Generating+natural+adversarial+examples%2E+In+ICLR%2E)
179. Chunting Zhou, Graham Neubig, Jiatao Gu, Mona Diab, Francisco Guzmán, Luke Zettlemoyer, and Marjan Ghazvininejad. 2021. Detecting hallucinated content in conditional neural sequence generation. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 1393– 1404. Associati… [our card](https://md.research.elamur.ai/free/en/papers/zhou-2021-detecting-hallucinated-content-conditional-neural/)
180. Chen Zhu, Yu Cheng, Zhe Gan, Siqi Sun, Thomas Goldstein, and Jingjing Liu. 2020. Freelb: Enhanced adversarial training for language understanding. In ICLR. [find](https://scholar.google.com/scholar?q=Chen+Zhu%2C+Yu+Cheng%2C+Zhe+Gan%2C+Siqi+Sun%2C+Thomas+Goldstein%2C+and+Jingjing+Liu%2E+2020%2E+Freelb%3A+Enhanced+adversarial+training+for+language+understanding%2E+In+ICLR%2E)

*Updated 24 October 2026*