---
title: "An Empirical Survey of Data Augmentation for — Chen 2023"
description: "Neural NLP models usually need large annotated datasets."
authors: ["Jiaao Chen", "Derek Tam", "Colin Raffel", "Mohit Bansal", "Diyi Yang"]
year: 2023
venue: "Transactions of the Association for Computational Linguistics"
source: "https://aclanthology.org/2023.tacl-1.12/"
doi: "10.1162/tacl_a_00542"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/chen-2023-empirical-survey-data-augmentation-limited/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/chen-2023-empirical-survey-data-augmentation-limited/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2023](https://md.research.elamur.ai/free/en/papers/2023/) / An Empirical Survey of Data Augmentation for Limited Data Learning in NLP

# An Empirical Survey of Data Augmentation for Limited Data Learning in NLP

**Authors:** [Jiaao Chen](https://md.research.elamur.ai/free/en/authors/jiaao-chen/), [Derek Tam](https://md.research.elamur.ai/free/en/authors/derek-tam/), [Colin Raffel](https://md.research.elamur.ai/free/en/authors/colin-raffel/), [Mohit Bansal](https://md.research.elamur.ai/free/en/authors/mohit-bansal/), [Diyi Yang](https://md.research.elamur.ai/free/en/authors/diyi-yang/) · **Year:** 2023 · **Venue:** Transactions of the Association for Computational Linguistics · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2023.tacl-1.12/) · [PDF](https://aclanthology.org/2023.tacl-1.12.pdf) · [DOI 10.1162/tacl\_a\_00542](https://doi.org/10.1162/tacl_a_00542) · [OpenAlex](https://openalex.org/W4327656064)

**Citations:** 173 citations (openalex-snapshot · 2026-10-14) · [80](#cited-by) in our library, of the 140884 papers whose bibliographies we read

## Summary
Neural NLP models usually need large annotated datasets. These are costly to build and quickly become outdated, so low-resource and new tasks are hard to serve. Jiaao Chen, Derek Tam, Colin Raffel, Mohit Bansal and Diyi Yang (Georgia Tech, UNC Chapel Hill) review and benchmark text data augmentation for training with very little labeled data. They sort recent techniques into four families: token-level edits, sentence-level rewriting or generation, adversarial perturbations, and changes in hidden representations. They then test them on 11 datasets covering news/topic classification, inference, paraphrase detection and single-sentence tasks. Each method is used in two ways: as extra training examples in plain supervised learning, or inside consistency training on unlabeled text. No single technique wins everywhere. Simple token edits tend to help most in the supervised regime, and back-translation helps most when unlabeled data are available. Hidden-space methods are less dependable. These findings give practitioners guidance on choosing augmentations, which matters for under-resourced languages such as Ukrainian.

## Key points
- **Taxonomy of methods:**
  - Token-level: synonym replacement (SR), LM-based replacement, random insertion, deletion and swapping (RI/RD/RS), word replacement (WR), compositional recombination.
  - Sentence-level: round-trip translation (RT), label-conditioned generation (e.g., with GPT-2).
  - Adversarial and hidden-space: ADV, Cutoff, Mixup.
- **Low-data GLUE experiments:** the main experiments use 10 labeled examples per class on MNLI, QNLI, RTE, QQP, MRPC, SST-2 and CoLA. Results are averaged over 3 random seeds and reported with 95% confidence intervals.
- **Which methods work where:**
  - Supervised setting: WR and RS give the most consistent gains.
  - Semi-supervised (consistency) setting: RT is the strongest overall.
  - Token and sentence methods are more robust than hidden-level ones.
- **Augmentation can hurt hard tasks:** on CoLA, the supervised baseline reaches 12.9. Most augmentations fall below it (e.g., SR 7.2, ADV 1.37), and only Cutoff comes close at 12.4.
- **Gains on easier tasks:** on SST-2 in the semi-supervised setting, Cutoff (68.6) and SR (68.1) clearly beat the supervised baseline (61.8).

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

## Cited by

Cited by

80 papers of our library cite it (of the 140884 whose bibliographies we read); 4 of them have a page here, 76 not yet.

- [NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation](https://md.research.elamur.ai/free/en/papers/dhole-2023-nl-augmenter-framework-task-sensitive/)
- [Is GPT-3 a Good Data Annotator?](https://md.research.elamur.ai/free/en/papers/ding-2022-gpt-3-good-data-annotator/)
- [Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey](https://md.research.elamur.ai/free/en/papers/min-2021-recent-advances-natural-language-processing/)
- [Data Augmentation using Transformers and Similarity Measures for Improving Arabic Text Classification](https://md.research.elamur.ai/free/en/papers/refai-2022-data-augmentation-using-transformers-similarity/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@article{chen2023empirical,
  title = {{An Empirical Survey of Data Augmentation for Limited Data Learning in NLP}},
  author = {Chen, Jiaao and Tam, Derek and Raffel, Colin and Bansal, Mohit and Yang, Diyi},
  journal = {Transactions of the Association for Computational Linguistics},
  year = {2023},
  doi = {10.1162/tacl\_a\_00542},
  url = {https://doi.org/10.1162/tacl_a_00542}
}
```

- [← previous An Analysis of English Grammar in the Perspective of Nahwu](https://md.research.elamur.ai/free/en/papers/rohmah-2023-analysis-english-grammar-perspective-nahwu/)
- [next → An ensemble-based framework for mispronunciation detection of Arabic phonemes](https://md.research.elamur.ai/free/en/papers/calik-2023-ensemble-based-framework-mispronunciation-detection/)
- [↑ back to papers of 2023](https://md.research.elamur.ai/free/en/papers/2023/)

## References

146 references, 45 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Alberto Abad, Peter Bell, Andrea Carmantini, and Steve Renais. 2020. Cross lingual transfer learning for zero-resource domain adaptation. [find](https://scholar.google.com/scholar?q=Alberto+Abad%2C+Peter+Bell%2C+Andrea+Carmantini%2C+and+Steve+Renais%2E+2020%2E+Cross+lingual+transfer+learning+for+zero%2Dresource+domain+adaptation%2E)
2. ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). https://doi.org/10 .1109/ICASSP40776.2020.9054468 [find](https://scholar.google.com/scholar?q=ICASSP+2020+%2D+2020+IEEE+International+Conference+on+Acoustics%2C+Speech+and+Signal+Processing+%28ICASSP%29%2E+https%3A%2F%2Fdoi%2Eorg%2F10+%2E1109%2FICASSP40776%2E2020%2E9054468)
3. Theoretical Guarantees and Data Distribution Shift. Current data augmentation methods for text typically assume that they are label-preserving and will not change the data distribution. However, these assumptions are often not true in practice, which can result in noisy labels or a shift in the data… [find](https://scholar.google.com/scholar?q=Theoretical+Guarantees+and+Data+Distribution+Shift%2E+Current+data+augmentation+methods+for+text+typically+assume+that+they+are+label%2Dpreserving+and+will+not+change+the+data+distribution%2E+However%2C+these)
4. Ateret Anaby-Tavor, Boaz Carmeli, Esther Goldbraich, Amir Kantor, George Kour, Segev Shlomov, Naama Tepper, and Naama Zwerdling. 2020. Do not have enough data? Deep learning to the rescue! In The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applic… [find](https://scholar.google.com/scholar?q=Ateret+Anaby%2DTavor%2C+Boaz+Carmeli%2C+Esther+Goldbraich%2C+Amir+Kantor%2C+George+Kour%2C+Segev+Shlomov%2C+Naama+Tepper%2C+and+Naama+Zwerdling%2E+2020%2E+Do+not+have+enough+data%3F+Deep+learning+to+the+rescue%21+In+The+Thir)
5. Automatic Data Augmentation. Despite being effective, current data augmentation methods are generally manually designed. Methods for automatically selecting the appropriate types of data augmentation still remain under-investigated. Although certain augmentation techniques have been shown effective… [find](https://scholar.google.com/scholar?q=Automatic+Data+Augmentation%2E+Despite+being+effective%2C+current+data+augmentation+methods+are+generally+manually+designed%2E+Methods+for+automatically+selecting+the+appropriate+types+of+data+augmentation+) [our card](https://md.research.elamur.ai/free/en/papers/andreas-2020-good-enough-compositional-data-augmentation/)
6. Mikel Artetxe, Gorka Labaka, Eneko Agirre, and Kyunghyun Cho. 2018. Unsupervised neural machine translation. In International Conference on Learning Representations. https://doi.org/10.18653/v1/D18-1399 [↗](https://doi.org/10.18653/v1/D18-1399) [our card](https://md.research.elamur.ai/free/en/papers/artetxe-2018-unsupervised-statistical-machine-translation/)
7. Isabelle Augenstein, Sebastian Ruder, and Anders Søgaard. 2018. Multi-task learning of pairwise sequence classification tasks over disparate label spaces. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies… [find](https://scholar.google.com/scholar?q=Isabelle+Augenstein%2C+Sebastian+Ruder%2C+and+Anders+S%C3%B8gaard%2E+2018%2E+Multi%2Dtask+learning+of+pairwise+sequence+classification+tasks+over+disparate+label+spaces%2E+In+Proceedings+of+the+2018+Conference+of+the+)
8. Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language models are few-shot le… [find](https://scholar.google.com/scholar?q=Tom+Henighan%2C+Rewon+Child%2C+Aditya+Ramesh%2C+Daniel+Ziegler%2C+Jeffrey+Wu%2C+Clemens+Winter%2C+Chris+Hesse%2C+Mark+Chen%2C+Eric+Sigler%2C+Mateusz+Litwin%2C+Scott+Gray%2C+Benjamin+Chess%2C+Jack+Clark%2C+Christopher+Berner%2C+S)
9. Philip Bachman, Ouais Alsharif, and Doina Precup. 2014. Learning with pseudo-ensembles. In Advances in Neural Information Processing Systems, volume 27. Curran Associates, Inc. [find](https://scholar.google.com/scholar?q=Philip+Bachman%2C+Ouais+Alsharif%2C+and+Doina+Precup%2E+2014%2E+Learning+with+pseudo%2Densembles%2E+In+Advances+in+Neural+Information+Processing+Systems%2C+volume+27%2E+Curran+Associates%2C+Inc%2E)
10. Hengyi Cai, Hongshen Chen, Yonghao Song, Cheng Zhang, Xiaofang Zhao, and Dawei Yin. 2020. Data manipulation: Towards effective instance learning for neural dialogue generation via learning to augment and reweight. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguis… [find](https://scholar.google.com/scholar?q=Hengyi+Cai%2C+Hongshen+Chen%2C+Yonghao+Song%2C+Cheng+Zhang%2C+Xiaofang+Zhao%2C+and+Dawei+Yin%2E+2020%2E+Data+manipulation%3A+Towards+effective+instance+learning+for+neural+dialogue+generation+via+learning+to+augment+)
11. Yonatan Belinkov and Yonatan Bisk. 2017. Synthetic and natural noise both break neural machine translation. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Yonatan+Belinkov+and+Yonatan+Bisk%2E+2017%2E+Synthetic+and+natural+noise+both+break+neural+machine+translation%2E+In+International+Conference+on+Learning+Representations%2E)
12. David Berthelot, Nicholas Carlini, Ian Goodfellow, Nicolas Papernot, Avital Oliver, and Colin A. Raffel. 2019. Mixmatch: A holistic approach to semi-supervised learning. In Advances in Neural Information Processing Systems, pages 5050–5060. [find](https://scholar.google.com/scholar?q=David+Berthelot%2C+Nicholas+Carlini%2C+Ian+Goodfellow%2C+Nicolas+Papernot%2C+Avital+Oliver%2C+and+Colin+A%2E+Raffel%2E+2019%2E+Mixmatch%3A+A+holistic+approach+to+semi%2Dsupervised+learning%2E+In+Advances+in+Neural+Informat)
13. Kevin Blissett and Heng Ji. 2019. Zero-shot cross-lingual name retrieval for low-resource languages. In Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019), pages 275–280, Hong Kong, China. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Kevin+Blissett+and+Heng+Ji%2E+2019%2E+Zero%2Dshot+cross%2Dlingual+name+retrieval+for+low%2Dresource+languages%2E+In+Proceedings+of+the+2nd+Workshop+on+Deep+Learning+Approaches+for+Low%2DResource+NLP+%28DeepLo+2019%29%2C+)
14. Rui Cai and Mirella Lapata. 2019. Semi-supervised semantic role labeling with cross-view training. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 1018–1027, Hong… [find](https://scholar.google.com/scholar?q=Rui+Cai+and+Mirella+Lapata%2E+2019%2E+Semi%2Dsupervised+semantic+role+labeling+with+cross%2Dview+training%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Methods+in+Natural+Language+Processing+and+the+9th)
15. Avrim Blum and Tom Mitchell. 1998. Combining labeled and unlabeled data with co-training. In Proceedings of the Eleventh Annual Conference on Computational Learning Theory, pages 92–100. https://doi.org/10 .1145/279943.279962 [find](https://scholar.google.com/scholar?q=Avrim+Blum+and+Tom+Mitchell%2E+1998%2E+Combining+labeled+and+unlabeled+data+with+co%2Dtraining%2E+In+Proceedings+of+the+Eleventh+Annual+Conference+on+Computational+Learning+Theory%2C+pages+92%E2%80%93100%2E+https%3A%2F%2Fdoi%2Eo) [our card](https://md.research.elamur.ai/free/en/papers/blum-1998-combining-labeled-unlabeled-data-co-training/)
16. Ming-Wei Chang, Lev Ratinov, Dan Roth, and Vivek Srikumar. 2008. Importance of semantic representation: Dataless classification. In Proceedings of the 23rd National Conference on Artificial Intelligence - Volume 2, AAAI’08, pages 830–835. AAAI Press. [find](https://scholar.google.com/scholar?q=Ming%2DWei+Chang%2C+Lev+Ratinov%2C+Dan+Roth%2C+and+Vivek+Srikumar%2E+2008%2E+Importance+of+semantic+representation%3A+Dataless+classification%2E+In+Proceedings+of+the+23rd+National+Conference+on+Artificial+Intelligen)
17. Samuel R. Bowman, Luke Vilnis, Oriol Vinyals, Andrew Dai, Rafal Jozefowicz, and Samy Bengio. 2016. Generating sentences from a continuous space. In Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning, pages 10–21, Berlin, Germany. Association for Computational Lingui… [find](https://scholar.google.com/scholar?q=Samuel+R%2E+Bowman%2C+Luke+Vilnis%2C+Oriol+Vinyals%2C+Andrew+Dai%2C+Rafal+Jozefowicz%2C+and+Samy+Bengio%2E+2016%2E+Generating+sentences+from+a+continuous+space%2E+In+Proceedings+of+The+20th+SIGNLL+Conference+on+Computa) [our card](https://md.research.elamur.ai/free/en/papers/bowman-2016-generating-sentences-continuous-space/)
18. O. Chapelle, B. Scholkopf, and Eds A. Zien. 2009. Semi-supervised learning. IEEE Transactions on Neural Networks, 20(3):542–542. https://doi.org/10.1109/TNN.2009 .2015974 — [doi:10.1109/tnn.2009](https://doi.org/10.1109/tnn.2009) [↗](https://doi.org/10.1109/TNN.2009)
19. Jiaao Chen, Dinghan Shen, Weizhu Chen, and Diyi Yang. 2021. Hiddencut: Simple data augmentation for natural language understanding with better generalization. In ACL. https://doi.org/10.18653/v1/2021.acl-long.338 [↗](https://doi.org/10.18653/v1/2021.acl-long.338)
20. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D. Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Jiaao Chen, Zhenghui Wang, Ran Tian, Zichao Yang, and Diyi Yang. 2020a. Local additivity… [find](https://scholar.google.com/scholar?q=Tom+Brown%2C+Benjamin+Mann%2C+Nick+Ryder%2C+Melanie+Subbiah%2C+Jared+D%2E+Kaplan%2C+Prafulla+Dhariwal%2C+Arvind+Neelakantan%2C+Pranav+Shyam%2C+Girish+Sastry%2C+Amanda+Askell%2C+Sandhini+Agarwal%2C+Ariel+Herbert%2DVoss%2C+Gretche)
21. Yong Cheng, Lu Jiang, Wolfgang Macherey, and Jacob Eisenstein. 2020b. AdvAug: Robust adversarial augmentation for neural machine translation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5961–5970, Online. Association for Computational Linguistics… [find](https://scholar.google.com/scholar?q=Yong+Cheng%2C+Lu+Jiang%2C+Wolfgang+Macherey%2C+and+Jacob+Eisenstein%2E+2020b%2E+AdvAug%3A+Robust+adversarial+augmentation+for+neural+machine+translation%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+the+Associati)
22. Jiaao Chen, Yuwei Wu, and Diyi Yang. 2020b. Semi-supervised models via data augmentation for classifying interactive affective responses. In AffCon@ AAAI. [find](https://scholar.google.com/scholar?q=Jiaao+Chen%2C+Yuwei+Wu%2C+and+Diyi+Yang%2E+2020b%2E+Semi%2Dsupervised+models+via+data+augmentation+for+classifying+interactive+affective+responses%2E+In+AffCon%40+AAAI%2E)
23. Jiaao Chen, Zichao Yang, and Diyi Yang. 2020c. MixText: Linguistically-informed interpolation of hidden space for semi-supervised text classification. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 2147–2157, Online. Association for Computational Li… [find](https://scholar.google.com/scholar?q=Jiaao+Chen%2C+Zichao+Yang%2C+and+Diyi+Yang%2E+2020c%2E+MixText%3A+Linguistically%2Dinformed+interpolation+of+hidden+space+for+semi%2Dsupervised+text+classification%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+the+)
24. Yong Cheng, Wei Xu, Zhongjun He, Wei He, Hua Wu, Maosong Sun, and Yang Liu. 2016. Semi-supervised learning for neural machine translation. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). https://doi.org/10.18653/v1/P16-1185 [↗](https://doi.org/10.18653/v1/P16-1185)
25. Luoxin Chen, Weitong Ruan, Xinyue Liu, and Jianhua Lu. 2020d. SeqVAT: Virtual adversarial training for semi-supervised sequence labeling. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 8801–8811, Online. Association for Computational Linguistics. ht… [find](https://scholar.google.com/scholar?q=Luoxin+Chen%2C+Weitong+Ruan%2C+Xinyue+Liu%2C+and+Jianhua+Lu%2E+2020d%2E+SeqVAT%3A+Virtual+adversarial+training+for+semi%2Dsupervised+sequence+labeling%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+the+Association+f)
26. Kevin Clark, Minh-Thang Luong, Christopher D. Manning, and Quoc Le. 2018. Semi-supervised sequence modeling with cross-view training. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 1914–1925, Brussels, Belgium. Association for Computational Linguisti… [find](https://scholar.google.com/scholar?q=Kevin+Clark%2C+Minh%2DThang+Luong%2C+Christopher+D%2E+Manning%2C+and+Quoc+Le%2E+2018%2E+Semi%2Dsupervised+sequence+modeling+with+cross%2Dview+training%2E+In+Proceedings+of+the+2018+Conference+on+Empirical+Methods+in+Natu) [our card](https://md.research.elamur.ai/free/en/papers/clark-2018-semi-supervised-sequence-modeling-cross/)
27. Ryan Cotterell and Georg Heigold. 2017. Cross-lingual character-level neural morphological tagging. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 748–759, Copenhagen, Denmark. Association for Computational Linguistics. [https://doi.org](https://doi.org) /10.18653/v1/D… [↗](https://doi.org)
28. Mingda Chen, Qingming Tang, Sam Wiseman, and Kevin Gimpel. 2019. Controllable paraphrase generation with a syntactic exemplar. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 5972–5984. [find](https://scholar.google.com/scholar?q=Mingda+Chen%2C+Qingming+Tang%2C+Sam+Wiseman%2C+and+Kevin+Gimpel%2E+2019%2E+Controllable+paraphrase+generation+with+a+syntactic+exemplar%2E+In+Proceedings+of+the+57th+Annual+Meeting+of+the+Association+for+Computat) [our card](https://md.research.elamur.ai/free/en/papers/chen-2019-controllable-paraphrase-generation-syntactic-exemplar/)
29. Xinyun Chen, Chen Liang, Adams Wei Yu, Dawn Song, and Denny Zhou. 2020e. Compositional generalization via neural-symbolic stack machines. Advances in Neural Information Processing Systems, 33. [find](https://scholar.google.com/scholar?q=Xinyun+Chen%2C+Chen+Liang%2C+Adams+Wei+Yu%2C+Dawn+Song%2C+and+Denny+Zhou%2E+2020e%2E+Compositional+generalization+via+neural%2Dsymbolic+stack+machines%2E+Advances+in+Neural+Information+Processing+Systems%2C+33%2E)
30. Ekin D. Cubuk, Barret Zoph, Dandelion Mane, Vijay Vasudevan, and Quoc V. Le. 2019. Autoaugment: Learning augmentation strategies from data. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 113–123. https://doi.org/10.1109/CVPR.2019.00020 — [doi:10.1109/cvpr.2019.00020](https://doi.org/10.1109/cvpr.2019.00020) [↗](https://doi.org/10.1109/CVPR.2019.00020)
31. Minhao Cheng, Jinfeng Yi, Pin-Yu Chen, Huan Zhang, and Cho-Jui Hsieh. 2020a. Seq2sick: Evaluating the robustness of sequence-to-sequence models with adversarial examples. Proceedings of the AAAI Conference on Artificial Intelligence, 34(04):3601–3608. https://doi.org/10.1609/aaai.v34i04.5767 — [doi:10.1609/aaai.v34i04.5767](https://doi.org/10.1609/aaai.v34i04.5767) [↗](https://doi.org/10.1609/aaai.v34i04.5767)
32. Li Deng, Jinyu Li, Jui-Ting Huang, Kaisheng Yao, Dong Yu, Frank Seide, Mike Seltzer, Geoff Zweig, Xiaodong He, Jason Williams, Yifan Gong, and Alex Acero. 2013. Recent advances in deep learning for speech research at microsoft. In IEEE International Yong Cheng, Lu Jiang, and Wolfgang Macherey. 2019.… [find](https://scholar.google.com/scholar?q=Li+Deng%2C+Jinyu+Li%2C+Jui%2DTing+Huang%2C+Kaisheng+Yao%2C+Dong+Yu%2C+Frank+Seide%2C+Mike+Seltzer%2C+Geoff+Zweig%2C+Xiaodong+He%2C+Jason+Williams%2C+Yifan+Gong%2C+and+Alex+Acero%2E+2013%2E+Recent+advances+in+deep+learning+for+sp)
33. Marzieh Fadaee, Arianna Bisazza, and Christof Monz. 2017. Data augmentation for low-resource neural machine translation. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 567–573, Vancouver, Canada. Association for Computationa… [find](https://scholar.google.com/scholar?q=Marzieh+Fadaee%2C+Arianna+Bisazza%2C+and+Christof+Monz%2E+2017%2E+Data+augmentation+for+low%2Dresource+neural+machine+translation%2E+In+Proceedings+of+the+55th+Annual+Meeting+of+the+Association+for+Computational+) [our card](https://md.research.elamur.ai/free/en/papers/fadaee-2017-data-augmentation-low-resource-neural/)
34. Shumin Deng, Ningyu Zhang, Zhanlin Sun, Jiaoyan Chen, and Huajun Chen. 2019. When low resource nlp meets unsupervised language model: Meta-pretraining then meta-learning for few-shot text classification. In Proceedings of the AAAI Conference on Artificial Intelligence. https://doi.org/10.1609 /aaai.… [find](https://scholar.google.com/scholar?q=Shumin+Deng%2C+Ningyu+Zhang%2C+Zhanlin+Sun%2C+Jiaoyan+Chen%2C+and+Huajun+Chen%2E+2019%2E+When+low+resource+nlp+meets+unsupervised+language+model%3A+Meta%2Dpretraining+then+meta%2Dlearning+for+few%2Dshot+text+classificati)
35. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,… [find](https://scholar.google.com/scholar?q=Jacob+Devlin%2C+Ming%2DWei+Chang%2C+Kenton+Lee%2C+and+Kristina+Toutanova%2E+2019%2E+BERT%3A+Pre%2Dtraining+of+deep+bidirectional+transformers+for+language+understanding%2E+In+Proceedings+of+the+2019+Conference+of+the+N)
36. Lisa Fan, Dong Yu, and L. Wang. 2018. Robust neural abstractive summarization systems and evaluation against adversarial information. Interpretability and Robustness for Audio, Speech and Language Workshop at Neurips 2018. https://doi.org/10.18653/v1/W18-2706 [↗](https://doi.org/10.18653/v1/W18-2706) [our card](https://md.research.elamur.ai/free/en/papers/fan-2018-controllable-abstractive-summarization/)
37. Steven Y. Feng, Varun Gangal, Dongyeop Kang, Teruko Mitamura, and Eduard Hovy. 2020. Genaug: Data augmentation for finetuning text generators. In Proceedings of Deep Learning Inside Out (DeeLIO): The First Workshop on Knowledge Extraction and Integration for Deep Learning Architectures, pages 29–42. [find](https://scholar.google.com/scholar?q=Steven+Y%2E+Feng%2C+Varun+Gangal%2C+Dongyeop+Kang%2C+Teruko+Mitamura%2C+and+Eduard+Hovy%2E+2020%2E+Genaug%3A+Data+augmentation+for+finetuning+text+generators%2E+In+Proceedings+of+Deep+Learning+Inside+Out+%28DeeLIO%29%3A+The+)
38. Terrance DeVries and Graham W. Taylor. 2017. Improved regularization of convolutional neural networks with cutout. [find](https://scholar.google.com/scholar?q=Terrance+DeVries+and+Graham+W%2E+Taylor%2E+2017%2E+Improved+regularization+of+convolutional+neural+networks+with+cutout%2E)
39. Quynh Do and Judith Gaspers. 2019. Cross-lingual transfer learning with data selection for large-scale spoken language understanding. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (E… [find](https://scholar.google.com/scholar?q=Quynh+Do+and+Judith+Gaspers%2E+2019%2E+Cross%2Dlingual+transfer+learning+with+data+selection+for+large%2Dscale+spoken+language+understanding%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Methods+in+Natu)
40. Steven Y. Feng, Varun Gangal, Jason Wei, Chandar Sarath, Soroush Vosoughi, Teruko Mitamura, and Eduard Hovy. 2021. A survey of data augmentation approaches for NLP. In Association for Computational Linguistics Findings. [find](https://scholar.google.com/scholar?q=Steven+Y%2E+Feng%2C+Varun+Gangal%2C+Jason+Wei%2C+Chandar+Sarath%2C+Soroush+Vosoughi%2C+Teruko+Mitamura%2C+and+Eduard+Hovy%2E+2021%2E+A+survey+of+data+augmentation+approaches+for+NLP%2E+In+Association+for+Computational+Li) [our card](https://md.research.elamur.ai/free/en/papers/feng-2021-survey-data-augmentation-approaches-nlp/)
41. Daniel Furrer, Marc van Zee, Nathan Scales, and Nathanael Schärli. 2020. Compositional generalization in semantic parsing: Pre-training vs. specialized architectures. [find](https://scholar.google.com/scholar?q=Daniel+Furrer%2C+Marc+van+Zee%2C+Nathan+Scales%2C+and+Nathanael+Scha%CC%88rli%2E+2020%2E+Compositional+generalization+in+semantic+parsing%3A+Pre%2Dtraining+vs%2E+specialized+architectures%2E)
42. Javid Ebrahimi, Daniel Lowd, and Dejing Dou. 2018a. On adversarial examples for character-level neural machine translation. [find](https://scholar.google.com/scholar?q=Javid+Ebrahimi%2C+Daniel+Lowd%2C+and+Dejing+Dou%2E+2018a%2E+On+adversarial+examples+for+character%2Dlevel+neural+machine+translation%2E)
43. Fei Gao, Jinhua Zhu, Lijun Wu, Yingce Xia, Tao Qin, Xueqi Cheng, Wengang Zhou, and Tie-Yan Liu. 2019. Soft contextual data augmentation for neural machine translation. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 5539–5544. https://doi.org/10 .186… [find](https://scholar.google.com/scholar?q=Fei+Gao%2C+Jinhua+Zhu%2C+Lijun+Wu%2C+Yingce+Xia%2C+Tao+Qin%2C+Xueqi+Cheng%2C+Wengang+Zhou%2C+and+Tie%2DYan+Liu%2E+2019%2E+Soft+contextual+data+augmentation+for+neural+machine+translation%2E+In+Proceedings+of+the+57th+Annua)
44. Javid Ebrahimi, Anyi Rao, Daniel Lowd, and Dejing Dou. 2018b. Hotflip: White-box adversarial examples for text classification. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 31–36. https://doi.org/10.18653/v1/P18 -2006 [↗](https://doi.org/10.18653/v1/P18) [our card](https://md.research.elamur.ai/free/en/papers/ebrahimi-2018-hotflip-white-box-adversarial-examples/)
45. Siddhant Garg and Goutham Ramakrishnan. 2020. BAE: BERT-based adversarial examples for text classification. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 6174–6181, Online. Association for Sergey Edunov, Myle Ott, Michael Auli, and David Gra… [find](https://scholar.google.com/scholar?q=Siddhant+Garg+and+Goutham+Ramakrishnan%2E+2020%2E+BAE%3A+BERT%2Dbased+adversarial+examples+for+text+classification%2E+In+Proceedings+of+the+2020+Conference+on+Empirical+Methods+in+Natural+Language+Processing+%28E) [our card](https://md.research.elamur.ai/free/en/papers/garg-2020-bae-bert-based-adversarial-examples/)
46. Association for the Advancement of Artificial Intelligence. https://doi.org/10 .1609/aaai.v32i1.11956 [find](https://scholar.google.com/scholar?q=Association+for+the+Advancement+of+Artificial+Intelligence%2E+https%3A%2F%2Fdoi%2Eorg%2F10+%2E1609%2Faaai%2Ev32i1%2E11956)
47. Dan Garrette and Jason Baldridge. 2013. Learning a part-of-speech tagger from two hours of annotation. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 138–147, Atlanta, Georgia. Association for C… [find](https://scholar.google.com/scholar?q=Dan+Garrette+and+Jason+Baldridge%2E+2013%2E+Learning+a+part%2Dof%2Dspeech+tagger+from+two+hours+of+annotation%2E+In+Proceedings+of+the+2013+Conference+of+the+North+American+Chapter+of+the+Association+for+Comput)
48. Kelvin Guu, Tatsunori B. Hashimoto, Yonatan Oren, and Percy Liang. 2017. Generating sentences by editing prototypes. In Transactions of the Association for Computational Linguistics, Volume 6. https://doi.org/10.1162/tacl_a_00030 [↗](https://doi.org/10.1162/tacl_a_00030) [our card](https://md.research.elamur.ai/free/en/papers/guu-2017-generating-sentences-editing-prototypes/)
49. Xu Han, Hao Zhu, Pengfei Yu, Ziyun Wang, Yuan Yao, Zhiyuan Liu, and Maosong Sun. 2018. FewRel: A large-scale supervised few-shot relation classification dataset with state-of-the-art evaluation. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 4803–480… [find](https://scholar.google.com/scholar?q=Xu+Han%2C+Hao+Zhu%2C+Pengfei+Yu%2C+Ziyun+Wang%2C+Yuan+Yao%2C+Zhiyuan+Liu%2C+and+Maosong+Sun%2E+2018%2E+FewRel%3A+A+large%2Dscale+supervised+few%2Dshot+relation+classification+dataset+with+state%2Dof%2Dthe%2Dart+evaluation%2E+In+Pr)
50. Xavier Glorot, Antoine Bordes, and Yoshua Bengio. 2011. Domain adaptation for large-scale sentiment classification: A deep learning approach. In International Conference of Machine Learning. [find](https://scholar.google.com/scholar?q=Xavier+Glorot%2C+Antoine+Bordes%2C+and+Yoshua+Bengio%2E+2011%2E+Domain+adaptation+for+large%2Dscale+sentiment+classification%3A+A+deep+learning+approach%2E+In+International+Conference+of+Machine+Learning%2E)
51. Karan Goel, Nazneen Fatema Rajani, Jesse Vig, Zachary Taschdjian, Mohit Bansal, and Christopher Ré. 2021. Robustness gym: Unifying the NLP evaluation landscape. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Techn… [find](https://scholar.google.com/scholar?q=Karan+Goel%2C+Nazneen+Fatema+Rajani%2C+Jesse+Vig%2C+Zachary+Taschdjian%2C+Mohit+Bansal%2C+and+Christopher+Re%CC%81%2E+2021%2E+Robustness+gym%3A+Unifying+the+NLP+evaluation+landscape%2E+In+Proceedings+of+the+2021+Conference+)
52. Junxian He, Jiatao Gu, Jiajun Shen, and Marc’Aurelio Ranzato. 2020. Revisiting self-training for neural sequence generation. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Junxian+He%2C+Jiatao+Gu%2C+Jiajun+Shen%2C+and+Marc%E2%80%99Aurelio+Ranzato%2E+2020%2E+Revisiting+self%2Dtraining+for+neural+sequence+generation%2E+In+International+Conference+on+Learning+Representations%2E)
53. Michael A. Hedderich, Lukas Lange, Heike Adel, Jannik Strötgen, and Dietrich Klakow. 2020. A survey on recent approaches for natural language processing in low-resource scenarios. CoRR, abs/2010.12309. https://doi.org/10.18653/v1/2021.naacl-main.201 [↗](https://doi.org/10.18653/v1/2021.naacl-main.201) [our card](https://md.research.elamur.ai/free/en/papers/hedderich-2021-survey-recent-approaches-natural-language/)
54. Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger, editors, Advances in Neural Information Processing System… [find](https://scholar.google.com/scholar?q=Ian+Goodfellow%2C+Jean+Pouget%2DAbadie%2C+Mehdi+Mirza%2C+Bing+Xu%2C+David+Warde%2DFarley%2C+Sherjil+Ozair%2C+Aaron+Courville%2C+and+Yoshua+Bengio%2E+2014%2E+Generative+adversarial+nets%2E+In+Z%2E+Ghahramani%2C+M%2E+Welling%2C+C%2E+Cor)
55. Aurélie Herbelot and Marco Baroni. 2017. High-risk learning: Acquiring new word vectors from tiny data. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 304–309, Copenhagen, Denmark. Association for Computational Linguistics. [https://doi.org](https://doi.org) /10.18653… [↗](https://doi.org)
56. Ian J. Goodfellow, Jonathon Shlens, and Christian Szegedy. 2015. Explaining and harnessing adversarial examples. stat, 1050:20. [find](https://scholar.google.com/scholar?q=Ian+J%2E+Goodfellow%2C+Jonathon+Shlens%2C+and+Christian+Szegedy%2E+2015%2E+Explaining+and+harnessing+adversarial+examples%2E+stat%2C+1050%3A20%2E) [our card](https://md.research.elamur.ai/free/en/papers/goodfellow-2014-explaining-harnessing-adversarial-examples/)
57. Wei-Ning Hsu, Hao Tang, and James Glass. 2018. Unsupervised adaptation with interpretable disentangled representations for distant conversational speech recognition. [find](https://scholar.google.com/scholar?q=Wei%2DNing+Hsu%2C+Hao+Tang%2C+and+James+Glass%2E+2018%2E+Unsupervised+adaptation+with+interpretable+disentangled+representations+for+distant+conversational+speech+recognition%2E)
58. Demi Guo, Yoon Kim, and Alexander Rush. 2020. Sequence-level mixed sample data augmentation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 5547–5552, Online. Association for Computational Linguistics. https://doi.org/10.18653/v1 /2020.emnlp-… [find](https://scholar.google.com/scholar?q=Demi+Guo%2C+Yoon+Kim%2C+and+Alexander+Rush%2E+2020%2E+Sequence%2Dlevel+mixed+sample+data+augmentation%2E+In+Proceedings+of+the+2020+Conference+on+Empirical+Methods+in+Natural+Language+Processing+%28EMNLP%29%2C+pages+55)
59. Wei-Ning Hsu, Yu Zhang, and James Glass. 2017. Unsupervised domain adaptation for robust speech recognition via variational autoencoder-based data augmentation. 2017 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU). [find](https://scholar.google.com/scholar?q=Wei%2DNing+Hsu%2C+Yu+Zhang%2C+and+James+Glass%2E+2017%2E+Unsupervised+domain+adaptation+for+robust+speech+recognition+via+variational+autoencoder%2Dbased+data+augmentation%2E+2017+IEEE+Automatic+Speech+Recognition+)
60. Ankush Gupta, Arvind Agarwal, Prawaan Singh, and Piyush Rai. 2017. A deep generative framework for paraphrase generation. In Zhiting Hu, Bowen Tan, Russ R. Salakhutdinov, Tom M. Mitchell, and Eric P. Xing. 2019. Learning data manipulation for augmentation and weighting. Advances in Neural Informatio… [find](https://scholar.google.com/scholar?q=Ankush+Gupta%2C+Arvind+Agarwal%2C+Prawaan+Singh%2C+and+Piyush+Rai%2E+2017%2E+A+deep+generative+framework+for+paraphrase+generation%2E+In+Zhiting+Hu%2C+Bowen+Tan%2C+Russ+R%2E+Salakhutdinov%2C+Tom+M%2E+Mitchell%2C+and+Eric+P%2E+)
61. Robin Jia and Percy Liang. 2017. Adversarial examples for evaluating reading comprehension systems. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 2021–2031, Copenhagen, Denmark. Association for Computational Linguistics. [https://doi.org](https://doi.org) /10.18653/v1… [↗](https://doi.org) [our card](https://md.research.elamur.ai/free/en/papers/jia-2017-adversarial-examples-evaluating-reading-comprehension/)
62. Zhiting Hu, Zichao Yang, Xiaodan Liang, Ruslan Salakhutdinov, and Eric P. Xing. 2017. Toward controlled generation of text. In Proceedings of the 34th International Conference on Machine Learning, volume 70 of Proceedings of Machine Learning Research, pages 1587–1596. PMLR. [find](https://scholar.google.com/scholar?q=Zhiting+Hu%2C+Zichao+Yang%2C+Xiaodan+Liang%2C+Ruslan+Salakhutdinov%2C+and+Eric+P%2E+Xing%2E+2017%2E+Toward+controlled+generation+of+text%2E+In+Proceedings+of+the+34th+International+Conference+on+Machine+Learning%2C+vol) [our card](https://md.research.elamur.ai/free/en/papers/hu-2017-toward-controlled-generation-text/)
63. Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, and Tuo Zhao. 2019. Smart: Robust and efficient fine-tuning for pre-trained natural language models through principled regularized optimization. In Proceedings of the 58th Annual Meeting of the Association for Computational Lingui… [find](https://scholar.google.com/scholar?q=Haoming+Jiang%2C+Pengcheng+He%2C+Weizhu+Chen%2C+Xiaodong+Liu%2C+Jianfeng+Gao%2C+and+Tuo+Zhao%2E+2019%2E+Smart%3A+Robust+and+efficient+fine%2Dtuning+for+pre%2Dtrained+natural+language+models+through+principled+regularized) [our card](https://md.research.elamur.ai/free/en/papers/jiang-2020-smart-robust-efficient-fine-tuning/)
64. Zikun Hu, Xiang Li, Cunchao Tu, Zhiyuan Liu, and Maosong Sun. 2018. Few-shot charge prediction with discriminative legal attributes. In Proceedings of the 27th International Conference on Computational Linguistics, pages 487–498, Santa Fe, New Mexico, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Zikun+Hu%2C+Xiang+Li%2C+Cunchao+Tu%2C+Zhiyuan+Liu%2C+and+Maosong+Sun%2E+2018%2E+Few%2Dshot+charge+prediction+with+discriminative+legal+attributes%2E+In+Proceedings+of+the+27th+International+Conference+on+Computationa) [our card](https://md.research.elamur.ai/free/en/papers/hu-2018-few-shot-charge-prediction-discriminative/)
65. Yichen Jiang and Mohit Bansal. 2019. Avoiding reasoning shortcuts: Adversarial evaluation, training, and model development for multi-hop QA. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 2726–2736, Florence, Italy. Association for Computational Lin… [find](https://scholar.google.com/scholar?q=Yichen+Jiang+and+Mohit+Bansal%2E+2019%2E+Avoiding+reasoning+shortcuts%3A+Adversarial+evaluation%2C+training%2C+and+model+development+for+multi%2Dhop+QA%2E+In+Proceedings+of+the+57th+Annual+Meeting+of+the+Associatio)
66. Aminul Huq and Mst. Tasnim Pervin. 2020. Adversarial attacks and defense on texts: A survey. [find](https://scholar.google.com/scholar?q=Aminul+Huq+and+Mst%2E+Tasnim+Pervin%2E+2020%2E+Adversarial+attacks+and+defense+on+texts%3A+A+survey%2E)
67. Mohit Iyyer, Varun Manjunatha, Jordan Boyd-Graber, and Hal Daumé III. 2015. Deep unordered composition rivals syntactic methods for text classification. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural L… [find](https://scholar.google.com/scholar?q=Mohit+Iyyer%2C+Varun+Manjunatha%2C+Jordan+Boyd%2DGraber%2C+and+Hal+Daume%CC%81+III%2E+2015%2E+Deep+unordered+composition+rivals+syntactic+methods+for+text+classification%2E+In+Proceedings+of+the+53rd+Annual+Meeting+of+t) [our card](https://md.research.elamur.ai/free/en/papers/iyyer-2015-deep-unordered-composition-rivals-syntactic/)
68. Thorsten Joachims. 1997. A probabilistic analysis of the rocchio algorithm with tfidf for text categorization. In Proceedings of the Fourteenth International Conference on Machine Learning, ICML ’97, pages 143–151, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc. [find](https://scholar.google.com/scholar?q=Thorsten+Joachims%2E+1997%2E+A+probabilistic+analysis+of+the+rocchio+algorithm+with+tfidf+for+text+categorization%2E+In+Proceedings+of+the+Fourteenth+International+Conference+on+Machine+Learning%2C+ICML+%E2%80%9997%2C+)
69. Mohit Iyyer, John Wieting, Kevin Gimpel, and Luke Zettlemoyer. 2018. Adversarial example generation with syntactically controlled paraphrase networks. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vo… [find](https://scholar.google.com/scholar?q=Mohit+Iyyer%2C+John+Wieting%2C+Kevin+Gimpel%2C+and+Luke+Zettlemoyer%2E+2018%2E+Adversarial+example+generation+with+syntactically+controlled+paraphrase+networks%2E+In+Proceedings+of+the+2018+Conference+of+the+Nort) [our card](https://md.research.elamur.ai/free/en/papers/iyyer-2018-adversarial-example-generation-syntactically-controlled/)
70. Melvin Johnson, Mike Schuster, Quoc V. Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda Viégas, Martin Wattenberg, Greg Corrado, Macduff Hughes, and Jeffrey Dean. 2017. Google’s multilingual neural machine translation system: Enabling zero-shot translation. Transactions of the As… [find](https://scholar.google.com/scholar?q=Melvin+Johnson%2C+Mike+Schuster%2C+Quoc+V%2E+Le%2C+Maxim+Krikun%2C+Yonghui+Wu%2C+Zhifeng+Chen%2C+Nikhil+Thorat%2C+Fernanda+Vie%CC%81gas%2C+Martin+Wattenberg%2C+Greg+Corrado%2C+Macduff+Hughes%2C+and+Jeffrey+Dean%2E+2017%2E+Google%E2%80%99s+mu)
71. Robin Jia and Percy Liang. 2016. Data recombination for neural semantic parsing. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 12–22, Berlin, Germany. Association for Computational Lin-Durk P. Kingma, Shakir Mohamed, Danilo… [find](https://scholar.google.com/scholar?q=Robin+Jia+and+Percy+Liang%2E+2016%2E+Data+recombination+for+neural+semantic+parsing%2E+In+Proceedings+of+the+54th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volume+1%3A+Long+Papers%29%2C+pag)
72. Sosuke Kobayashi. 2018. Contextual augmentation: Data augmentation by words with paradigmatic relations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pages 452–457, New Orle… [find](https://scholar.google.com/scholar?q=Sosuke+Kobayashi%2E+2018%2E+Contextual+augmentation%3A+Data+augmentation+by+words+with+paradigmatic+relations%2E+In+Proceedings+of+the+2018+Conference+of+the+North+American+Chapter+of+the+Association+for+Comp) [our card](https://md.research.elamur.ai/free/en/papers/kobayashi-2018-contextual-augmentation-data-augmentation-words/)
73. Advances in Neural Information Processing Systems 32 (NeurIPS 2019). [find](https://scholar.google.com/scholar?q=Advances+in+Neural+Information+Processing+Systems+32+%28NeurIPS+2019%29%2E)
74. Guillaume Lample, Alexis Conneau, Ludovic Denoyer, and Marc’Aurelio Ranzato. 2018. Unsupervised machine translation using monolingual corpora only. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Guillaume+Lample%2C+Alexis+Conneau%2C+Ludovic+Denoyer%2C+and+Marc%E2%80%99Aurelio+Ranzato%2E+2018%2E+Unsupervised+machine+translation+using+monolingual+corpora+only%2E+In+International+Conference+on+Learning+Representati) [our card](https://md.research.elamur.ai/free/en/papers/lample-2017-unsupervised-machine-translation-using-monolingual/)
75. Chia-Hsuan Lee and Hung-Yi Lee. 2019. Cross-lingual transfer learning for question answering. In arXiv. [find](https://scholar.google.com/scholar?q=Chia%2DHsuan+Lee+and+Hung%2DYi+Lee%2E+2019%2E+Cross%2Dlingual+transfer+learning+for+question+answering%2E+In+arXiv%2E)
76. Oleksandr Kolomiyets, Steven Bethard, and Marie-Francine Moens. 2011. Model-portability experiments for textual temporal analysis. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 271–276, Portland, Oregon, USA. Associatio… [find](https://scholar.google.com/scholar?q=Oleksandr+Kolomiyets%2C+Steven+Bethard%2C+and+Marie%2DFrancine+Moens%2E+2011%2E+Model%2Dportability+experiments+for+textual+temporal+analysis%2E+In+Proceedings+of+the+49th+Annual+Meeting+of+the+Association+for+Comp)
77. Bill Yuchen Lin, Dong-Ho Lee, Ming Shen, Ryan Moreno, Xiao Huang, Prashant Shiralkar, and Xiang Ren. 2020. TriggerNER: Learning with entity triggers as explanations for named entity recognition. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 8503–85… [find](https://scholar.google.com/scholar?q=Bill+Yuchen+Lin%2C+Dong%2DHo+Lee%2C+Ming+Shen%2C+Ryan+Moreno%2C+Xiao+Huang%2C+Prashant+Shiralkar%2C+and+Xiang+Ren%2E+2020%2E+TriggerNER%3A+Learning+with+entity+triggers+as+explanations+for+named+entity+recognition%2E+In+Pr)
78. Alex Krizhevsky, I. Sutskever, and G. Hinton. 2012. Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, 25(2). [find](https://scholar.google.com/scholar?q=Alex+Krizhevsky%2C+I%2E+Sutskever%2C+and+G%2E+Hinton%2E+2012%2E+Imagenet+classification+with+deep+convolutional+neural+networks%2E+Advances+in+Neural+Information+Processing+Systems%2C+25%282%29%2E)
79. Pengfei Liu, Xipeng Qiu, and Xuanjing Huang. 2017. Adversarial multi-task learning for text classification. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1–10, Vancouver, Canada. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Pengfei+Liu%2C+Xipeng+Qiu%2C+and+Xuanjing+Huang%2E+2017%2E+Adversarial+multi%2Dtask+learning+for+text+classification%2E+In+Proceedings+of+the+55th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28) [our card](https://md.research.elamur.ai/free/en/papers/liu-2017-adversarial-multi-task-learning-text/)
80. Ashutosh Kumar, Satwik Bhattamishra, Manik Bhandari, and Partha Talukdar. 2019. Submodular optimization-based diverse paraphrasing and its effectiveness in data augmentation. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human L… [find](https://scholar.google.com/scholar?q=Ashutosh+Kumar%2C+Satwik+Bhattamishra%2C+Manik+Bhandari%2C+and+Partha+Talukdar%2E+2019%2E+Submodular+optimization%2Dbased+diverse+paraphrasing+and+its+effectiveness+in+data+augmentation%2E+In+Proceedings+of+the+201) [our card](https://md.research.elamur.ai/free/en/papers/kumar-2019-submodular-optimization-based-diverse-paraphrasing/)
81. Adyasha Maharana and Mohit Bansal. 2020. Adversarial augmentation policy search for domain and cross-lingual generalization in reading comprehension. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online. Association for Computational Linguistics.… [find](https://scholar.google.com/scholar?q=Adyasha+Maharana+and+Mohit+Bansal%2E+2020%2E+Adversarial+augmentation+policy+search+for+domain+and+cross%2Dlingual+generalization+in+reading+comprehension%2E+In+Proceedings+of+the+2020+Conference+on+Empirical)
82. Varun Kumar, Ashutosh Choudhary, and Eunah Cho. 2020. Data augmentation using pre-trained transformer models. In Proceedings of the 2nd Workshop on Life-long Learning for Spoken Language Systems, pages 18–26, Suzhou, China. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Varun+Kumar%2C+Ashutosh+Choudhary%2C+and+Eunah+Cho%2E+2020%2E+Data+augmentation+using+pre%2Dtrained+transformer+models%2E+In+Proceedings+of+the+2nd+Workshop+on+Life%2Dlong+Learning+for+Spoken+Language+Systems%2C+page) [our card](https://md.research.elamur.ai/free/en/papers/kumar-2020-data-augmentation-using-pre-trained/)
83. Nikolaos Malandrakis, Minmin Shen, Anuj Goyal, Shuyang Gao, Abhishek Sethi, and Angeliki Metallinou. 2019. Controlled text generation for data augmentation in intelligent artificial agents. In Proceedings of the 3rd Workshop on Neural Generation and Translation, pages 90–98, Hong Kong. Association f… [find](https://scholar.google.com/scholar?q=Nikolaos+Malandrakis%2C+Minmin+Shen%2C+Anuj+Goyal%2C+Shuyang+Gao%2C+Abhishek+Sethi%2C+and+Angeliki+Metallinou%2E+2019%2E+Controlled+text+generation+for+data+augmentation+in+intelligent+artificial+agents%2E+In+Proceed)
84. Samuli Laine and Timo Aila. 2017. Temporal ensembling for semi-supervised learning. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net. [find](https://scholar.google.com/scholar?q=Samuli+Laine+and+Timo+Aila%2E+2017%2E+Temporal+ensembling+for+semi%2Dsupervised+learning%2E+In+5th+International+Conference+on+Learning+Representations%2C+ICLR+2017%2C+Toulon%2C+France%2C+April+24%2D26%2C+2017%2C+Conferenc)
85. R. Thomas McCoy, Ellie Pavlick, and Tal Linzen. 2019. Right for the wrong reasons: Diagnosing syntactic heuristics in natural language inference. In Proceedings of the 57th Guillaume Lample and Alexis Conneau. 2019. Cross-lingual language model pretraining. In Annual Meeting of the Association for C… [find](https://scholar.google.com/scholar?q=R%2E+Thomas+McCoy%2C+Ellie+Pavlick%2C+and+Tal+Linzen%2E+2019%2E+Right+for+the+wrong+reasons%3A+Diagnosing+syntactic+heuristics+in+natural+language+inference%2E+In+Proceedings+of+the+57th+Guillaume+Lample+and+Alexis) [our card](https://md.research.elamur.ai/free/en/papers/mccoy-2019-right-wrong-reasons-diagnosing-syntactic/)
86. Zhengjie Miao, Yuliang Li, Xiaolan Wang, and Wang-Chiew Tan. 2020. Snippext: Semi-supervised opinion mining with augmented data. In Proceedings of The Web Conference 2020, pages 617–628. https://doi.org/10.1145/3366423.3380144 — [doi:10.1145/3366423.3380144](https://doi.org/10.1145/3366423.3380144) [↗](https://doi.org/10.1145/3366423.3380144)
87. Phoebe Mulcaire, Jungo Kasai, and Noah A. Smith. 2019. Low-resource parsing with crosslingual contextualized representations. In Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL), pages 304–315, Hong Kong, China. Association for Computational Linguistics. https://… [find](https://scholar.google.com/scholar?q=Phoebe+Mulcaire%2C+Jungo+Kasai%2C+and+Noah+A%2E+Smith%2E+2019%2E+Low%2Dresource+parsing+with+crosslingual+contextualized+representations%2E+In+Proceedings+of+the+23rd+Conference+on+Computational+Natural+Language+Le)
88. Junghyun Min, R. Thomas McCoy, Dipanjan Das, Emily Pitler, and Tal Linzen. 2020. Syntactic data augmentation increases robustness to inference heuristics. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Junghyun+Min%2C+R%2E+Thomas+McCoy%2C+Dipanjan+Das%2C+Emily+Pitler%2C+and+Tal+Linzen%2E+2020%2E+Syntactic+data+augmentation+increases+robustness+to+inference+heuristics%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+) [our card](https://md.research.elamur.ai/free/en/papers/min-2020-syntactic-data-augmentation-increases-robustness/)
89. Tong Niu and Mohit Bansal. 2018. Adversarial over-sensitivity and over-stability strategies for dialogue models. In The SIGNLL Conference on Computational Natural Language Learning (CoNLL). https://doi.org/10 .18653/v1/K18-1047 [find](https://scholar.google.com/scholar?q=Tong+Niu+and+Mohit+Bansal%2E+2018%2E+Adversarial+over%2Dsensitivity+and+over%2Dstability+strategies+for+dialogue+models%2E+In+The+SIGNLL+Conference+on+Computational+Natural+Language+Learning+%28CoNLL%29%2E+https%3A%2F%2Fdo)
90. Shervin Minaee, Nal Kalchbrenner, Erik Cambria, Narjes Nikzad, Meysam Chenaghlu, and Jianfeng Gao. 2021. Deep learning based text classification: A comprehensive review. In ACM Comptuing Survey. https://doi.org/10.1145/3439726 — [doi:10.1145/3439726](https://doi.org/10.1145/3439726) [↗](https://doi.org/10.1145/3439726)
91. Tong Niu and Mohit Bansal. 2019. Automatically learning data augmentation policies for dialogue tasks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 1317–1323,… [find](https://scholar.google.com/scholar?q=Tong+Niu+and+Mohit+Bansal%2E+2019%2E+Automatically+learning+data+augmentation+policies+for+dialogue+tasks%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Methods+in+Natural+Language+Processing+and+the)
92. Arindam Mitra, Ishan Shrivastava, and Chitta Baral. 2020. Enhancing natural language inference using new and expanded training data sets and new learning models. In Proceedings of the AAAI Conference on Artificial Intelligence. https://doi.org/10 .1609/aaai.v34i05.6371 [find](https://scholar.google.com/scholar?q=Arindam+Mitra%2C+Ishan+Shrivastava%2C+and+Chitta+Baral%2E+2020%2E+Enhancing+natural+language+inference+using+new+and+expanded+training+data+sets+and+new+learning+models%2E+In+Proceedings+of+the+AAAI+Conference+)
93. Maxwell I. Nye, Armando Solar-Lezama, Joshua B. Tenenbaum, and Brenden M. Lake. 2020. Learning compositional rules via neural program synthesis. Advances in Neural Information Processing Systems, 33. [find](https://scholar.google.com/scholar?q=Maxwell+I%2E+Nye%2C+Armando+Solar%2DLezama%2C+Joshua+B%2E+Tenenbaum%2C+and+Brenden+M%2E+Lake%2E+2020%2E+Learning+compositional+rules+via+neural+program+synthesis%2E+Advances+in+Neural+Information+Processing+Systems%2C+33%2E)
94. Takeru Miyato, Andrew M. Dai, and Ian Goodfellow. 2017. Adversarial training methods for semi-supervised text classification. International Conference on Learning Representations (ICLR). [find](https://scholar.google.com/scholar?q=Takeru+Miyato%2C+Andrew+M%2E+Dai%2C+and+Ian+Goodfellow%2E+2017%2E+Adversarial+training+methods+for+semi%2Dsupervised+text+classification%2E+International+Conference+on+Learning+Representations+%28ICLR%29%2E) [our card](https://md.research.elamur.ai/free/en/papers/miyato-2016-adversarial-training-methods-semi-supervised/)
95. Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018. Deep contextualized word representations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technolog… [find](https://scholar.google.com/scholar?q=Matthew+Peters%2C+Mark+Neumann%2C+Mohit+Iyyer%2C+Matt+Gardner%2C+Christopher+Clark%2C+Kenton+Lee%2C+and+Luke+Zettlemoyer%2E+2018%2E+Deep+contextualized+word+representations%2E+In+Proceedings+of+the+2018+Conference+of+t)
96. Takeru Miyato, Shin-ichi Maeda, Masanori Koyama, and Shin Ishii. 2018. Virtual adversarial training: A regularization method for supervised and semi-supervised learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41(8):1979–1993. https://doi.org/10.1109/TPAMI.2018.2858821, PubM… — [doi:10.1109/tpami.2018.2858821](https://doi.org/10.1109/tpami.2018.2858821) [↗](https://doi.org/10.1109/TPAMI.2018.2858821)
97. Ngoc-Quan Pham, Jan Niehues, Thanh-Le Ha, and Alexander Waibel. 2019. Improving zero-shot translation with language-independent constraints. In Proceedings of the Fourth Conference on Machine Translation (Volume 1: Research Papers), pages 13–23, Florence, Italy. Association for Computational Linguis… [find](https://scholar.google.com/scholar?q=Ngoc%2DQuan+Pham%2C+Jan+Niehues%2C+Thanh%2DLe+Ha%2C+and+Alexander+Waibel%2E+2019%2E+Improving+zero%2Dshot+translation+with+language%2Dindependent+constraints%2E+In+Proceedings+of+the+Fourth+Conference+on+Machine+Translat)
98. John Morris, Eli Lifland, Jin Yong Yoo, Jake Grigsby, Di Jin, and Yanjun Qi. 2020. Text-Attack: A framework for adversarial attacks, data augmentation, and adversarial training in NLP. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, A… [find](https://scholar.google.com/scholar?q=John+Morris%2C+Eli+Lifland%2C+Jin+Yong+Yoo%2C+Jake+Grigsby%2C+Di+Jin%2C+and+Yanjun+Qi%2E+2020%2E+Text%2DAttack%3A+A+framework+for+adversarial+attacks%2C+data+augmentation%2C+and+adversarial+training+in+NLP%2E+In+Proceedings+)
99. Timo Schick and Hinrich Schütze. 2021b. It’s not just size that matters: Small language models are also few-shot learners. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 2339–2352, Online. Asso… [find](https://scholar.google.com/scholar?q=Timo+Schick+and+Hinrich+Schu%CC%88tze%2E+2021b%2E+It%E2%80%99s+not+just+size+that+matters%3A+Small+language+models+are+also+few%2Dshot+learners%2E+In+Proceedings+of+the+2021+Conference+of+the+North+American+Chapter+of+the+A) [our card](https://md.research.elamur.ai/free/en/papers/schick-2021-it-s-not-just-size/)
100. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog, 1(8):9. [find](https://scholar.google.com/scholar?q=Alec+Radford%2C+Jeffrey+Wu%2C+Rewon+Child%2C+David+Luan%2C+Dario+Amodei%2C+and+Ilya+Sutskever%2E+2019%2E+Language+models+are+unsupervised+multitask+learners%2E+OpenAI+Blog%2C+1%288%29%3A9%2E)
101. Sebastian Schuster, Sonal Gupta, Rushin Shah, and Mike Lewis. 2019. Cross-lingual transfer learning for multilingual task oriented dialog. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long… [find](https://scholar.google.com/scholar?q=Sebastian+Schuster%2C+Sonal+Gupta%2C+Rushin+Shah%2C+and+Mike+Lewis%2E+2019%2E+Cross%2Dlingual+transfer+learning+for+multilingual+task+oriented+dialog%2E+In+Proceedings+of+the+2019+Conference+of+the+North+American+C) [our card](https://md.research.elamur.ai/free/en/papers/schuster-2019-cross-lingual-transfer-learning-multilingual/)
102. Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21(140):1–67. [find](https://scholar.google.com/scholar?q=Colin+Raffel%2C+Noam+Shazeer%2C+Adam+Roberts%2C+Katherine+Lee%2C+Sharan+Narang%2C+Michael+Matena%2C+Yanqi+Zhou%2C+Wei+Li%2C+and+Peter+J%2E+Liu%2E+2020%2E+Exploring+the+limits+of+transfer+learning+with+a+unified+text%2Dto%2Dtex)
103. Shuhuai Ren, Yihe Deng, Kun He, and Wanxiang Che. 2019. Generating natural language adversarial examples through probability weighted word saliency. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 1085–1097. [find](https://scholar.google.com/scholar?q=Shuhuai+Ren%2C+Yihe+Deng%2C+Kun+He%2C+and+Wanxiang+Che%2E+2019%2E+Generating+natural+language+adversarial+examples+through+probability+weighted+word+saliency%2E+In+Proceedings+of+the+57th+Annual+Meeting+of+the+As) [our card](https://md.research.elamur.ai/free/en/papers/ren-2019-generating-natural-language-adversarial-examples/)
104. Rico Sennrich, Barry Haddow, and Alexandra Birch. 2015. Improving neural machine translation models with monolingual data. Computer Science. https://doi.org/10.18653/v1/P16-1009 [↗](https://doi.org/10.18653/v1/P16-1009)
105. Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2018. Semantically equivalent adversarial rules for debugging NLP models. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 856–865, Melbourne, Australia. Association for C… [find](https://scholar.google.com/scholar?q=Marco+Tulio+Ribeiro%2C+Sameer+Singh%2C+and+Carlos+Guestrin%2E+2018%2E+Semantically+equivalent+adversarial+rules+for+debugging+NLP+models%2E+In+Proceedings+of+the+56th+Annual+Meeting+of+the+Association+for+Compu)
106. Peter Shaw, Ming-Wei Chang, Panupong Pasupat, and Kristina Toutanova. 2021. Compositional generalization and natural language variation: Can a semantic parsing approach handle both? In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International… [find](https://scholar.google.com/scholar?q=Peter+Shaw%2C+Ming%2DWei+Chang%2C+Panupong+Pasupat%2C+and+Kristina+Toutanova%2E+2021%2E+Compositional+generalization+and+natural+language+variation%3A+Can+a+semantic+parsing+approach+handle+both%3F+In+Proceedings+of+)
107. Anthony Rios and Ramakanth Kavuluru. 2018. Few-shot and zero-shot multi-label learning for structured label spaces. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 3132–3142, Brussels, Belgium. Association for Computational Linguistics. [https://doi.or…](https://doi.or…) [↗](https://doi.or…)
108. Dinghan Shen, Mingzhi Zheng, Yelong Shen, Yanru Qu, and Weizhu Chen. 2020. A simple but tough-to-beat data augmentation approach for natural language understanding and generation. arXiv preprint arXiv:2009.13818. — [arXiv:2009.13818](https://arxiv.org/abs/2009.13818) [find](https://scholar.google.com/scholar?q=Dinghan+Shen%2C+Mingzhi+Zheng%2C+Yelong+Shen%2C+Yanru+Qu%2C+and+Weizhu+Chen%2E+2020%2E+A+simple+but+tough%2Dto%2Dbeat+data+augmentation+approach+for+natural+language+understanding+and+generation%2E+arXiv+preprint+arXiv)
109. Timo Schick and Hinrich Schütze. 2021a. Exploiting cloze-questions for few-shot text classification and natural language inference. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 255–269, Online. Association for Com… [find](https://scholar.google.com/scholar?q=Timo+Schick+and+Hinrich+Schu%CC%88tze%2E+2021a%2E+Exploiting+cloze%2Dquestions+for+few%2Dshot+text+classification+and+natural+language+inference%2E+In+Proceedings+of+the+16th+Conference+of+the+European+Chapter+of+th) [our card](https://md.research.elamur.ai/free/en/papers/schick-2021-exploiting-cloze-questions-few-shot/)
110. Sam Shleifer. 2019. Low resource text classification with ulmfit and backtranslation. [find](https://scholar.google.com/scholar?q=Sam+Shleifer%2E+2019%2E+Low+resource+text+classification+with+ulmfit+and+backtranslation%2E)
111. Patrice Y. Simard, David Steinkraus, and John C. Platt. 2003. Best practices for convolutional neural networks applied to visual document analysis. Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings. pages 958–963. representation learning. In Proceedings of the… — [doi:10.18653/v1/n16](https://doi.org/10.18653/v1/n16) [find](https://scholar.google.com/scholar?q=Patrice+Y%2E+Simard%2C+David+Steinkraus%2C+and+John+C%2E+Platt%2E+2003%2E+Best+practices+for+convolutional+neural+networks+applied+to+visual+document+analysis%2E+Seventh+International+Conference+on+Document+Analysi)
112. Kihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang, Han Zhang, Colin A. Raffel, Ekin Dogus Cubuk, Alexey Kurakin, and Chun-Liang Li. 2020. Fixmatch: Simplifying semi-supervised learning with consistency and confidence. Advances in Neural Information Processing Systems, 33. [find](https://scholar.google.com/scholar?q=Kihyuk+Sohn%2C+David+Berthelot%2C+Nicholas+Carlini%2C+Zizhao+Zhang%2C+Han+Zhang%2C+Colin+A%2E+Raffel%2C+Ekin+Dogus+Cubuk%2C+Alexey+Kurakin%2C+and+Chun%2DLiang+Li%2E+2020%2E+Fixmatch%3A+Simplifying+semi%2Dsupervised+learning+with)
113. Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel Bowman. 2018. GLUE: A multi-task benchmark and analysis platform for natural language understanding. In Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pages 353–355,… [find](https://scholar.google.com/scholar?q=Alex+Wang%2C+Amanpreet+Singh%2C+Julian+Michael%2C+Felix+Hill%2C+Omer+Levy%2C+and+Samuel+Bowman%2E+2018%2E+GLUE%3A+A+multi%2Dtask+benchmark+and+analysis+platform+for+natural+language+understanding%2E+In+Proceedings+of+the) [our card](https://md.research.elamur.ai/free/en/papers/wang-2018-glue-multi-task-benchmark-analysis/)
114. Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. In Proceedings of the 27th International Conference on Neural Information Processing Systems-Volume 2, pages 3104–3112. [find](https://scholar.google.com/scholar?q=Ilya+Sutskever%2C+Oriol+Vinyals%2C+and+Quoc+V%2E+Le%2E+2014%2E+Sequence+to+sequence+learning+with+neural+networks%2E+In+Proceedings+of+the+27th+International+Conference+on+Neural+Information+Processing+Systems%2DVo)
115. Samson Tan, Shafiq Joty, Min-Yen Kan, and Richard Socher. 2020. It’s morphin’ time! Combating linguistic discrimination with inflectional perturbations. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 2920–2935, Online. Association for Computational… [find](https://scholar.google.com/scholar?q=Samson+Tan%2C+Shafiq+Joty%2C+Min%2DYen+Kan%2C+and+Richard+Socher%2E+2020%2E+It%E2%80%99s+morphin%E2%80%99+time%21+Combating+linguistic+discrimination+with+inflectional+perturbations%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+th)
116. Yaqing Wang, Quanming Yao, James T. Kwok, and Lionel M. Ni. 2020. Generalizing from a few examples. ACM Computing Surveys, 53(3):1–34. https://doi.org/10.1145/3386252 [↗](https://doi.org/10.1145/3386252)
117. Antti Tarvainen and Harri Valpola. 2017. Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results. In Advances in Neural Information Processing Systems, pages 1195–1204. [find](https://scholar.google.com/scholar?q=Antti+Tarvainen+and+Harri+Valpola%2E+2017%2E+Mean+teachers+are+better+role+models%3A+Weight%2Daveraged+consistency+targets+improve+semi%2Dsupervised+deep+learning+results%2E+In+Advances+in+Neural+Information+Proc)
118. Yicheng Wang and Mohit Bansal. 2018. Robust machine comprehension models via adversarial training. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pages 575–581, New Orleans, L… [find](https://scholar.google.com/scholar?q=Yicheng+Wang+and+Mohit+Bansal%2E+2018%2E+Robust+machine+comprehension+models+via+adversarial+training%2E+In+Proceedings+of+the+2018+Conference+of+the+North+American+Chapter+of+the+Association+for+Computatio)
119. Luke Taylor and Geoff Nitschke. 2018. Improving deep learning with generic data augmentation. In 2018 IEEE Symposium Series on Computational Intelligence (SSCI), pages 1542–1547. https://doi.org/10 .1109/SSCI.2018.8628742 [find](https://scholar.google.com/scholar?q=Luke+Taylor+and+Geoff+Nitschke%2E+2018%2E+Improving+deep+learning+with+generic+data+augmentation%2E+In+2018+IEEE+Symposium+Series+on+Computational+Intelligence+%28SSCI%29%2C+pages+1542%E2%80%931547%2E+https%3A%2F%2Fdoi%2Eorg%2F10+%2E1)
120. Zirui Wang, Adams Wei Yu, Orhan Firat, and Yuan Cao. 2021. Towards zero-label language learning. arXiv preprint arXiv:2109.09193. — [arXiv:2109.09193](https://arxiv.org/abs/2109.09193) [find](https://scholar.google.com/scholar?q=Zirui+Wang%2C+Adams+Wei+Yu%2C+Orhan+Firat%2C+and+Yuan+Cao%2E+2021%2E+Towards+zero%2Dlabel+language+learning%2E+arXiv+preprint+arXiv%3A2109%2E09193%2E+%E2%80%94+%5BarXiv%3A2109%2E09193%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2109%2E09193%29)
121. Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, and Ashish Sabharwal. 2020. Is multihop QA in DiRe condition? Measuring and reducing disconnected reasoning. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 8846–8863, Online. Association f… [find](https://scholar.google.com/scholar?q=Harsh+Trivedi%2C+Niranjan+Balasubramanian%2C+Tushar+Khot%2C+and+Ashish+Sabharwal%2E+2020%2E+Is+multihop+QA+in+DiRe+condition%3F+Measuring+and+reducing+disconnected+reasoning%2E+In+Proceedings+of+the+2020+Conference)
122. Jason Wei and Kai Zou. 2019. EDA: Easy data augmentation techniques for boosting performance on text classification tasks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP… [find](https://scholar.google.com/scholar?q=Jason+Wei+and+Kai+Zou%2E+2019%2E+EDA%3A+Easy+data+augmentation+techniques+for+boosting+performance+on+text+classification+tasks%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Methods+in+Natural+Languag) [our card](https://md.research.elamur.ai/free/en/papers/wei-2019-eda-easy-data-augmentation-techniques/)
123. Yulia Tsvetkov, Sunayana Sitaram, Manaal Faruqui, Guillaume Lample, Patrick Littell, David Mortensen, Alan W. Black, Lori Levin, and Chris Dyer. 2016. Polyglot neural language models: A case study in cross-lingual phonetic Xing Wu, Shangwen Lv, Liangjun Zang, Jizhong Han, and Songlin Hu. 2019a. Cond… — [doi:10.1007/978-3-030-22747-0_7](https://doi.org/10.1007/978-3-030-22747-0_7) [find](https://scholar.google.com/scholar?q=Yulia+Tsvetkov%2C+Sunayana+Sitaram%2C+Manaal+Faruqui%2C+Guillaume+Lample%2C+Patrick+Littell%2C+David+Mortensen%2C+Alan+W%2E+Black%2C+Lori+Levin%2C+and+Chris+Dyer%2E+2016%2E+Polyglot+neural+language+models%3A+A+case+study+in+)
124. Zichao Yang, Zhiting Hu, Ruslan Salakhutdinov, and Taylor Berg-Kirkpatrick. 2017. Improved variational autoencoders for text modeling using dilated convolutions. In Proceedings of the 34th International Conference on Machine Learning - Volume 70, ICML’17, pages 3881–3890. JMLR.org. [find](https://scholar.google.com/scholar?q=Zichao+Yang%2C+Zhiting+Hu%2C+Ruslan+Salakhutdinov%2C+and+Taylor+Berg%2DKirkpatrick%2E+2017%2E+Improved+variational+autoencoders+for+text+modeling+using+dilated+convolutions%2E+In+Proceedings+of+the+34th+Internation)
125. Zhanghao Wu, Shuai Wang, Yanmin Qian, and Kai Yu. 2019b. Data augmentation using variational autoencoder for embedding based speaker verification. In Proceedings of Interspeech 2019, pages 1163–1167. [find](https://scholar.google.com/scholar?q=Zhanghao+Wu%2C+Shuai+Wang%2C+Yanmin+Qian%2C+and+Kai+Yu%2E+2019b%2E+Data+augmentation+using+variational+autoencoder+for+embedding+based+speaker+verification%2E+In+Proceedings+of+Interspeech+2019%2C+pages+1163%E2%80%931167%2E)
126. David Yarowsky. 1995. Unsupervised word sense disambiguation rivaling supervised methods. In 33rd Annual Meeting of the Association for Computational Linguistics, pages 189–196. https://doi.org/10 .3115/981658.981684 [find](https://scholar.google.com/scholar?q=David+Yarowsky%2E+1995%2E+Unsupervised+word+sense+disambiguation+rivaling+supervised+methods%2E+In+33rd+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+pages+189%E2%80%93196%2E+https%3A%2F%2Fdoi%2Eorg%2F10+%2E31) [our card](https://md.research.elamur.ai/free/en/papers/yarowsky-1995-unsupervised-word-sense-disambiguation-rivaling/)
127. Qizhe Xie, Zihang Dai, Eduard Hovy, Thang Luong, and Quoc V. Le. 2020. Unsupervised data augmentation for consistency training. Advances in Neural Information Processing Systems, 33. [find](https://scholar.google.com/scholar?q=Qizhe+Xie%2C+Zihang+Dai%2C+Eduard+Hovy%2C+Thang+Luong%2C+and+Quoc+V%2E+Le%2E+2020%2E+Unsupervised+data+augmentation+for+consistency+training%2E+Advances+in+Neural+Information+Processing+Systems%2C+33%2E) [our card](https://md.research.elamur.ai/free/en/papers/xie-2019-unsupervised-data-augmentation-consistency-training/)
128. Jiacheng Ye, Jiahui Gao, Qintong Li, Hang Xu, Jiangtao Feng, Zhiyong Wu, Tao Yu, and Lingpeng Kong. 2022. Zerogen: Efficient zero-shot learning via dataset generation. arXiv preprint arXiv:2202.07922. [find](https://scholar.google.com/scholar?q=Jiacheng+Ye%2C+Jiahui+Gao%2C+Qintong+Li%2C+Hang+Xu%2C+Jiangtao+Feng%2C+Zhiyong+Wu%2C+Tao+Yu%2C+and+Lingpeng+Kong%2E+2022%2E+Zerogen%3A+Efficient+zero%2Dshot+learning+via+dataset+generation%2E+arXiv+preprint+arXiv%3A2202%2E07922%2E) [our card](https://md.research.elamur.ai/free/en/papers/ye-2022-zerogen-efficient-zero-shot-learning/)
129. Ziang Xie, Sida I. Wang, Jiwei Li, Daniel Lévy, Aiming Nie, Dan Jurafsky, and Andrew Y. Ng. 2017. Data noising as smoothing in neural network language models. CoRR, abs/1703.02573. — [arXiv:1703.02573](https://arxiv.org/abs/1703.02573) [find](https://scholar.google.com/scholar?q=Ziang+Xie%2C+Sida+I%2E+Wang%2C+Jiwei+Li%2C+Daniel+Le%CC%81vy%2C+Aiming+Nie%2C+Dan+Jurafsky%2C+and+Andrew+Y%2E+Ng%2E+2017%2E+Data+noising+as+smoothing+in+neural+network+language+models%2E+CoRR%2C+abs%2F1703%2E02573%2E+%E2%80%94+%5BarXiv%3A1703%2E0257)
130. Adams Wei Yu, David Dohan, Minh-Thang Luong, Rui Zhao, Kai Chen, Mohammad Norouzi, and Quoc V. Le. 2018. Qanet: Combining local convolution with global self-attention for reading comprehension. CoRR, abs/1804.09541. [find](https://scholar.google.com/scholar?q=Adams+Wei+Yu%2C+David+Dohan%2C+Minh%2DThang+Luong%2C+Rui+Zhao%2C+Kai+Chen%2C+Mohammad+Norouzi%2C+and+Quoc+V%2E+Le%2E+2018%2E+Qanet%3A+Combining+local+convolution+with+global+self%2Dattention+for+reading+comprehension%2E+CoRR%2C+) [our card](https://md.research.elamur.ai/free/en/papers/yu-2018-qanet-combining-local-convolution-global/)
131. Jingjing Xu, Xuancheng Ren, Junyang Lin, and Xu Sun. 2018. Dp-gan: Diversity-promoting generative adversarial network for generating informative and diversified text. In CoRR. [find](https://scholar.google.com/scholar?q=Jingjing+Xu%2C+Xuancheng+Ren%2C+Junyang+Lin%2C+and+Xu+Sun%2E+2018%2E+Dp%2Dgan%3A+Diversity%2Dpromoting+generative+adversarial+network+for+generating+informative+and+diversified+text%2E+In+CoRR%2E)
132. Guoyang Zeng, Fanchao Qi, Qianrui Zhou, Tingji Zhang, Bairu Hou, Yuan Zang, Zhiyuan Liu, and Maosong Sun. 2020. Openattack: An open-source textual adversarial attack toolkit. https://doi.org/10.18653/v1/2021.acl-demo.43 [↗](https://doi.org/10.18653/v1/2021.acl-demo.43)
133. Weidi Xu, Haoze Sun, Chao Deng, and Ying Tan. 2017. Variational autoencoder for semi-supervised text classification. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 31. https://doi.org/10.1609/aaai.v31i1.10966 — [doi:10.1609/aaai.v31i1.10966](https://doi.org/10.1609/aaai.v31i1.10966) [↗](https://doi.org/10.1609/aaai.v31i1.10966)
134. Hongyi Zhang, Moustapha Cisse, Yann N. Dauphin, and David Lopez-Paz. 2018. mixup: Beyond empirical risk minimization. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Hongyi+Zhang%2C+Moustapha+Cisse%2C+Yann+N%2E+Dauphin%2C+and+David+Lopez%2DPaz%2E+2018%2E+mixup%3A+Beyond+empirical+risk+minimization%2E+In+International+Conference+on+Learning+Representations%2E) [our card](https://md.research.elamur.ai/free/en/papers/zhang-2017-mixup-empirical-risk-minimization/)
135. Diyi Yang, and William Yang Wang. 2015. That’s so annoying!!!: A lexical and frame-semantic embedding based data augmentation approach to automatic categorization of annoying behaviors using \#petpeeve tweets. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing.… [find](https://scholar.google.com/scholar?q=Diyi+Yang%2C+and+William+Yang+Wang%2E+2015%2E+That%E2%80%99s+so+annoying%21%21%21%3A+A+lexical+and+frame%2Dsemantic+embedding+based+data+augmentation+approach+to+automatic+categorization+of+annoying+behaviors+using+%5C%23petpeev) [our card](https://md.research.elamur.ai/free/en/papers/wang-2015-that-s-so-annoying-lexical/)
136. Jiajun Zhang and Chengqing Zong. 2016. Exploiting source-side monolingual data in neural machine translation. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1535–1545, Austin, Texas. Association for Computational Linguistics. https://doi.org/10 .1865… [find](https://scholar.google.com/scholar?q=Jiajun+Zhang+and+Chengqing+Zong%2E+2016%2E+Exploiting+source%2Dside+monolingual+data+in+neural+machine+translation%2E+In+Proceedings+of+the+2016+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C) [our card](https://md.research.elamur.ai/free/en/papers/zhang-2016-exploiting-source-side-monolingual-data/)
137. Yiben Yang, Chaitanya Malaviya, Jared Fernandez, Swabha Swayamdipta, Ronan Le Bras, Ji-Ping Wang, Chandra Bhagavatula, Yejin Choi, and Doug Downey. 2020. Generative data augmentation for commonsense reasoning. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 1008–1025,… [find](https://scholar.google.com/scholar?q=Yiben+Yang%2C+Chaitanya+Malaviya%2C+Jared+Fernandez%2C+Swabha+Swayamdipta%2C+Ronan+Le+Bras%2C+Ji%2DPing+Wang%2C+Chandra+Bhagavatula%2C+Yejin+Choi%2C+and+Doug+Downey%2E+2020%2E+Generative+data+augmentation+for+commonsense+r) [our card](https://md.research.elamur.ai/free/en/papers/yang-2020-generative-data-augmentation-commonsense-reasoning/)
138. Rongzhi Zhang, Yue Yu, and Chao Zhang. 2020a. SeqMix: Augmenting active sequence labeling via sequence mixup. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 8566–8579, Online. Association for Computational Linguistics. [https://doi.org](https://doi.org) /10.186… [↗](https://doi.org)
139. Xiang Zhang, Junbo Zhao, and Yann LeCun. 2015b. Character-level convolutional networks for text classification. Advances in Neural Information Processing Systems, 28:649–657. [find](https://scholar.google.com/scholar?q=Xiang+Zhang%2C+Junbo+Zhao%2C+and+Yann+LeCun%2E+2015b%2E+Character%2Dlevel+convolutional+networks+for+text+classification%2E+Advances+in+Neural+Information+Processing+Systems%2C+28%3A649%E2%80%93657%2E) [our card](https://md.research.elamur.ai/free/en/papers/zhang-2015-character-level-convolutional-networks-text/)
140. Shiyue Zhang and Mohit Bansal. 2019. Addressing semantic drift in question generation for semi-supervised question answering. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJC… [find](https://scholar.google.com/scholar?q=Shiyue+Zhang+and+Mohit+Bansal%2E+2019%2E+Addressing+semantic+drift+in+question+generation+for+semi%2Dsupervised+question+answering%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Methods+in+Natural+Lang)
141. Zhengli Zhao, Dheeru Dua, and Sameer Singh. 2017. Generating natural adversarial examples. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Zhengli+Zhao%2C+Dheeru+Dua%2C+and+Sameer+Singh%2E+2017%2E+Generating+natural+adversarial+examples%2E+In+International+Conference+on+Learning+Representations%2E)
142. Zhun Zhong, Liang Zheng, Guoliang Kang, Shaozi Li, and Yi Yang. 2020. Random erasing data augmentation. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 13001–13008. https://doi.org/10.1609/aaai.v34i07.7000 — [doi:10.1609/aaai.v34i07.7000](https://doi.org/10.1609/aaai.v34i07.7000) [↗](https://doi.org/10.1609/aaai.v34i07.7000)
143. Xiang Zhang, Junbo Zhao, and Yann LeCun. 2015a. Character-level convolutional networks for text classification. In Proceedings of the 28th International Conference on Neural Information Processing Systems - Volume 1, NIPS’15, page 649–657. Cambridge, MA, USA. MIT Press. [find](https://scholar.google.com/scholar?q=Xiang+Zhang%2C+Junbo+Zhao%2C+and+Yann+LeCun%2E+2015a%2E+Character%2Dlevel+convolutional+networks+for+text+classification%2E+In+Proceedings+of+the+28th+International+Conference+on+Neural+Information+Processing+Sys) [our card](https://md.research.elamur.ai/free/en/papers/zhang-2015-character-level-convolutional-networks-text/)
144. Chen Zhu, Yu Cheng, Zhe Gan, Siqi Sun, Tom Goldstein, and Jingjing Liu. 2020. Freelb: Enhanced adversarial training for natural language understanding. In ICLR. [find](https://scholar.google.com/scholar?q=Chen+Zhu%2C+Yu+Cheng%2C+Zhe+Gan%2C+Siqi+Sun%2C+Tom+Goldstein%2C+and+Jingjing+Liu%2E+2020%2E+Freelb%3A+Enhanced+adversarial+training+for+natural+language+understanding%2E+In+ICLR%2E) [our card](https://md.research.elamur.ai/free/en/papers/zhu-2019-freelb-enhanced-adversarial-training-natural/)
145. Xiaojin Jerry Zhu. 2005. Semi-supervised learning literature survey, University of Wisconsin-Madison Department of Computer Sciences. [find](https://scholar.google.com/scholar?q=Xiaojin+Jerry+Zhu%2E+2005%2E+Semi%2Dsupervised+learning+literature+survey%2C+University+of+Wisconsin%2DMadison+Department+of+Computer+Sciences%2E)
146. Wei Emma Zhang, Quan Z. Sheng, Ahoud Alhazmi, and Chenliang Li. 2020b. Adversarial attacks on deep-learning models in natural language processing: A survey. ACM Transactions on Intelligent Systems and Technology (TIST), 11(3):1–41. https://doi.org/10 .1145/3374217 [find](https://scholar.google.com/scholar?q=Wei+Emma+Zhang%2C+Quan+Z%2E+Sheng%2C+Ahoud+Alhazmi%2C+and+Chenliang+Li%2E+2020b%2E+Adversarial+attacks+on+deep%2Dlearning+models+in+natural+language+processing%3A+A+survey%2E+ACM+Transactions+on+Intelligent+Systems+and)