---
title: "Inoculation by Fine-Tuning — paper by Liu et al. (2019)"
description: "A drop alone does not show whether the model architecture is limited or whether the original training… 18 references, cited by 60 papers here."
authors: ["Nelson F. Liu", "Roy Schwartz", "Noah A. Smith"]
year: 2019
venue: "Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)"
source: "https://aclanthology.org/N19-1225/"
doi: "10.18653/v1/n19-1225"
arxiv: "1904.02668"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/liu-2019-inoculation-fine-tuning-method-analyzing/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/liu-2019-inoculation-fine-tuning-method-analyzing/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2019](https://md.research.elamur.ai/free/en/papers/2019/page/4/) / Inoculation by Fine-Tuning: A Method for Analyzing Challenge Datasets

# Inoculation by Fine-Tuning: A Method for Analyzing Challenge Datasets

**Authors:** [Nelson F. Liu](https://md.research.elamur.ai/free/en/authors/nelson-f-liu/), [Roy Schwartz](https://md.research.elamur.ai/free/en/authors/roy-schwartz/) and [Noah A. Smith](https://md.research.elamur.ai/free/en/authors/noah-a-smith/) · **Year:** 2019 · **Venue:** [Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)](https://md.research.elamur.ai/free/en/venues/naacl/) ([NAACL 2019](https://md.research.elamur.ai/free/en/venues/naacl/2019/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/N19-1225/) · [PDF](https://aclanthology.org/N19-1225.pdf) · [DOI 10.18653/v1/n19-1225](https://doi.org/10.18653/v1/n19-1225) · [arXiv 1904.02668](https://arxiv.org/abs/1904.02668) · [OpenAlex](https://openalex.org/W2927622107)

**Citations:** 77 citations (OpenAlex, 2026-10-14) · [60](https://md.research.elamur.ai/free/en/papers/liu-2019-inoculation-fine-tuning-method-analyzing/cited-by/) in our library, of the 141,840 papers whose bibliographies we read

## Summary
Challenge (adversarial) datasets often cause sharp drops in model accuracy. A drop alone does not show whether the model architecture is limited or whether the original training data simply lacked certain patterns. Liu, Schwartz and Smith address this with "inoculation by fine-tuning." A model trained on the standard dataset continues training on a small sample of challenge examples. Training halts after five consecutive epochs without any gain in accuracy on the original development set. The model is then re-tested on both test sets, and one of three outcomes follows:

- **Outcome 1:** the gap closes, which points to a data gap.
- **Outcome 2:** nothing changes, which points to a model limitation.
- **Outcome 3:** original performance drops, which suggests the two data distributions conflict.

The authors tested five NLI stress tests from Naik et al. using ESIM and decomposable attention trained on MultiNLI. They also tested Adversarial SQuAD using BiDAF and QANet, with fine-tuning sets of 50 to 1K examples. All three outcomes appeared. This shows that challenge sets differ widely in what they actually diagnose. The method is cheap, task-independent and useful for interpreting robustness benchmarks.

## Key points
- **Word overlap and negation (Outcome 1):** about 100 challenge examples, under 0.03% of the MultiNLI training data, let ESIM recover over 90% of the gap. Original accuracy stays intact.
- **Spelling errors and length mismatch (Outcome 2):** neither model improves much. A character-aware ESIM variant behaves the same way, which hints at a weakness beyond word representations.
- **Numerical reasoning (Outcome 3):** ESIM closes the whole gap with 100 examples and DA with 750, but original accuracy falls. The data turns out to be shallow:
  - a 3-rule baseline exceeds 80%;
  - 35% of hypotheses contain "more/less than," and 95% of those are labeled neutral.
- **Adversarial SQuAD (Outcome 3):** 400 examples let BiDAF close more than 60% of the gap, at roughly a 7% cost on original SQuAD; QANet shows the same pattern. The likely cause is that the distractor sentence always sits at the paragraph's end.
- **Limitation:** the method is uninformative for label-skewed challenge sets, such as the antonym test, where every example is labeled contradiction. Code is publicly released.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Washington](https://md.research.elamur.ai/free/en/universities/university-of-washington/) — University, Seattle, United States · 263 works · 180,581 citations
- [Allen Institute for Artificial Intelligence](https://md.research.elamur.ai/free/en/labs/allen-institute-for-artificial-intelligence/) — Research institute, Seattle, United States · 219 works · 89,712 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,086 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,889 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works

## Cite

Cite as: Nelson F. Liu, Roy Schwartz and Noah A. Smith. 2019. Inoculation by Fine-Tuning: A Method for Analyzing Challenge Datasets. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{liu2019inoculation,
  title = {{Inoculation by Fine-Tuning: A Method for Analyzing Challenge Datasets}},
  author = {Nelson F. Liu, Roy Schwartz and Noah A. Smith},
  booktitle = {Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)},
  year = {2019},
  doi = {10.18653/v1/n19-1225},
  eprint = {1904.02668},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.18653/v1/n19-1225}
}
```

- [← previous Investigating Entity Knowledge in BERT with Simple Neural End-To-End Entity Linking](https://md.research.elamur.ai/free/en/papers/broscheit-2019-investigating-entity-knowledge-bert-simple/)
- [next → Lost in Translation: Loss and Decay of Linguistic Richness in Machine Translation](https://md.research.elamur.ai/free/en/papers/vanmassenhove-2019-lost-translation-loss-decay-linguistic/)
- [↑ back to papers of 2019](https://md.research.elamur.ai/free/en/papers/2019/page/4/)

## References

18 references, 9 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Yonatan Belinkov and Yonatan Bisk. 2018. Synthetic and natural noise both break neural machine translation. In Proc. of ICLR. [find](https://scholar.google.com/scholar?q=Yonatan+Belinkov+and+Yonatan+Bisk%2E+2018%2E+Synthetic+and+natural+noise+both+break+neural+machine+translation%2E+In+Proc%2E+of+ICLR%2E)
2. Samuel R. Bowman, Gabor Angeli, Christopher Potts, and Christopher D. Manning. 2015. A large annotated corpus for learning natural language inference. In Proc. of EMNLP. [find](https://scholar.google.com/scholar?q=Samuel+R%2E+Bowman%2C+Gabor+Angeli%2C+Christopher+Potts%2C+and+Christopher+D%2E+Manning%2E+2015%2E+A+large+annotated+corpus+for+learning+natural+language+inference%2E+In+Proc%2E+of+EMNLP%2E)
3. Qian Chen, Xiaodan Zhu, Zhenhua Ling, Si Wei, Hui Jiang, and Diana Inkpen. 2017. Enhanced LSTM for natural language inference. In Proc. of ACL. [find](https://scholar.google.com/scholar?q=Qian+Chen%2C+Xiaodan+Zhu%2C+Zhenhua+Ling%2C+Si+Wei%2C+Hui+Jiang%2C+and+Diana+Inkpen%2E+2017%2E+Enhanced+LSTM+for+natural+language+inference%2E+In+Proc%2E+of+ACL%2E)
4. Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In Proc. of EMNLP. [find](https://scholar.google.com/scholar?q=Kyunghyun+Cho%2C+Bart+Van+Merrie%CC%88nboer%2C+Caglar+Gulcehre%2C+Dzmitry+Bahdanau%2C+Fethi+Bougares%2C+Holger+Schwenk%2C+and+Yoshua+Bengio%2E+2014%2E+Learning+phrase+representations+using+RNN+encoder%2Ddecoder+for+statisti)
5. Minjoon Seo, Aniruddha Kembhavi, Ali Farhadi, and Hannaneh Hajishirzi. 2017. [Bidirectional attention flow for machine comprehension](https://md.research.elamur.ai/free/en/papers/seo-2016-bidirectional-attention-flow-machine-comprehension/). In Proc. of ICLR.
6. Adina Williams, Nikita Nangia, and Samuel R. Bowman. 2018. A broad-coverage challenge corpus for sentence understanding through inference. In Proc. of NAACL. [find](https://scholar.google.com/scholar?q=Adina+Williams%2C+Nikita+Nangia%2C+and+Samuel+R%2E+Bowman%2E+2018%2E+A+broad%2Dcoverage+challenge+corpus+for+sentence+understanding+through+inference%2E+In+Proc%2E+of+NAACL%2E)
7. Adams Wei Yu, David Dohan, Minh-Thang Luong, Rui Zhao, Kai Chen, Mohammad Norouzi, and Quoc V. Le. 2018. [Qanet: Combining local convolution with global self-attention for reading comprehension](https://md.research.elamur.ai/free/en/papers/yu-2018-qanet-combining-local-convolution-global/). In Proc. of ICLR.
8. Zhengli Zhao, Dheeru Dua, and Sameer Singh. 2018. Generating natural adversarial examples. In Proc. of ICLR. [find](https://scholar.google.com/scholar?q=Zhengli+Zhao%2C+Dheeru+Dua%2C+and+Sameer+Singh%2E+2018%2E+Generating+natural+adversarial+examples%2E+In+Proc%2E+of+ICLR%2E)
9. Javid Ebrahimi, Anyi Rao, Daniel Lowd, and Dejing Dou. 2018. [Hotflip: White-box adversarial examples for text classification](https://md.research.elamur.ai/free/en/papers/ebrahimi-2018-hotflip-white-box-adversarial-examples/). In Proc. of ACL.
10. Matt Gardner, Joel Grus, Mark Neumann, Oyvind Tafjord, Pradeep Dasigi, Nelson F. Liu, Matthew Peters, Michael Schmitz, and Luke Zettlemoyer. 2018. [AllenNLP: A deep semantic natural language processing platform](https://md.research.elamur.ai/free/en/papers/gardner-2018-allennlp-deep-semantic-natural-language/). In Proc. of NLP-OSS.
11. Max Glockner, Vered Shwartz, and Yoav Goldberg. 2018. [Breaking NLI systems with sentences that require simple lexical inferences](https://md.research.elamur.ai/free/en/papers/glockner-2018-breaking-nli-systems-sentences-that/). In Proc. of ACL.
12. Suchin Gururangan, Swabha Swayamdipta, Omer Levy, Roy Schwartz, Samuel R. Bowman, and Noah A. Smith. 2018. Annotation artifacts in natural language inference data. In Proc. of NAACL. [find](https://scholar.google.com/scholar?q=Suchin+Gururangan%2C+Swabha+Swayamdipta%2C+Omer+Levy%2C+Roy+Schwartz%2C+Samuel+R%2E+Bowman%2C+and+Noah+A%2E+Smith%2E+2018%2E+Annotation+artifacts+in+natural+language+inference+data%2E+In+Proc%2E+of+NAACL%2E)
13. Robin Jia and Percy Liang. 2017. [Adversarial examples for evaluating reading comprehension systems](https://md.research.elamur.ai/free/en/papers/jia-2017-adversarial-examples-evaluating-reading-comprehension/). In Proc. of EMNLP.
14. Pramod Kaushik Mudrakarta, Ankur Taly, Mukund Sundararajan, and Kedar Dhamdhere. 2018. [Did the model understand the question?](https://md.research.elamur.ai/free/en/papers/mudrakarta-2018-did-model-understand-question/) In Proc. of ACL.
15. Aakanksha Naik, Abhilasha Ravichander, Norman Sadeh, Carolyn Penstein Rosé, and Graham Neubig. 2018. Stress test evaluation for natural language inference. In Proc. of COLING. [find](https://scholar.google.com/scholar?q=Aakanksha+Naik%2C+Abhilasha+Ravichander%2C+Norman+Sadeh%2C+Carolyn+Penstein+Rose%CC%81%2C+and+Graham+Neubig%2E+2018%2E+Stress+test+evaluation+for+natural+language+inference%2E+In+Proc%2E+of+COLING%2E)
16. Ankur P. Parikh, Oscar Täckström, Dipanjan Das, and Jakob Uszkoreit. 2016. [A decomposable attention model for natural language inference](https://md.research.elamur.ai/free/en/papers/parikh-2016-decomposable-attention-model-natural-language/). In Proc. of EMNLP.
17. Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016. [SQuAD: 100,000+ questions for machine comprehension of text](https://md.research.elamur.ai/free/en/papers/rajpurkar-2016-squad-100-000-questions-machine/). In Proc. of EMNLP.
18. Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2018. Semantically equivalent adversarial rules for debugging NLP models. In Proc. of ACL. [find](https://scholar.google.com/scholar?q=Marco+Tulio+Ribeiro%2C+Sameer+Singh%2C+and+Carlos+Guestrin%2E+2018%2E+Semantically+equivalent+adversarial+rules+for+debugging+NLP+models%2E+In+Proc%2E+of+ACL%2E)

*Updated 24 October 2026*