---
title: "Penguins Don't Fly — paper by Allaway et al. (2023)"
description: "Drawing on linguistic theory, the authors propose to automatically generate EXEMPLARS. 12.8 points. 71 references, cited by 18 papers here."
authors: ["Emily Allaway", "Jena D. Hwang", "Chandra Bhagavatula", "Kathleen McKeown", "Doug Downey", "Yejin Choi"]
year: 2023
venue: "Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics"
source: "https://aclanthology.org/2023.eacl-main.192/"
doi: "10.18653/v1/2023.eacl-main.192"
arxiv: "2205.11658"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/allaway-2023-penguins-don-t-fly-reasoning/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/allaway-2023-penguins-don-t-fly-reasoning/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2023](https://md.research.elamur.ai/free/en/papers/2023/page/12/) / Penguins Don't Fly: Reasoning about Generics through Instantiations and Exceptions

# Penguins Don't Fly: Reasoning about Generics through Instantiations and Exceptions

**Authors:** [Emily Allaway](https://md.research.elamur.ai/free/en/authors/emily-allaway/), [Jena D. Hwang](https://md.research.elamur.ai/free/en/authors/jena-d-hwang/), [Chandra Bhagavatula](https://md.research.elamur.ai/free/en/authors/chandra-bhagavatula/), [Kathleen McKeown](https://md.research.elamur.ai/free/en/authors/kathleen-mckeown/), [Doug Downey](https://md.research.elamur.ai/free/en/authors/doug-downey/) and [Yejin Choi](https://md.research.elamur.ai/free/en/authors/yejin-choi/) · **Year:** 2023 · **Venue:** [Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/eacl/) ([EACL 2023](https://md.research.elamur.ai/free/en/venues/eacl/2023/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2023.eacl-main.192/) · [PDF](https://aclanthology.org/2023.eacl-main.192.pdf) · [DOI 10.18653/v1/2023.eacl-main.192](https://doi.org/10.18653/v1/2023.eacl-main.192) · [arXiv 2205.11658](https://arxiv.org/abs/2205.11658) · [OpenAlex](https://openalex.org/W4386566648)

**Citations:** 13 citations (OpenAlex, 2026-10-14) · [18](https://md.research.elamur.ai/free/en/papers/allaway-2023-penguins-don-t-fly-reasoning/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Generics are generalizations such as "birds fly" that do not always hold: penguins and chicks do not fly. Commonsense knowledge bases contain such statements but say almost nothing about when a generic holds and when it does not. Drawing on linguistic theory, the authors propose to automatically generate EXEMPLARS. These are INSTANTIATIONS, i.e., examples where the generic holds, and EXCEPTIONS, i.e., counterexamples. Generics are divided into three categories: quasi-definitional, principled, and characterizing. A logical form is derived for each category, and generation templates are built from it. Concepts from ConceptNet are inserted into prompts and into constraints for Neurologic A*esque decoding on top of GPT-2. Trained discriminators then filter out low-quality candidates. This yields about 19K exemplars for 653 generics. According to human evaluation, the system is 12.8 points more accurate than few-shot GPT-3. The analysis shows that knowledge bases are a poor source of exemplars. Moreover, the NLI scheme inadequately captures the relation between a generic and its exceptions. The work matters for modeling default (non-monotonic) reasoning.

## Key points
- The resource contains 12,562 INSTANTIATIONS and 6,297 EXCEPTIONS for about 650 English generics from the collection of Bhagavatula et al. (2022). The code and data are published on GitHub (emilyallaway/generics-exemplars).
- The method combines knowledge from ConceptNet, templates based on logical forms, and constrained Neurologic A*esque decoding with GPT2-XL. At the output, discriminators check the quality of the candidates.
- According to human evaluation, the system's precision is 12.8 points higher than that of a strong GPT-3-based baseline. At the same time, generation is easier to control.
- If only those EXCEPTIONS are kept for which an NLI model predicts "contradiction", P@1 rises from 0.632 to 0.839 (+20.7 points). For INSTANTIATIONS, such filtering changes almost nothing (about 0.91).
- The authors argue that the theoretically correct NLI label for exceptions is "neutral". Hence, the agreement of the predicted labels with exceptions indicates systematic model errors and the need for a more fine-grained NLI scheme. Generics about people are deliberately excluded so as not to reproduce stereotypes.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Washington](https://md.research.elamur.ai/free/en/universities/university-of-washington/) — University, Seattle, United States · 422 works · 213,538 citations
- [Allen Institute for Artificial Intelligence](https://md.research.elamur.ai/free/en/labs/allen-institute-for-artificial-intelligence/) — Research institute, Seattle, United States · 317 works · 106,633 citations
- [Columbia University](https://md.research.elamur.ai/free/en/universities/columbia-university/) — University, New York, United States · 263 works · 57,820 citations
- [Northwestern University](https://md.research.elamur.ai/free/en/universities/northwestern-university/) — University, Evanston, United States · 49 works · 3,654 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 19,503 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 18,805 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,959 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,789 works

🧭 Topics (1): [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 1,948 works

## Cite

Cite as: Emily Allaway, Jena D. Hwang, Chandra Bhagavatula, Kathleen McKeown, Doug Downey and Yejin Choi. 2023. Penguins Don't Fly: Reasoning about Generics through Instantiations and Exceptions. Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{allaway2023penguins,
  title = {{Penguins Don't Fly: Reasoning about Generics through Instantiations and Exceptions}},
  author = {Emily Allaway, Jena D. Hwang, Chandra Bhagavatula, Kathleen McKeown, Doug Downey and Yejin Choi},
  booktitle = {Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics},
  year = {2023},
  doi = {10.18653/v1/2023.eacl-main.192},
  eprint = {2205.11658},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.18653/v1/2023.eacl-main.192}
}
```

- [← previous Knowledge Graph-Augmented Language Models for Knowledge-Grounded Dialogue Generation](https://md.research.elamur.ai/free/en/papers/kang-2023-knowledge-graph-augmented-language-models/)
- [next → PropSegmEnt: A Large-Scale Corpus for Proposition-Level Segmentation and Entailment Recognition](https://md.research.elamur.ai/free/en/papers/chen-2023-propsegment-large-scale-corpus-proposition/)
- [↑ back to papers of 2023](https://md.research.elamur.ai/free/en/papers/2023/page/12/)

## References

71 references, 12 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Nicholas Asher and Michael Morreau. 1995. What some generic sentences mean. In Gregory N. Carlson and Francis Jeffry Pelletier, editors, The generic book, pages 300–338. The University of Chicago Press. [find](https://scholar.google.com/scholar?q=Nicholas+Asher+and+Michael+Morreau%2E+1995%2E+What+some+generic+sentences+mean%2E+In+Gregory+N%2E+Carlson+and+Francis+Jeffry+Pelletier%2C+editors%2C+The+generic+book%2C+pages+300%E2%80%93338%2E+The+University+of+Chicago+Pres)
2. Chandra Bhagavatula, Jena D. Hwang, Doug Downey, Ronan Le Bras, Ximing Lu, Keisuke Sakaguchi, Swabha Swayamdipta, Peter West, and Yejin Choi. 2022. I2d2: Inductive knowledge distillation with neurologic and self-imitation. ArXiv, abs/2212.09246. [find](https://scholar.google.com/scholar?q=Chandra+Bhagavatula%2C+Jena+D%2E+Hwang%2C+Doug+Downey%2C+Ronan+Le+Bras%2C+Ximing+Lu%2C+Keisuke+Sakaguchi%2C+Swabha+Swayamdipta%2C+Peter+West%2C+and+Yejin+Choi%2E+2022%2E+I2d2%3A+Inductive+knowledge+distillation+with+neurolog)
3. Sumithra Bhakthavatsalam, Chloe Anastasiades, and Peter Clark. 2020. Genericskb: A knowledge base of generic statements. ArXiv, abs/2005.00660. [find](https://scholar.google.com/scholar?q=Sumithra+Bhakthavatsalam%2C+Chloe+Anastasiades%2C+and+Peter+Clark%2E+2020%2E+Genericskb%3A+A+knowledge+base+of+generic+statements%2E+ArXiv%2C+abs%2F2005%2E00660%2E)
4. Michael Boratko, Xiang Lorraine Li, Rajarshi Das, Timothy J. O’Gorman, Daniel Le, and Andrew McCallum. 2020. Protoqa: A question answering dataset for prototypical common-sense reasoning. ArXiv, abs/2005.00771. [find](https://scholar.google.com/scholar?q=Michael+Boratko%2C+Xiang+Lorraine+Li%2C+Rajarshi+Das%2C+Timothy+J%2E+O%E2%80%99Gorman%2C+Daniel+Le%2C+and+Andrew+McCallum%2E+2020%2E+Protoqa%3A+A+question+answering+dataset+for+prototypical+common%2Dsense+reasoning%2E+ArXiv%2C+abs%2F2)
5. Samuel R Bowman, Gabor Angeli, Christopher Potts, and Christopher D Manning. 2015. [A large annotated corpus for learning natural language inference](https://md.research.elamur.ai/free/en/papers/bowman-2015-large-annotated-corpus-learning-natural/). In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP).
6. Gerhard Brewka. 1987. The logic of inheritance in frame systems. In IJCAI. [find](https://scholar.google.com/scholar?q=Gerhard+Brewka%2E+1987%2E+The+logic+of+inheritance+in+frame+systems%2E+In+IJCAI%2E)
7. Tom B Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020. [Language models are few-shot learners](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/). arXiv preprint arXiv:2005.14165.
8. Greg N. Carlson. 1977. Reference to kinds in english. In Ph.D. dissertation, University of Massachusetts, Amherst. [find](https://scholar.google.com/scholar?q=Greg+N%2E+Carlson%2E+1977%2E+Reference+to+kinds+in+english%2E+In+Ph%2ED%2E+dissertation%2C+University+of+Massachusetts%2C+Amherst%2E)
9. Greg N. Carlson. 1989. On the semantic composition of english generic sentences. In Gennaro Chierchia, Barbara H Partee, and Raymond Turner, editors, Properties, Types and Meaning, Vol. II. Semantic Issues. Dordrecht: Kluwer. [find](https://scholar.google.com/scholar?q=Greg+N%2E+Carlson%2E+1989%2E+On+the+semantic+composition+of+english+generic+sentences%2E+In+Gennaro+Chierchia%2C+Barbara+H+Partee%2C+and+Raymond+Turner%2C+editors%2C+Properties%2C+Types+and+Meaning%2C+Vol%2E+II%2E+Semantic+I)
10. Ariel Cohen. 1996. Think generic! The meaning and use of generic sentences. Carnegie Mellon University. [find](https://scholar.google.com/scholar?q=Ariel+Cohen%2E+1996%2E+Think+generic%21+The+meaning+and+use+of+generic+sentences%2E+Carnegie+Mellon+University%2E)
11. Ariel Cohen. 1999. Generics, frequency adverbs, and probability. Linguistics and philosophy, 22(3):221– 253. [find](https://scholar.google.com/scholar?q=Ariel+Cohen%2E+1999%2E+Generics%2C+frequency+adverbs%2C+and+probability%2E+Linguistics+and+philosophy%2C+22%283%29%3A221%E2%80%93+253%2E)
12. Ariel Cohen. 2004. Generics and mental representations. Linguistics and Philosophy, 27(5):529–556. [find](https://scholar.google.com/scholar?q=Ariel+Cohen%2E+2004%2E+Generics+and+mental+representations%2E+Linguistics+and+Philosophy%2C+27%285%29%3A529%E2%80%93556%2E)
13. Robin Cooper, Richard Crouch, Jan Van Eijck, Chris Fox, Josef Van Genabith, Jan Jaspers, Hans Kamp, Manfred Pinkal, Massimo Poesio, Stephen Pulman, et al. 1994. Fracas: A framework for computational semantics. Deliverable D6. [find](https://scholar.google.com/scholar?q=Robin+Cooper%2C+Richard+Crouch%2C+Jan+Van+Eijck%2C+Chris+Fox%2C+Josef+Van+Genabith%2C+Jan+Jaspers%2C+Hans+Kamp%2C+Manfred+Pinkal%2C+Massimo+Poesio%2C+Stephen+Pulman%2C+et+al%2E+1994%2E+Fracas%3A+A+framework+for+computational+s)
14. Ido Dagan, Dan Roth, Mark Sammons, and Fabio Massimo Zanzotto. 2013. Recognizing textual entailment: Models and applications. Synthesis Lectures on Human Language Technologies, 6(4):1–220. [find](https://scholar.google.com/scholar?q=Ido+Dagan%2C+Dan+Roth%2C+Mark+Sammons%2C+and+Fabio+Massimo+Zanzotto%2E+2013%2E+Recognizing+textual+entailment%3A+Models+and+applications%2E+Synthesis+Lectures+on+Human+Language+Technologies%2C+6%284%29%3A1%E2%80%93220%2E)
15. Barry Devereux, Lorraine K. Tyler, Jeroen Geertzen, and Billi Randall. 2014. The centre for speech, language and the brain (cslb) concept property norms. Behavior Research Methods, 46:1119 – 1127. [find](https://scholar.google.com/scholar?q=Barry+Devereux%2C+Lorraine+K%2E+Tyler%2C+Jeroen+Geertzen%2C+and+Billi+Randall%2E+2014%2E+The+centre+for+speech%2C+language+and+the+brain+%28cslb%29+concept+property+norms%2E+Behavior+Research+Methods%2C+46%3A1119+%E2%80%93+1127%2E)
16. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. [Bert: Pre-training of deep bidirectional transformers for language understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/). arXiv preprint arXiv:1810.04805.
17. Renée Elio and Francis Jeffry Pelletier. 1996. On reasoning with default rules and exceptions. In Proceedings of the 18th conference of the Cognitive Science Society, pages 131–136. [find](https://scholar.google.com/scholar?q=Ren%C3%A9e+Elio+and+Francis+Jeffry+Pelletier%2E+1996%2E+On+reasoning+with+default+rules+and+exceptions%2E+In+Proceedings+of+the+18th+conference+of+the+Cognitive+Science+Society%2C+pages+131%E2%80%93136%2E)
18. Joseph L Fleiss. 1971. Measuring nominal scale agreement among many raters. Psychological bulletin, 76(5):378. [find](https://scholar.google.com/scholar?q=Joseph+L+Fleiss%2E+1971%2E+Measuring+nominal+scale+agreement+among+many+raters%2E+Psychological+bulletin%2C+76%285%29%3A378%2E)
19. Maxwell Forbes, Jena D. Hwang, Vered Shwartz, Maarten Sap, and Yejin Choi. 2020. Social chemistry 101: Learning to reason about social and moral norms. In EMNLP. [find](https://scholar.google.com/scholar?q=Maxwell+Forbes%2C+Jena+D%2E+Hwang%2C+Vered+Shwartz%2C+Maarten+Sap%2C+and+Yejin+Choi%2E+2020%2E+Social+chemistry+101%3A+Learning+to+reason+about+social+and+moral+norms%2E+In+EMNLP%2E)
20. Annemarie Friedrich, Alexis Palmer, and Manfred Pinkal. 2016. Situation entity types: automatic classification of clause-level aspect. In Annual Meeting of the Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Annemarie+Friedrich%2C+Alexis+Palmer%2C+and+Manfred+Pinkal%2E+2016%2E+Situation+entity+types%3A+automatic+classification+of+clause%2Dlevel+aspect%2E+In+Annual+Meeting+of+the+Association+for+Computational+Linguistic)
21. Annemarie Friedrich, Alexis Palmer, Melissa Peate Sørensen, and Manfred Pinkal. 2015. Annotating genericity: a survey, a scheme, and a corpus. In LAW@NAACL-HLT. [find](https://scholar.google.com/scholar?q=Annemarie+Friedrich%2C+Alexis+Palmer%2C+Melissa+Peate+S%C3%B8rensen%2C+and+Manfred+Pinkal%2E+2015%2E+Annotating+genericity%3A+a+survey%2C+a+scheme%2C+and+a+corpus%2E+In+LAW%40NAACL%2DHLT%2E)
22. M. Ginsberg. 1987a. Introduction. Morgan Kaufmann, Los Altos, CA. [find](https://scholar.google.com/scholar?q=M%2E+Ginsberg%2E+1987a%2E+Introduction%2E+Morgan+Kaufmann%2C+Los+Altos%2C+CA%2E)
23. Matthew L. Ginsberg. 1987b. Readings in nonmonotonic reasoning. In AAAI. [find](https://scholar.google.com/scholar?q=Matthew+L%2E+Ginsberg%2E+1987b%2E+Readings+in+nonmonotonic+reasoning%2E+In+AAAI%2E)
24. Yael Greenberg. 2007. Exceptions to generics: Where vagueness, context dependence and modality interact. Journal of Semantics, 24(2):131–167. [find](https://scholar.google.com/scholar?q=Yael+Greenberg%2E+2007%2E+Exceptions+to+generics%3A+Where+vagueness%2C+context+dependence+and+modality+interact%2E+Journal+of+Semantics%2C+24%282%29%3A131%E2%80%93167%2E)
25. Steve Hanks and Drew McDermott. 1986. Default reasoning, nonmonotonic logics, and the frame problem. In AAAI. [find](https://scholar.google.com/scholar?q=Steve+Hanks+and+Drew+McDermott%2E+1986%2E+Default+reasoning%2C+nonmonotonic+logics%2C+and+the+frame+problem%2E+In+AAAI%2E)
26. Paul Haward, Laura Wagner, Susan Carey, and Sandeep Prasada. 2018. The development of principled connections and kind representations. Cognition, 176:255–268. [find](https://scholar.google.com/scholar?q=Paul+Haward%2C+Laura+Wagner%2C+Susan+Carey%2C+and+Sandeep+Prasada%2E+2018%2E+The+development+of+principled+connections+and+kind+representations%2E+Cognition%2C+176%3A255%E2%80%93268%2E)
27. John F. Horty and Richmond H. Thomason. 1988. Mixing strict and defeasible inheritance. In AAAI. [find](https://scholar.google.com/scholar?q=John+F%2E+Horty+and+Richmond+H%2E+Thomason%2E+1988%2E+Mixing+strict+and+defeasible+inheritance%2E+In+AAAI%2E)
28. Dirk Hovy, Taylor Berg-Kirkpatrick, Ashish Vaswani, and Eduard Hovy. 2013. [Learning whom to trust with mace](https://md.research.elamur.ai/free/en/papers/hovy-2013-learning-whom-trust-mace/). In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 1120–1130.
29. Jena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Jeff Da, Keisuke Sakaguchi, Antoine Bosselut, and Yejin Choi. 2021. [find](https://scholar.google.com/scholar?q=Jena+D%2E+Hwang%2C+Chandra+Bhagavatula%2C+Ronan+Le+Bras%2C+Jeff+Da%2C+Keisuke+Sakaguchi%2C+Antoine+Bosselut%2C+and+Yejin+Choi%2E+2021%2E)
30. [Comet-atomic 2020: On symbolic and neural commonsense knowledge graphs](https://md.research.elamur.ai/free/en/papers/hwang-2020-comet-atomic-2020-symbolic-neural/). In AAAI.
31. Tomasz Imielinski. 1985. Results on translating defaults to circumscription. In IJCAI. [find](https://scholar.google.com/scholar?q=Tomasz+Imielinski%2E+1985%2E+Results+on+translating+defaults+to+circumscription%2E+In+IJCAI%2E)
32. Nirit Kadmon and Fred Landman. 1993. Any. Linguistics and philosophy, 16(4):353–422. [find](https://scholar.google.com/scholar?q=Nirit+Kadmon+and+Fred+Landman%2E+1993%2E+Any%2E+Linguistics+and+philosophy%2C+16%284%29%3A353%E2%80%93422%2E)
33. Sangeet Khemlani, Sarah-Jane Leslie, and Sam Glucksberg. 2009. Generics, prevalence, and default inferences. Proceedings of the 31st annual cognitive science society, pages 443–448. [find](https://scholar.google.com/scholar?q=Sangeet+Khemlani%2C+Sarah%2DJane+Leslie%2C+and+Sam+Glucksberg%2E+2009%2E+Generics%2C+prevalence%2C+and+default+inferences%2E+Proceedings+of+the+31st+annual+cognitive+science+society%2C+pages+443%E2%80%93448%2E)
34. Manfred Krifka, Francis Jeffry Pelletier, Gregory N. Carlson, Alice Ter Meulen, Gennaro Chierchia, and Godehard Link. 1995. Genericity: an introduction. In Gregory N. Carlson and Francis Jeffry Pelletier, editors, The Generic book, pages 1–124. The University of Chicago Press. [find](https://scholar.google.com/scholar?q=Manfred+Krifka%2C+Francis+Jeffry+Pelletier%2C+Gregory+N%2E+Carlson%2C+Alice+Ter+Meulen%2C+Gennaro+Chierchia%2C+and+Godehard+Link%2E+1995%2E+Genericity%3A+an+introduction%2E+In+Gregory+N%2E+Carlson+and+Francis+Jeffry+Pellet)
35. Manfred Krifka et al. 2012. Genericity, pages 372–389. [find](https://scholar.google.com/scholar?q=Manfred+Krifka+et+al%2E+2012%2E+Genericity%2C+pages+372%E2%80%93389%2E)
36. Dimitra Lazaridou-Chatzigoga and Linnaea Stockall. 2013. Genericity, exceptions and domain restriction: experimental evidence from comparison with universals. In Proceedings of Sinn und Bedeutung, volume 17, pages 325–343. [find](https://scholar.google.com/scholar?q=Dimitra+Lazaridou%2DChatzigoga+and+Linnaea+Stockall%2E+2013%2E+Genericity%2C+exceptions+and+domain+restriction%3A+experimental+evidence+from+comparison+with+universals%2E+In+Proceedings+of+Sinn+und+Bedeutung%2C+vol)
37. Sarah-Jane Leslie. 2007. Generics and the structure of the mind. Philosophical perspectives, 21:375–403. [find](https://scholar.google.com/scholar?q=Sarah%2DJane+Leslie%2E+2007%2E+Generics+and+the+structure+of+the+mind%2E+Philosophical+perspectives%2C+21%3A375%E2%80%93403%2E)
38. Sarah-Jane Leslie. 2008. Generics: Cognition and acquisition. Philosophical Review, 117(1):1–47. [find](https://scholar.google.com/scholar?q=Sarah%2DJane+Leslie%2E+2008%2E+Generics%3A+Cognition+and+acquisition%2E+Philosophical+Review%2C+117%281%29%3A1%E2%80%9347%2E)
39. Sarah-Jane Leslie. 2017. The original sin of cognition: Fear, prejudice, and generalization. The Journal of Philosophy, 114(8):393–421. [find](https://scholar.google.com/scholar?q=Sarah%2DJane+Leslie%2E+2017%2E+The+original+sin+of+cognition%3A+Fear%2C+prejudice%2C+and+generalization%2E+The+Journal+of+Philosophy%2C+114%288%29%3A393%E2%80%93421%2E)
40. David Lewis and Edward L. Keenan. 1975. Adverbs of quantification, page 3–15. Cambridge University Press. [find](https://scholar.google.com/scholar?q=David+Lewis+and+Edward+L%2E+Keenan%2E+1975%2E+Adverbs+of+quantification%2C+page+3%E2%80%9315%2E+Cambridge+University+Press%2E)
41. Vladimir Lifschitz. 1989. Benchmark problems for non-monotonic reasoning. In Proceedings of the Second international Workshop on Non-monotonic Reasoning. [find](https://scholar.google.com/scholar?q=Vladimir+Lifschitz%2E+1989%2E+Benchmark+problems+for+non%2Dmonotonic+reasoning%2E+In+Proceedings+of+the+Second+international+Workshop+on+Non%2Dmonotonic+Reasoning%2E)
42. Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. [Roberta: A robustly optimized bert pretraining approach](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/). arXiv preprint arXiv:1907.11692.
43. Ximing Lu, Sean Welleck, Peter West, Liwei Jiang, Jungo Kasai, Daniel Khashabi, Ronan Le Bras, Lianhui Qin, Youngjae Yu, Rowan Zellers, Noah A. Smith, and Yejin Choi. 2022. [Neurologic a* esque decoding: Constrained text generation with lookahead heuristics](https://md.research.elamur.ai/free/en/papers/lu-2022-neurologic-esque-decoding-constrained-text/). In NAACL.
44. Alda Mari, Claire Beyssade, and Fabio Del Prete. 2012. Genericity, volume 43. OUP Oxford. [find](https://scholar.google.com/scholar?q=Alda+Mari%2C+Claire+Beyssade%2C+and+Fabio+Del+Prete%2E+2012%2E+Genericity%2C+volume+43%2E+OUP+Oxford%2E)
45. Ken McRae, George S. Cree, Mark S. Seidenberg, and Chris McNorgan. 2005. Semantic feature production norms for a large set of living and nonliving things. Behavior Research Methods, 37:547–559. [find](https://scholar.google.com/scholar?q=Ken+McRae%2C+George+S%2E+Cree%2C+Mark+S%2E+Seidenberg%2C+and+Chris+McNorgan%2E+2005%2E+Semantic+feature+production+norms+for+a+large+set+of+living+and+nonliving+things%2E+Behavior+Research+Methods%2C+37%3A547%E2%80%93559%2E)
46. George A Miller. 1995. [Wordnet: a lexical database for english](https://md.research.elamur.ai/free/en/papers/miller-1994-wordnet/). Communications of the ACM, 38(11):39–41.
47. Arnold Kochari, Robert Van Rooij, and Katrin Schulz. 2020. Generics and alternatives. Frontiers in Psychology, 11:1274. [find](https://scholar.google.com/scholar?q=Arnold+Kochari%2C+Robert+Van+Rooij%2C+and+Katrin+Schulz%2E+2020%2E+Generics+and+alternatives%2E+Frontiers+in+Psychology%2C+11%3A1274%2E)
48. Kanishka Misra, Allyson Ettinger, and Julia Taylor Rayz. 2021. Do language models learn typicality judgments from text? ArXiv, abs/2105.02987. — [arXiv:2105.02987](https://arxiv.org/abs/2105.02987) [find](https://scholar.google.com/scholar?q=Kanishka+Misra%2C+Allyson+Ettinger%2C+and+Julia+Taylor+Rayz%2E+2021%2E+Do+language+models+learn+typicality+judgments+from+text%3F+ArXiv%2C+abs%2F2105%2E02987%2E+%E2%80%94+%5BarXiv%3A2105%2E02987%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2105%2E02987%29)
49. Manfred Krifka. 1987. An outline of genericity. Seminar für natürlich-sprachliche Systeme der Universität Tübingen. [find](https://scholar.google.com/scholar?q=Manfred+Krifka%2E+1987%2E+An+outline+of+genericity%2E+Seminar+f%C3%BCr+nat%C3%BCrlich%2Dsprachliche+Systeme+der+Universit%C3%A4t+T%C3%BCbingen%2E)
50. Daniel N. Osherson, Edward E. Smith, Ormond Wilkie, Alejandro López, and Eldar Shafir. 1990. Category-based induction. Psychological Review, 97:185–200. [find](https://scholar.google.com/scholar?q=Daniel+N%2E+Osherson%2C+Edward+E%2E+Smith%2C+Ormond+Wilkie%2C+Alejandro+L%C3%B3pez%2C+and+Eldar+Shafir%2E+1990%2E+Category%2Dbased+induction%2E+Psychological+Review%2C+97%3A185%E2%80%93200%2E)
51. James P. Van Overschelde, Katherine A. Rawson, and John Dunlosky. 2004. Category norms: An updated and expanded version of the battig and montague (1969) norms. Journal of Memory and Language, 50:289–335. [find](https://scholar.google.com/scholar?q=James+P%2E+Van+Overschelde%2C+Katherine+A%2E+Rawson%2C+and+John+Dunlosky%2E+2004%2E+Category+norms%3A+An+updated+and+expanded+version+of+the+battig+and+montague+%281969%29+norms%2E+Journal+of+Memory+and+Language%2C+50%3A289%E2%80%93)
52. Maarten Sap, Ronan Le Bras, Emily Allaway, Chandra Bhagavatula, Nicholas Lourie, Hannah Rashkin, Brendan Roof, Noah A. Smith, and Yejin Choi. 2019. Atomic: An atlas of machine commonsense for if-then reasoning. In AAAI. [find](https://scholar.google.com/scholar?q=Maarten+Sap%2C+Ronan+Le+Bras%2C+Emily+Allaway%2C+Chandra+Bhagavatula%2C+Nicholas+Lourie%2C+Hannah+Rashkin%2C+Brendan+Roof%2C+Noah+A%2E+Smith%2C+and+Yejin+Choi%2E+2019%2E+Atomic%3A+An+atlas+of+machine+commonsense+for+if%2Dthen+)
53. Francis Jeffry Pelletier. 2009. Are all generics created equal? Kinds, Things, and Stuff: Mass Terms and Generics, pages 60–79. [find](https://scholar.google.com/scholar?q=Francis+Jeffry+Pelletier%2E+2009%2E+Are+all+generics+created+equal%3F+Kinds%2C+Things%2C+and+Stuff%3A+Mass+Terms+and+Generics%2C+pages+60%E2%80%9379%2E)
54. Robyn Speer, Joshua Chin, and Catherine Havasi. 2017. Conceptnet 5.5: An open multilingual graph of general knowledge. In Thirty-first AAAI conference on artificial intelligence. [find](https://scholar.google.com/scholar?q=Robyn+Speer%2C+Joshua+Chin%2C+and+Catherine+Havasi%2E+2017%2E+Conceptnet+5%2E5%3A+An+open+multilingual+graph+of+general+knowledge%2E+In+Thirty%2Dfirst+AAAI+conference+on+artificial+intelligence%2E)
55. Francis Jeffry Pelletier and Renée Elio. 2005. The case for psychologism in default and inheritance reasoning. Synthese, 146(1):7–35. [find](https://scholar.google.com/scholar?q=Francis+Jeffry+Pelletier+and+Ren%C3%A9e+Elio%2E+2005%2E+The+case+for+psychologism+in+default+and+inheritance+reasoning%2E+Synthese%2C+146%281%29%3A7%E2%80%9335%2E)
56. Fabio Petroni, Tim Rocktäschel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, Alexander H. Miller, and Sebastian Riedel. 2019. [Language models as knowledge bases?](https://md.research.elamur.ai/free/en/papers/petroni-2019-language-models-as-knowledge-bases/) In EMNLP.
57. David L. Poole. 1988. A logical framework for default reasoning. Artificial Intelligence, 36:27–47. [find](https://scholar.google.com/scholar?q=David+L%2E+Poole%2E+1988%2E+A+logical+framework+for+default+reasoning%2E+Artificial+Intelligence%2C+36%3A27%E2%80%9347%2E)
58. Sandeep Prasada and Elaine M Dillingham. 2006. Principled and statistical connections in common sense conception. Cognition, 99(1):73–112. [find](https://scholar.google.com/scholar?q=Sandeep+Prasada+and+Elaine+M+Dillingham%2E+2006%2E+Principled+and+statistical+connections+in+common+sense+conception%2E+Cognition%2C+99%281%29%3A73%E2%80%93112%2E)
59. Sandeep Prasada and Elaine M Dillingham. 2009. Representation of principled connections: A window onto the formal aspect of common sense conception. Cognitive Science, 33(3):401–448. [find](https://scholar.google.com/scholar?q=Sandeep+Prasada+and+Elaine+M+Dillingham%2E+2009%2E+Representation+of+principled+connections%3A+A+window+onto+the+formal+aspect+of+common+sense+conception%2E+Cognitive+Science%2C+33%283%29%3A401%E2%80%93448%2E)
60. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9. [find](https://scholar.google.com/scholar?q=Alec+Radford%2C+Jeffrey+Wu%2C+Rewon+Child%2C+David+Luan%2C+Dario+Amodei%2C+Ilya+Sutskever%2C+et+al%2E+2019%2E+Language+models+are+unsupervised+multitask+learners%2E+OpenAI+blog%2C+1%288%29%3A9%2E)
61. R. Reiter. 1978a. On reasoning by default. In Proceedings of TINLAP-2, pages 210–218, University of Illinois. Association of Computational Linguistics. [find](https://scholar.google.com/scholar?q=R%2E+Reiter%2E+1978a%2E+On+reasoning+by+default%2E+In+Proceedings+of+TINLAP%2D2%2C+pages+210%E2%80%93218%2C+University+of+Illinois%2E+Association+of+Computational+Linguistics%2E)
62. Wilson L Taylor. 1953. “cloze procedure”: A new tool for measuring readability. Journalism quarterly, 30(4):415–433. [find](https://scholar.google.com/scholar?q=Wilson+L+Taylor%2E+1953%2E+%E2%80%9Ccloze+procedure%E2%80%9D%3A+A+new+tool+for+measuring+readability%2E+Journalism+quarterly%2C+30%284%29%3A415%E2%80%93433%2E)
63. Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel R Bowman. 2019. [Glue: A multi-task benchmark and analysis platform for natural language understanding](https://md.research.elamur.ai/free/en/papers/wang-2018-glue-multi-task-benchmark-analysis/). In ICLR.
64. Adina Williams, Nikita Nangia, and Samuel R Bowman. 2018. [A broad-coverage challenge corpus for sentence understanding through inference](https://md.research.elamur.ai/free/en/papers/williams-2018-broad-coverage-challenge-corpus-sentence/). In "Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long…
65. Hitomi Yanaka, Koji Mineshima, Daisuke Bekki, Kentaro Inui, Satoshi Sekine, Lasha Abzianidze, and Johan Bos. 2019a. HELP: A Dataset for Identifying Shortcomings of Neural Models in Monotonicity Reasoning. ArXiv, abs/1904.12166. [find](https://scholar.google.com/scholar?q=Hitomi+Yanaka%2C+Koji+Mineshima%2C+Daisuke+Bekki%2C+Kentaro+Inui%2C+Satoshi+Sekine%2C+Lasha+Abzianidze%2C+and+Johan+Bos%2E+2019a%2E+HELP%3A+A+Dataset+for+Identifying+Shortcomings+of+Neural+Models+in+Monotonicity+Reason)
66. Hitomi Yanaka, Koji Mineshima, Daisuke Bekki, Kentaro Inui, Satoshi Sekine, Lasha Abzianidze, and Johan Bos. 2019b. Can Neural Networks Understand Monotonicity Reasoning? In BlackboxNLP@ACL. [find](https://scholar.google.com/scholar?q=Hitomi+Yanaka%2C+Koji+Mineshima%2C+Daisuke+Bekki%2C+Kentaro+Inui%2C+Satoshi+Sekine%2C+Lasha+Abzianidze%2C+and+Johan+Bos%2E+2019b%2E+Can+Neural+Networks+Understand+Monotonicity+Reasoning%3F+In+BlackboxNLP%40ACL%2E)
67. Raymond Reiter. 1978b. On Closed World Data Bases, pages 55–76. Springer US, Boston, MA. [find](https://scholar.google.com/scholar?q=Raymond+Reiter%2E+1978b%2E+On+Closed+World+Data+Bases%2C+pages+55%E2%80%9376%2E+Springer+US%2C+Boston%2C+MA%2E)
68. Raymond Reiter. 1980. A logic for default reasoning. Artificial Intelligence, 13:81–132. [find](https://scholar.google.com/scholar?q=Raymond+Reiter%2E+1980%2E+A+logic+for+default+reasoning%2E+Artificial+Intelligence%2C+13%3A81%E2%80%93132%2E)
69. Lance J. Rips. 1975. Inductive judgments about natural categories. Journal of Verbal Learning and Verbal Behavior, 14:665–681. [find](https://scholar.google.com/scholar?q=Lance+J%2E+Rips%2E+1975%2E+Inductive+judgments+about+natural+categories%2E+Journal+of+Verbal+Learning+and+Verbal+Behavior%2C+14%3A665%E2%80%93681%2E)
70. Anna Rohrbach, Lisa Anne Hendricks, Kaylee Burns, Trevor Darrell, and Kate Saenko. 2018. [Object hallucination in image captioning](https://md.research.elamur.ai/free/en/papers/rohrbach-2018-object-hallucination-image-captioning/). In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium. Association for Computational Linguistics.
71. Rachel Rudinger, Vered Shwartz, Jena D Hwang, Chandra Bhagavatula, Maxwell Forbes, Ronan Le Bras, Noah A Smith, and Yejin Choi. 2020. Thinking like a skeptic: Defeasible inference in natural language. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings… [find](https://scholar.google.com/scholar?q=Rachel+Rudinger%2C+Vered+Shwartz%2C+Jena+D+Hwang%2C+Chandra+Bhagavatula%2C+Maxwell+Forbes%2C+Ronan+Le+Bras%2C+Noah+A+Smith%2C+and+Yejin+Choi%2E+2020%2E+Thinking+like+a+skeptic%3A+Defeasible+inference+in+natural+language%2E)

*Updated 3 November 2026*