---
title: "常识问答研究综述 — 范怡帆 2023"
description: "This survey, written in Chinese, covers commonsense question answering (CQA)."
authors: ["范怡帆", "邹博伟", "徐庆婷", "李志峰", "洪宇"]
year: 2023
venue: "软件学报 (Journal of Software)"
source: "https://jos.org.cn/jos/article/abstract/6913"
doi: "10.13328/j.cnki.jos.006913"
licence: "Free access (jos.org.cn), no open licence stated — readonly; © 中国科学院软件研究所 / 软件学报"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/papers/fan-2023-commonsense-question-answering/"
---
[Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/fan-2023-commonsense-question-answering/)

[home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2023](https://md.research.elamur.ai/free/papers/2023/page/7/) / 常识问答研究综述

# 常识问答研究综述

**Authors:** 范怡帆, 邹博伟, 徐庆婷, 李志峰, 洪宇 · **Year:** 2023 · **Venue:** 软件学报 (Journal of Software) · **Licence:** Free access (jos.org.cn), no open licence stated — readonly; © 中国科学院软件研究所 / 软件学报

**Links:** [Publisher's page](https://doi.org/10.13328/j.cnki.jos.006913) · [PDF](https://www.jos.org.cn//jos/article/pdf/6913) · [DOI 10.13328/j.cnki.jos.006913](https://doi.org/10.13328/j.cnki.jos.006913)

## Summary
This survey, written in Chinese, covers commonsense question answering (CQA). In CQA a system must answer natural-language questions using everyday knowledge that the input text does not state. It can do this by choosing among options, judging a statement true or false, or generating an answer. The authors trace the field in two stages. The first relied on hand-built rules and features, as in early Winograd-style work. The second uses neural networks and pre-trained language models. They split modern approaches into two families: models that learn to sense commonsense from knowledge sources, and models that inject separately encoded knowledge into the answering pipeline. They also compare knowledge resources by how each was built, where its content comes from, and how it is represented. From this they propose a six-type taxonomy of the knowledge that questions require. A dedicated section looks at combining knowledge with large language models, and the authors run experiments on cross-dataset transfer. The provided excerpt omits the numeric results of those experiments. The survey is useful as a structured map of datasets, knowledge sources and fusion techniques, and it offers baselines for building generalizable CQA systems.

## Key points
- **Task scope and field size:** The task is split into discriminative CQA (multiple choice, true/false) and generative CQA. The authors count 12 established datasets drawn from 9 domains, and they identify 4 research sub-directions:
  - building knowledge sources,
  - acquiring knowledge,
  - fusion-based reasoning,
  - explainable generation.
- **Datasets examined in detail (9):** CommonsenseQA, OpenbookQA, ARC, Social IQA, Cosmos QA, MCScript, MCScript2.0, ReCoRD and ProtoQA. Earlier benchmarks also discussed are COPA (2011), WSC (2012), SCT and SWAG.
- **Knowledge taxonomy:** The proposed scheme has six categories: attribute, semantic, causal, context, abstract and intention.
- **Representative systems reviewed:**
  - Feature-based and rule-based WSC solvers using FrameNet and WordNet;
  - Self-talk (GPT/GPT-2);
  - ERNIE 3.0;
  - knowledge-driven pre-training on Atomic, ConceptNet, WordNet, Visual Genome and Wikidata;
  - KagNet (ConceptNet paths of up to 4 hops);
  - heterogeneous ConceptNet+Wikipedia graph reasoning;
  - Headhunter (attention-based filtering of OMCS knowledge).
- **Open challenges and citation:** The authors highlight three remaining problems: retrieving implicit knowledge, aligning structured knowledge with text, and the fact that even very large models (GPT3, T5) still fall short of practical reliability. For citation, the paper appeared in Journal of Software, vol. 35(1), 2024; it was first published online in August 2023.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/) · [Natural language processing](https://md.research.elamur.ai/free/shelves/nlp/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@article{2023,
  title = {{常识问答研究综述}},
  author = {范怡帆 and 邹博伟 and 徐庆婷 and 李志峰 and 洪宇},
  journal = {软件学报 (Journal of Software)},
  year = {2023},
  doi = {10.13328/j.cnki.jos.006913},
  url = {https://doi.org/10.13328/j.cnki.jos.006913}
}
```

- [← previous 对话式论辩研究综述](https://md.research.elamur.ai/free/papers/wei-2023-dialogical-argumentation/)
- [next → 汉语增强依存句法自动转换研究](https://md.research.elamur.ai/free/papers/yu-2023-automatic-transformation-enhanced/)
- [↑ back to papers of 2023](https://md.research.elamur.ai/free/papers/2023/page/7/)

## References

90 references, 16 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Pujara J, Miao H, Getoor L, Cohen W. Knowledge graph identification. In: Proc. of the 12th Int’l Semantic Web Conf. Sydney: Springer, 2013. 542–557. [doi: 10.1007/978-3-642-41335-3_34] — [doi:10.1007/978-3-642-41335-3_34](https://doi.org/10.1007/978-3-642-41335-3_34) [find](https://scholar.google.com/scholar?q=Pujara+J%2C+Miao+H%2C+Getoor+L%2C+Cohen+W%2E+Knowledge+graph+identification%2E+In%3A+Proc%2E+of+the+12th+Int%E2%80%99l+Semantic+Web+Conf%2E+Sydney%3A+Springer%2C+2013%2E+542%E2%80%93557%2E+%5Bdoi%3A+10%2E1007%2F978%2D3%2D642%2D41335%2D3%5F34%5D+%E2%80%94+%5Bdoi%3A10%2E1007%2F)
2. Wang X, Zou L, Wang CK, Peng P, Feng ZY. Research on knowledge graph data management: A survey. Ruan Jian Xue Bao/Journal of Software, 2019, 30(7): 2139–2174 (in Chinese with English abstract). [http://www.jos.org.cn/1000-9825/5841.htm](http://www.jos.org.cn/1000-9825/5841.htm) [doi: 10.13328/j.cnki. jos.005841] — [doi:10.13328/j.cnki](https://doi.org/10.13328/j.cnki) [↗](http://www.jos.org.cn/1000-9825/5841.htm)
3. Holland PW. Statistics and causal inference. Journal of the American statistical Association, 1986, 81(396): 945 –960. [doi: 10.1080/01621459.1986.10478354] — [doi:10.1080/01621459.1986.10478354](https://doi.org/10.1080/01621459.1986.10478354) [find](https://scholar.google.com/scholar?q=Holland+PW%2E+Statistics+and+causal+inference%2E+Journal+of+the+American+statistical+Association%2C+1986%2C+81%28396%29%3A+945+%E2%80%93960%2E+%5Bdoi%3A+10%2E1080%2F01621459%2E1986%2E10478354%5D+%E2%80%94+%5Bdoi%3A10%2E1080%2F01621459%2E1986%2E10478354%5D%28http)
4. Settles B, Craven M. An analysis of active learning strategies for sequence labeling tasks. In: Proc. of the 2008 Conf. on Empirical Methods in Natural Language Processing. Honolulu: Association for Computational Linguistics, 2008. 1070–1079. [find](https://scholar.google.com/scholar?q=Settles+B%2C+Craven+M%2E+An+analysis+of+active+learning+strategies+for+sequence+labeling+tasks%2E+In%3A+Proc%2E+of+the+2008+Conf%2E+on+Empirical+Methods+in+Natural+Language+Processing%2E+Honolulu%3A+Association+for+C)
5. Liu H, Singh P. ConceptNet—A practical commonsense reasoning tool-kit. BT Technology Journal, 2004, 22(4): 211–226. [doi: 10.1023/B:BTTJ.0000047600.45421.6d] — [doi:10.1023/b:bttj.0000047600.45421.6d](https://doi.org/10.1023/b:bttj.0000047600.45421.6d) [find](https://scholar.google.com/scholar?q=Liu+H%2C+Singh+P%2E+ConceptNet%E2%80%94A+practical+commonsense+reasoning+tool%2Dkit%2E+BT+Technology+Journal%2C+2004%2C+22%284%29%3A+211%E2%80%93226%2E+%5Bdoi%3A+10%2E1023%2FB%3ABTTJ%2E0000047600%2E45421%2E6d%5D+%E2%80%94+%5Bdoi%3A10%2E1023%2Fb%3Abttj%2E0000047600%2E45421%2E6d%5D)
6. Zaremba W, Sutskever I, Vinyals O. Recurrent neural network regularization. arXiv:1409.2329, 2015. [find](https://scholar.google.com/scholar?q=Zaremba+W%2C+Sutskever+I%2C+Vinyals+O%2E+Recurrent+neural+network+regularization%2E+arXiv%3A1409%2E2329%2C+2015%2E) [our card](https://md.research.elamur.ai/free/papers/zaremba-2014-recurrent-neural-network-regularization/)
7. Hochreiter S, Schmidhuber J. Long short-term memory. Neural Computation, 1997, 9(8): 1735–1780. [doi: 10.1162/neco.1997.9.8.1735] [find](https://scholar.google.com/scholar?q=Hochreiter+S%2C+Schmidhuber+J%2E+Long+short%2Dterm+memory%2E+Neural+Computation%2C+1997%2C+9%288%29%3A+1735%E2%80%931780%2E+%5Bdoi%3A+10%2E1162%2Fneco%2E1997%2E9%2E8%2E1735%5D)
8. Bahdanau D, Cho K, Bengio Y. Neural machine translation by jointly learning to align and translate. In: Proc. of the 3rd Int’l Conf. on Learning Representations. San Diego, 2015. 1–15. [find](https://scholar.google.com/scholar?q=Bahdanau+D%2C+Cho+K%2C+Bengio+Y%2E+Neural+machine+translation+by+jointly+learning+to+align+and+translate%2E+In%3A+Proc%2E+of+the+3rd+Int%E2%80%99l+Conf%2E+on+Learning+Representations%2E+San+Diego%2C+2015%2E+1%E2%80%9315%2E) [our card](https://md.research.elamur.ai/free/papers/bahdanau-2014-neural-machine-translation-jointly-learning/)
9. Devlin J, Chang M W, Lee K, Toutanova K. BERT: Pre-training of deep bidirectional transformers for language understanding. In: Proc. of the 2019 Conf. of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol. 1 (Long and Short Papers). Minneapo… [find](https://scholar.google.com/scholar?q=Devlin+J%2C+Chang+M+W%2C+Lee+K%2C+Toutanova+K%2E+BERT%3A+Pre%2Dtraining+of+deep+bidirectional+transformers+for+language+understanding%2E+In%3A+Proc%2E+of+the+2019+Conf%2E+of+the+North+American+Chapter+of+the+Association+)
10. Liu Z, Lin W, Shi Y, Zhao J. A robustly optimized BERT pre-training approach with post-training. In: Proc. of the 20th Chinese National Conf. on Computational Linguistics. Huhhot: Chinese Information Processing Society of China, 2021. 1218–1227. [find](https://scholar.google.com/scholar?q=Liu+Z%2C+Lin+W%2C+Shi+Y%2C+Zhao+J%2E+A+robustly+optimized+BERT+pre%2Dtraining+approach+with+post%2Dtraining%2E+In%3A+Proc%2E+of+the+20th+Chinese+National+Conf%2E+on+Computational+Linguistics%2E+Huhhot%3A+Chinese+Information+) [our card](https://md.research.elamur.ai/free/papers/zhuang-2021-robustly-optimized-bert-pre-training/)
11. Lewis M, Liu YH, Goyal N, Ghazvininejad M, Mohamed A, Levy O, Stoyanov V, Zettlemoyer L. BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In: Proc. of the 58th Annual Meeting of the Association for Computational Linguistics. Associati… [find](https://scholar.google.com/scholar?q=Lewis+M%2C+Liu+YH%2C+Goyal+N%2C+Ghazvininejad+M%2C+Mohamed+A%2C+Levy+O%2C+Stoyanov+V%2C+Zettlemoyer+L%2E+BART%3A+Denoising+sequence%2Dto%2Dsequence+pre%2Dtraining+for+natural+language+generation%2C+translation%2C+and+comprehensi) [our card](https://md.research.elamur.ai/free/papers/lewis-2020-bart-denoising-sequence-sequence-pre/)
12. Brown TB, Mann B, Ryder N, Subbiah M, Kaplan J, Dhariwal P, Neelakantan A, Shyam P, Sastry G, Askell A, Agarwal S, Herbert-Voss A, Krueger G, Henighan T, Child R, Ramesh A, Ziegler DM, Wu J, Winter C, Hesse C, Chen M, Sigler E, Litwin M, Gray S, Chess B, Clark J, Berner C, McCandlish S, Radford A, S… [find](https://scholar.google.com/scholar?q=Brown+TB%2C+Mann+B%2C+Ryder+N%2C+Subbiah+M%2C+Kaplan+J%2C+Dhariwal+P%2C+Neelakantan+A%2C+Shyam+P%2C+Sastry+G%2C+Askell+A%2C+Agarwal+S%2C+Herbert%2DVoss+A%2C+Krueger+G%2C+Henighan+T%2C+Child+R%2C+Ramesh+A%2C+Ziegler+DM%2C+Wu+J%2C+Winter+C%2C)
13. Raffel C, Shazeer N, Roberts A, Lee K, Narang S, Matena M, Zhou YQ, Li W, Liu PJ. Exploring the limits of transfer learning with a unified text-to-text transformer. The Journal of Machine Learning Research, 2020, 21(1): 5485–5551. [find](https://scholar.google.com/scholar?q=Raffel+C%2C+Shazeer+N%2C+Roberts+A%2C+Lee+K%2C+Narang+S%2C+Matena+M%2C+Zhou+YQ%2C+Li+W%2C+Liu+PJ%2E+Exploring+the+limits+of+transfer+learning+with+a+unified+text%2Dto%2Dtext+transformer%2E+The+Journal+of+Machine+Learning+Res)
14. Yang Y, Kang S. Common sense-based reasoning using external knowledge for question answering. IEEE Access, 2020, 8: 227185–227192. [doi: 10.1109/ACCESS.2020.3045762] — [doi:10.1109/access.2020.3045762](https://doi.org/10.1109/access.2020.3045762) [find](https://scholar.google.com/scholar?q=Yang+Y%2C+Kang+S%2E+Common+sense%2Dbased+reasoning+using+external+knowledge+for+question+answering%2E+IEEE+Access%2C+2020%2C+8%3A+227185%E2%80%93227192%2E+%5Bdoi%3A+10%2E1109%2FACCESS%2E2020%2E3045762%5D+%E2%80%94+%5Bdoi%3A10%2E1109%2Faccess%2E2020%2E3045762)
15. Lim J, Oh D, Jang Y, Yang K, Lim H. I know what you asked: Graph path learning using AMR for commonsense reasoning. In: Proc. of the 28th Int’l Conf. on Computational Linguistics. Barcelona: International Committee on Computational Linguistics, 2020. 2459–2471. [doi: 10.18653/v1/2020.coling-main.222… [find](https://scholar.google.com/scholar?q=Lim+J%2C+Oh+D%2C+Jang+Y%2C+Yang+K%2C+Lim+H%2E+I+know+what+you+asked%3A+Graph+path+learning+using+AMR+for+commonsense+reasoning%2E+In%3A+Proc%2E+of+the+28th+Int%E2%80%99l+Conf%2E+on+Computational+Linguistics%2E+Barcelona%3A+Internati)
16. Ma KX, Francis J, Lu QY, Nyberg E, Oltramari A. Towards generalizable neuro-symbolic systems for commonsense question answering. In: Proc. of the 1st Workshop on Commonsense Inference in Natural Language Processing. Hong Kong: Association for Computational Linguistics, 2019. 22–32. [doi: 10.18653/v1… [find](https://scholar.google.com/scholar?q=Ma+KX%2C+Francis+J%2C+Lu+QY%2C+Nyberg+E%2C+Oltramari+A%2E+Towards+generalizable+neuro%2Dsymbolic+systems+for+commonsense+question+answering%2E+In%3A+Proc%2E+of+the+1st+Workshop+on+Commonsense+Inference+in+Natural+Langu)
17. Li ZF, Zou BW, Li YQ, Jin ZL, Hong Y. Cascading commonsense question answering method base on multi-source knowledge fusion. Journal of Shanxi University (Natural Science Edition), 2022, 45(2): 264–273 (in Chinese with English abstract). [doi: 10.13451/j.sxu. ns.2021099] — [doi:10.13451/j.sxu](https://doi.org/10.13451/j.sxu) [find](https://scholar.google.com/scholar?q=Li+ZF%2C+Zou+BW%2C+Li+YQ%2C+Jin+ZL%2C+Hong+Y%2E+Cascading+commonsense+question+answering+method+base+on+multi%2Dsource+knowledge+fusion%2E+Journal+of+Shanxi+University+%28Natural+Science+Edition%29%2C+2022%2C+45%282%29%3A+264%E2%80%9327)
18. Wang RZ, Tang DY, Duan N, Wei ZY, Huang XJ, Ji JS, Cao GH, Jiang DX, Zhou M. K-adapter: Infusing knowledge into pre-trained models with adapters. In: Proc. of the 2021 Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021. Association for Computational Linguistics, 2021. 1405–14… [find](https://scholar.google.com/scholar?q=Wang+RZ%2C+Tang+DY%2C+Duan+N%2C+Wei+ZY%2C+Huang+XJ%2C+Ji+JS%2C+Cao+GH%2C+Jiang+DX%2C+Zhou+M%2E+K%2Dadapter%3A+Infusing+knowledge+into+pre%2Dtrained+models+with+adapters%2E+In%3A+Proc%2E+of+the+2021+Findings+of+the+Association+for+) [our card](https://md.research.elamur.ai/free/papers/wang-2020-k-adapter-infusing-knowledge-pre/)
19. Wang PF, Peng NY, Ilievski F, Szekely P, Ren X. Connecting the dots: A knowledgeable path generator for commonsense question answering. In: Findings of the Association for Computational Linguistics: EMNLP 2020. Association for Computational Linguistics, 2020. 4129–4140. [doi: 10.18653/v1/2020.findin… [find](https://scholar.google.com/scholar?q=Wang+PF%2C+Peng+NY%2C+Ilievski+F%2C+Szekely+P%2C+Ren+X%2E+Connecting+the+dots%3A+A+knowledgeable+path+generator+for+commonsense+question+answering%2E+In%3A+Findings+of+the+Association+for+Computational+Linguistics%3A+E)
20. Talmor A, Herzig J, Lourie N, Berant J. CommonsenseQA: A question answering challenge targeting commonsense knowledge. In: Proc. of the 2019 Conf. of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol. 1 (Long and Short Papers). Minneapolis:… [find](https://scholar.google.com/scholar?q=Talmor+A%2C+Herzig+J%2C+Lourie+N%2C+Berant+J%2E+CommonsenseQA%3A+A+question+answering+challenge+targeting+commonsense+knowledge%2E+In%3A+Proc%2E+of+the+2019+Conf%2E+of+the+North+American+Chapter+of+the+Association+for+)
21. Mihaylov T, Clark P, Khot T, Sabharwal A. Can a suit of armor conduct electricity? A new dataset for open book question answering. In: Proc. of the 2018 Conf. on Empirical Methods in Natural Language Processing. Brussels: Association for Computational Linguistics, 2018. 2381–2391. [doi: 10.18653/v1/… [find](https://scholar.google.com/scholar?q=Mihaylov+T%2C+Clark+P%2C+Khot+T%2C+Sabharwal+A%2E+Can+a+suit+of+armor+conduct+electricity%3F+A+new+dataset+for+open+book+question+answering%2E+In%3A+Proc%2E+of+the+2018+Conf%2E+on+Empirical+Methods+in+Natural+Language+)
22. Clark P, Cowhey I, Etzioni O, Khot T, Sabharwal A, Schoenick C, Tafjord O. Think you have solved question answering? Try ARC, the AI2 reasoning challenge. arXiv:180305457, 2018. [find](https://scholar.google.com/scholar?q=Clark+P%2C+Cowhey+I%2C+Etzioni+O%2C+Khot+T%2C+Sabharwal+A%2C+Schoenick+C%2C+Tafjord+O%2E+Think+you+have+solved+question+answering%3F+Try+ARC%2C+the+AI2+reasoning+challenge%2E+arXiv%3A180305457%2C+2018%2E)
23. Sap M, Rashkin H, Chen D, Le Bras R, Choi Y. Social IQa: Commonsense reasoning about social interactions. In: Proc. of the 2019 Conf. on Empirical Methods in Natural Language Processing and the 9th Int’l Joint Conf. on Natural Language Processing. Hong Kong: Association for Computational Linguistics… [find](https://scholar.google.com/scholar?q=Sap+M%2C+Rashkin+H%2C+Chen+D%2C+Le+Bras+R%2C+Choi+Y%2E+Social+IQa%3A+Commonsense+reasoning+about+social+interactions%2E+In%3A+Proc%2E+of+the+2019+Conf%2E+on+Empirical+Methods+in+Natural+Language+Processing+and+the+9th+In)
24. Huang LF, Le Bras R, Bhagavatula C, Choi Y. Cosmos QA: Machine reading comprehension with contextual commonsense reasoning. In: Proc. of the 2019 Conf. on Empirical Methods in Natural Language Processing and the 9th Int ’l Joint Conf. on Natural Language Processing. Hong Kong: Association for Comput… [find](https://scholar.google.com/scholar?q=Huang+LF%2C+Le+Bras+R%2C+Bhagavatula+C%2C+Choi+Y%2E+Cosmos+QA%3A+Machine+reading+comprehension+with+contextual+commonsense+reasoning%2E+In%3A+Proc%2E+of+the+2019+Conf%2E+on+Empirical+Methods+in+Natural+Language+Process) [our card](https://md.research.elamur.ai/free/papers/huang-2019-cosmos-qa-machine-reading-comprehension/)
25. Ostermann S, Modi A, Roth M, Thater S, Pinkal M. MCScript: A novel dataset for assessing machine comprehension using script knowledge. In: Proc. of the 11th Int ’l Conf. on Language Resources and Evaluation. Miyazaki: European Language Resources Association (ELRA), 2018. 3567–3574. [find](https://scholar.google.com/scholar?q=Ostermann+S%2C+Modi+A%2C+Roth+M%2C+Thater+S%2C+Pinkal+M%2E+MCScript%3A+A+novel+dataset+for+assessing+machine+comprehension+using+script+knowledge%2E+In%3A+Proc%2E+of+the+11th+Int+%E2%80%99l+Conf%2E+on+Language+Resources+and+Eval)
26. Ostermann S, Roth M, Pinkal M. MCScript2.0: A machine comprehension corpus focused on script events and participants. In: Proc. of the 8th Joint Conf. on Lexical and Computational Semantics. Minneapolis: Association for Computational Linguistics, 2019. 103–117. [doi: 10.18653/v1/S19-1012] [find](https://scholar.google.com/scholar?q=Ostermann+S%2C+Roth+M%2C+Pinkal+M%2E+MCScript2%2E0%3A+A+machine+comprehension+corpus+focused+on+script+events+and+participants%2E+In%3A+Proc%2E+of+the+8th+Joint+Conf%2E+on+Lexical+and+Computational+Semantics%2E+Minneapol)
27. Zhang S, Liu XD, Liu JJ, Gao JF, Duh K, van Durme B. ReCoRD: Bridging the gap between human and machine commonsense reading comprehension. arXiv:181012885, 2018. [find](https://scholar.google.com/scholar?q=Zhang+S%2C+Liu+XD%2C+Liu+JJ%2C+Gao+JF%2C+Duh+K%2C+van+Durme+B%2E+ReCoRD%3A+Bridging+the+gap+between+human+and+machine+commonsense+reading+comprehension%2E+arXiv%3A181012885%2C+2018%2E) [our card](https://md.research.elamur.ai/free/papers/zhang-2018-record-bridging-gap-between-human/)
28. Boratko M, Li X, O ’Gorman T, Das R, Le D, McCallum A. ProtoQA: A question answering dataset for prototypical common-sense reasoning. In: Proc. of the 2020 Conf. on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2020. 1122–1136. [doi: 10.18653/v1/2020.em… [find](https://scholar.google.com/scholar?q=Boratko+M%2C+Li+X%2C+O+%E2%80%99Gorman+T%2C+Das+R%2C+Le+D%2C+McCallum+A%2E+ProtoQA%3A+A+question+answering+dataset+for+prototypical+common%2Dsense+reasoning%2E+In%3A+Proc%2E+of+the+2020+Conf%2E+on+Empirical+Methods+in+Natural+Langua)
29. Rahman A, Ng V. Resolving complex cases of definite pronouns: The Winograd schema challenge. In: Proc. of the 2012 Joint Conf. on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. Jeju Island: Association for Computational Linguistics, 2012. 777–789. [find](https://scholar.google.com/scholar?q=Rahman+A%2C+Ng+V%2E+Resolving+complex+cases+of+definite+pronouns%3A+The+Winograd+schema+challenge%2E+In%3A+Proc%2E+of+the+2012+Joint+Conf%2E+on+Empirical+Methods+in+Natural+Language+Processing+and+Computational+Nat) [our card](https://md.research.elamur.ai/free/papers/rahman-2012-resolving-complex-cases-definite-pronouns/)
30. Emami A, De La Cruz N, Trischler A, Suleman K, Cheung JCK. A knowledge hunting framework for common sense reasoning. In: Proc. of the 2018 Conf. on Empirical Methods in Natural Language Processing. Brussels: Association for Computational Linguistics, 2018. 1949–1958. [doi: 10.18653/v1/D18-1220] [find](https://scholar.google.com/scholar?q=Emami+A%2C+De+La+Cruz+N%2C+Trischler+A%2C+Suleman+K%2C+Cheung+JCK%2E+A+knowledge+hunting+framework+for+common+sense+reasoning%2E+In%3A+Proc%2E+of+the+2018+Conf%2E+on+Empirical+Methods+in+Natural+Language+Processing%2E+Br)
31. Cai Z, Tu LF, Gimpel K. Pay attention to the ending: Strong neural baselines for the ROC story cloze task. In: Proc. of the 55th Annual Meeting of the Association for Computational Linguistics (Vol. 2: Short Papers). Vancouver: Association for Computational Linguistics, 2017. 616–622. [doi: 10.18653… [find](https://scholar.google.com/scholar?q=Cai+Z%2C+Tu+LF%2C+Gimpel+K%2E+Pay+attention+to+the+ending%3A+Strong+neural+baselines+for+the+ROC+story+cloze+task%2E+In%3A+Proc%2E+of+the+55th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Vol%2E+2)
32. Shwartz V, West P, Le Bras R, Bhagavatula C, Choi Y. Unsupervised commonsense question answering with self-talk. In: Proc. of the 2020 Conf. on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2020. 4615–4629. [doi: 10.18653/v1/2020.emnlp-main.373] [find](https://scholar.google.com/scholar?q=Shwartz+V%2C+West+P%2C+Le+Bras+R%2C+Bhagavatula+C%2C+Choi+Y%2E+Unsupervised+commonsense+question+answering+with+self%2Dtalk%2E+In%3A+Proc%2E+of+the+2020+Conf%2E+on+Empirical+Methods+in+Natural+Language+Processing%2E+Associ)
33. Sun Y, Wang SH, Feng SK, Ding SY, Pang C, Shang JY, Liu JX, Chen XY, Zhao YB, Lu YX, Liu WX, Wu ZH, Gong WB, Liang JZ, Shang ZZ, Sun P, Liu W, Ouyang X, Yu DH, Tian H, Wu H, Wang HF. ERNIE 3.0: Large-scale knowledge enhanced pre-training for language understanding and generation. arXiv:2107.02137, 2… [find](https://scholar.google.com/scholar?q=Sun+Y%2C+Wang+SH%2C+Feng+SK%2C+Ding+SY%2C+Pang+C%2C+Shang+JY%2C+Liu+JX%2C+Chen+XY%2C+Zhao+YB%2C+Lu+YX%2C+Liu+WX%2C+Wu+ZH%2C+Gong+WB%2C+Liang+JZ%2C+Shang+ZZ%2C+Sun+P%2C+Liu+W%2C+Ouyang+X%2C+Yu+DH%2C+Tian+H%2C+Wu+H%2C+Wang+HF%2E+ERNIE+3%2E0%3A+Large%2D) [our card](https://md.research.elamur.ai/free/papers/sun-2021-ernie-3-0-large/)
34. Ma KX, Ilievski F, Francis J, Bisk Y, Nyberg E, Oltramari A. Knowledge-driven data construction for zero-shot evaluation in commonsense question answering. Proc. of the AAAI Conf. on Artificial Intelligence, 2021, 35(15): 13507–13515. [doi: 10.1609/aaai. v35i15.17593] — [doi:10.1609/aaai](https://doi.org/10.1609/aaai) [find](https://scholar.google.com/scholar?q=Ma+KX%2C+Ilievski+F%2C+Francis+J%2C+Bisk+Y%2C+Nyberg+E%2C+Oltramari+A%2E+Knowledge%2Ddriven+data+construction+for+zero%2Dshot+evaluation+in+commonsense+question+answering%2E+Proc%2E+of+the+AAAI+Conf%2E+on+Artificial+Intell)
35. Lin BY, Chen XY, Chen JM, Ren X. KagNet: Knowledge-aware graph networks for commonsense reasoning. In: Proc. of the 2019 Conf. on Empirical Methods in Natural Language Processing and the 9th Int ’l Joint Conf. on Natural Language Processing. Hong Kong: Association for Computational Linguistics, 2019… [find](https://scholar.google.com/scholar?q=Lin+BY%2C+Chen+XY%2C+Chen+JM%2C+Ren+X%2E+KagNet%3A+Knowledge%2Daware+graph+networks+for+commonsense+reasoning%2E+In%3A+Proc%2E+of+the+2019+Conf%2E+on+Empirical+Methods+in+Natural+Language+Processing+and+the+9th+Int+%E2%80%99l+Jo)
36. Lv SW, Guo DY, Xu JJ, Tang DY, Duan N, Gong M, Shou LJ, Jiang DX, Cao GH, Hu SL. Graph-based reasoning over heterogeneous external knowledge for commonsense question answering. Proc. of the AAAI Conf. on Artificial Intelligence, 2020, 34(5): 8449–8456. [doi: 10.1609/aaai.v34i05.6364] — [doi:10.1609/aaai.v34i05.6364](https://doi.org/10.1609/aaai.v34i05.6364) [find](https://scholar.google.com/scholar?q=Lv+SW%2C+Guo+DY%2C+Xu+JJ%2C+Tang+DY%2C+Duan+N%2C+Gong+M%2C+Shou+LJ%2C+Jiang+DX%2C+Cao+GH%2C+Hu+SL%2E+Graph%2Dbased+reasoning+over+heterogeneous+external+knowledge+for+commonsense+question+answering%2E+Proc%2E+of+the+AAAI+Conf%2E)
37. Li YQ, Zou BW, Li ZF, Aw AT, Hong Y, Zhu QM. Winnowing knowledge for multi-choice question answering. In: Proc. of the 2021 Findings of the Association for Computational Linguistics. Punta Cana: Association for Computational Linguistics, 2021. 1157 –1165. [doi: 10.18653/v1/2021.findings-emnlp.100] [find](https://scholar.google.com/scholar?q=Li+YQ%2C+Zou+BW%2C+Li+ZF%2C+Aw+AT%2C+Hong+Y%2C+Zhu+QM%2E+Winnowing+knowledge+for+multi%2Dchoice+question+answering%2E+In%3A+Proc%2E+of+the+2021+Findings+of+the+Association+for+Computational+Linguistics%2E+Punta+Cana%3A+Assoc)
38. Roemmele M, Bejan CA, Gordon AS. Choice of plausible alternatives: An evaluation of commonsense causal reasoning. In: Proc. of the 2011 AAAI Spring Symp. Stanford: AAAI, 2011. 90–95. [find](https://scholar.google.com/scholar?q=Roemmele+M%2C+Bejan+CA%2C+Gordon+AS%2E+Choice+of+plausible+alternatives%3A+An+evaluation+of+commonsense+causal+reasoning%2E+In%3A+Proc%2E+of+the+2011+AAAI+Spring+Symp%2E+Stanford%3A+AAAI%2C+2011%2E+90%E2%80%9395%2E)
39. Levesque HJ, Davis E, Morgenstern L. The winograd schema challenge. In: Proc. of the 13th Int’l Conf. on the Principles of Knowledge Representation and Reasoning. Rome: Institute of Electrical and Electronics Engineers, 2012. 552–561. [find](https://scholar.google.com/scholar?q=Levesque+HJ%2C+Davis+E%2C+Morgenstern+L%2E+The+winograd+schema+challenge%2E+In%3A+Proc%2E+of+the+13th+Int%E2%80%99l+Conf%2E+on+the+Principles+of+Knowledge+Representation+and+Reasoning%2E+Rome%3A+Institute+of+Electrical+and+Ele)
40. Sharma A, Vo NH, Aditya S. Baral C. Towards addressing the winograd schema challenge: Building and using a semantic parser and a knowledge hunting module. In: Proc. of the 24th Int’l Joint Conf. on Artificial Intelligence. Buenos Aires: AAAI, 2015. 1319–1325. [find](https://scholar.google.com/scholar?q=Sharma+A%2C+Vo+NH%2C+Aditya+S%2E+Baral+C%2E+Towards+addressing+the+winograd+schema+challenge%3A+Building+and+using+a+semantic+parser+and+a+knowledge+hunting+module%2E+In%3A+Proc%2E+of+the+24th+Int%E2%80%99l+Joint+Conf%2E+on+Ar)
41. Mostafazadeh N, Chambers N, He XD, Parikh D, Batra D, Vanderwende L, Kohli P, Allen J. A corpus and cloze evaluation for deeper understanding of commonsense stories. In: Proc. of the 2016 Conf. of the North American Chapter of the Association for Computational Linguistics: Human Language Technologie… [find](https://scholar.google.com/scholar?q=Mostafazadeh+N%2C+Chambers+N%2C+He+XD%2C+Parikh+D%2C+Batra+D%2C+Vanderwende+L%2C+Kohli+P%2C+Allen+J%2E+A+corpus+and+cloze+evaluation+for+deeper+understanding+of+commonsense+stories%2E+In%3A+Proc%2E+of+the+2016+Conf%2E+of+the)
42. Zellers R, Bisk Y, Schwartz R, Choi Y. SWAG: A large-scale adversarial dataset for grounded commonsense inference. In: Proc. of the 2018 Conf. on Empirical Methods in Natural Language Processing. Brussels: Association for Computational Linguistics, 2018. 93–104. [doi: 10.18653/v1/D18-1009] [find](https://scholar.google.com/scholar?q=Zellers+R%2C+Bisk+Y%2C+Schwartz+R%2C+Choi+Y%2E+SWAG%3A+A+large%2Dscale+adversarial+dataset+for+grounded+commonsense+inference%2E+In%3A+Proc%2E+of+the+2018+Conf%2E+on+Empirical+Methods+in+Natural+Language+Processing%2E+Brus)
43. Han K, Xiao A, Wu EH, Guo JY, Xu CJ, Wang YH. Transformer in Transformer. In: Proc. of the 35th Conf. on Neural Information Processing Systems. Sydney, 2021. 15908–15919. [find](https://scholar.google.com/scholar?q=Han+K%2C+Xiao+A%2C+Wu+EH%2C+Guo+JY%2C+Xu+CJ%2C+Wang+YH%2E+Transformer+in+Transformer%2E+In%3A+Proc%2E+of+the+35th+Conf%2E+on+Neural+Information+Processing+Systems%2E+Sydney%2C+2021%2E+15908%E2%80%9315919%2E)
44. Improving language understanding by generative pre-training. 2018. [https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf](https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf) [↗](https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf)
45. Yang ZL, Dai ZH, Yang YM, Carbonell J, Salakhutdinov R, Le QV. XLNet: Generalized autoregressive pretraining for language understanding. In: Proc. of the 33rd Int’l Conf. on Neural Information Processing Systems. Vancouver, 2019. 5753–5763. [find](https://scholar.google.com/scholar?q=Yang+ZL%2C+Dai+ZH%2C+Yang+YM%2C+Carbonell+J%2C+Salakhutdinov+R%2C+Le+QV%2E+XLNet%3A+Generalized+autoregressive+pretraining+for+language+understanding%2E+In%3A+Proc%2E+of+the+33rd+Int%E2%80%99l+Conf%2E+on+Neural+Information+Process) [our card](https://md.research.elamur.ai/free/papers/yang-2019-xlnet-generalized-autoregressive-pretraining-language/)
46. Sap M, Le Bras R, Allaway, E, Bhagavatula C, Lourie N, Rashkin H, Roof B, Smith NA, Choi Y. Atomic: An atlas of machine commonsense for if-then reasoning. Proc. of the AAAI Conf. on Artificial Intelligence, 2019, 33(1): 3027 –3035. [doi: 10.1609/aaai. v33i01.33013027] [find](https://scholar.google.com/scholar?q=Sap+M%2C+Le+Bras+R%2C+Allaway%2C+E%2C+Bhagavatula+C%2C+Lourie+N%2C+Rashkin+H%2C+Roof+B%2C+Smith+NA%2C+Choi+Y%2E+Atomic%3A+An+atlas+of+machine+commonsense+for+if%2Dthen+reasoning%2E+Proc%2E+of+the+AAAI+Conf%2E+on+Artificial+Intelli)
47. Fellbaum C. WordNet: An Electronic Lexical Database. Cambridge: MIT Press, 1998. 21–120. [find](https://scholar.google.com/scholar?q=Fellbaum+C%2E+WordNet%3A+An+Electronic+Lexical+Database%2E+Cambridge%3A+MIT+Press%2C+1998%2E+21%E2%80%93120%2E)
48. Krishna R, Zhu YK, Groth O, Johnson J, Hata K, Kravitz J, Chen S, Kalantidis Y, Li LJ, Shamma DA, Bernstein MS, Fei-Fei L. Visual genome: Connecting language and vision using crowdsourced dense image annotations. Int’l Journal of Computer Vision, 2017, 123(1): 32–73. [doi: 10.1007/s11263-016-0981-7] [find](https://scholar.google.com/scholar?q=Krishna+R%2C+Zhu+YK%2C+Groth+O%2C+Johnson+J%2C+Hata+K%2C+Kravitz+J%2C+Chen+S%2C+Kalantidis+Y%2C+Li+LJ%2C+Shamma+DA%2C+Bernstein+MS%2C+Fei%2DFei+L%2E+Visual+genome%3A+Connecting+language+and+vision+using+crowdsourced+dense+image+) [our card](https://md.research.elamur.ai/free/papers/krishna-2016-visual-genome-connecting-language-vision/)
49. Vrandečić D, Krötzsch M. Wikidata: A free collaborative knowledge base. Communications of the ACM, 2014, 57(10): 78–85. [doi: 10.1145/2629489] — [doi:10.1145/2629489](https://doi.org/10.1145/2629489) [find](https://scholar.google.com/scholar?q=Vrande%C4%8Di%C4%87+D%2C+Kr%C3%B6tzsch+M%2E+Wikidata%3A+A+free+collaborative+knowledge+base%2E+Communications+of+the+ACM%2C+2014%2C+57%2810%29%3A+78%E2%80%9385%2E+%5Bdoi%3A+10%2E1145%2F2629489%5D+%E2%80%94+%5Bdoi%3A10%2E1145%2F2629489%5D%28https%3A%2F%2Fdoi%2Eorg%2F10%2E1145%2F2629489%29)
50. Singh P, Lin T, Mueller ET, Lim G, Perkins T, Zhu WL. Open mind common sense: Knowledge acquisition from the general public. In: Proc. of the 2002 OTM Confederated Int’l Conf. Berlin: Springer, 2002. 1223–1237. [doi: 10.1007/3-540-36124-3_77] [find](https://scholar.google.com/scholar?q=Singh+P%2C+Lin+T%2C+Mueller+ET%2C+Lim+G%2C+Perkins+T%2C+Zhu+WL%2E+Open+mind+common+sense%3A+Knowledge+acquisition+from+the+general+public%2E+In%3A+Proc%2E+of+the+2002+OTM+Confederated+Int%E2%80%99l+Conf%2E+Berlin%3A+Springer%2C+2002%2E+)
51. Burton K, Java A, Soboroff I. The ICWSM 2009 Spinn3r dataset. In: Proc. of the 3rd Annual Conf. on Weblogs and Social Media. San Jose: AAAI, 2009. [find](https://scholar.google.com/scholar?q=Burton+K%2C+Java+A%2C+Soboroff+I%2E+The+ICWSM+2009+Spinn3r+dataset%2E+In%3A+Proc%2E+of+the+3rd+Annual+Conf%2E+on+Weblogs+and+Social+Media%2E+San+Jose%3A+AAAI%2C+2009%2E)
52. Modi A, Anikina T, Ostermann S, Pinkal M. InScript: Narrative texts annotated with script information. In: Proc. of the 10th Int’l Conf. on Language Resources and Evaluation. 2016. 3485–3493. [find](https://scholar.google.com/scholar?q=Modi+A%2C+Anikina+T%2C+Ostermann+S%2C+Pinkal+M%2E+InScript%3A+Narrative+texts+annotated+with+script+information%2E+In%3A+Proc%2E+of+the+10th+Int%E2%80%99l+Conf%2E+on+Language+Resources+and+Evaluation%2E+2016%2E+3485%E2%80%933493%2E)
53. Cambria E, Song YQ, Wang HX, Hussain A. Isanette: A common and common sense knowledge base for opinion mining. In: Proc. of the 11th IEEE Int’l Conf. on Data Mining Workshops. Vancouver: IEEE, 2011. 315–322. [doi: 10.1109/ICDMW.2011.106] — [doi:10.1109/icdmw.2011.106](https://doi.org/10.1109/icdmw.2011.106) [find](https://scholar.google.com/scholar?q=Cambria+E%2C+Song+YQ%2C+Wang+HX%2C+Hussain+A%2E+Isanette%3A+A+common+and+common+sense+knowledge+base+for+opinion+mining%2E+In%3A+Proc%2E+of+the+11th+IEEE+Int%E2%80%99l+Conf%2E+on+Data+Mining+Workshops%2E+Vancouver%3A+IEEE%2C+2011%2E+3)
54. Ilievski F, Oltramari A, Ma KX, Zhang B, McGuinness DL, Szekely P. Dimensions of commonsense knowledge. Knowledge-based Systems, 2021, 229: 107347. [doi: 10.1016/j.knosys.2021.107347] [find](https://scholar.google.com/scholar?q=Ilievski+F%2C+Oltramari+A%2C+Ma+KX%2C+Zhang+B%2C+McGuinness+DL%2C+Szekely+P%2E+Dimensions+of+commonsense+knowledge%2E+Knowledge%2Dbased+Systems%2C+2021%2C+229%3A+107347%2E+%5Bdoi%3A+10%2E1016%2Fj%2Eknosys%2E2021%2E107347%5D)
55. Lenat DB, Guha RV, Pittman K, Pratt D, Shepherd M. Cyc: Toward programs with common sense. Communications of the ACM, 1990, 33(8): 30–49. [doi: 10.1145/79173.79176] — [doi:10.1145/79173.79176](https://doi.org/10.1145/79173.79176) [find](https://scholar.google.com/scholar?q=Lenat+DB%2C+Guha+RV%2C+Pittman+K%2C+Pratt+D%2C+Shepherd+M%2E+Cyc%3A+Toward+programs+with+common+sense%2E+Communications+of+the+ACM%2C+1990%2C+33%288%29%3A+30%E2%80%9349%2E+%5Bdoi%3A+10%2E1145%2F79173%2E79176%5D+%E2%80%94+%5Bdoi%3A10%2E1145%2F79173%2E79176%5D%28https%3A%2F)
56. Mostafazadeh N, Kalyanpur A, Moon L, Buchanan D, Berkowitz L, Biran O, Chu-Carroll J. GLUCOSE: Generalized and contextualized story explanations. In: Proc. of the 2020 Conf. on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2020. 4569–4586. [doi: 10.1865… [find](https://scholar.google.com/scholar?q=Mostafazadeh+N%2C+Kalyanpur+A%2C+Moon+L%2C+Buchanan+D%2C+Berkowitz+L%2C+Biran+O%2C+Chu%2DCarroll+J%2E+GLUCOSE%3A+Generalized+and+contextualized+story+explanations%2E+In%3A+Proc%2E+of+the+2020+Conf%2E+on+Empirical+Methods+in+Na) [our card](https://md.research.elamur.ai/free/papers/commonsense-2020-mostafazadeh-glucose-generalized-contextualized-story-explanations/)
57. Tandon N, De Melo G, Weikum G. WebChild 2.0: Fine-grained commonsense knowledge distillation. In: Proc. of the 2017 ACL, System Demonstrations. Vancouver: Association for Computational Linguistics, 2017. 115–120. [find](https://scholar.google.com/scholar?q=Tandon+N%2C+De+Melo+G%2C+Weikum+G%2E+WebChild+2%2E0%3A+Fine%2Dgrained+commonsense+knowledge+distillation%2E+In%3A+Proc%2E+of+the+2017+ACL%2C+System+Demonstrations%2E+Vancouver%3A+Association+for+Computational+Linguistics%2C+20)
58. Romero J, Razniewski S, Pal K, Pan JZ, Sakhadeo A, Weikum G. Commonsense properties from query logs and question answering forums. In: Proc. of the 28th ACM Int’l Conf. on Information and Knowledge Management. Beijing: ACM, 2019. 1411–1420. [doi: 10.1145/3357384.3357955] [find](https://scholar.google.com/scholar?q=Romero+J%2C+Razniewski+S%2C+Pal+K%2C+Pan+JZ%2C+Sakhadeo+A%2C+Weikum+G%2E+Commonsense+properties+from+query+logs+and+question+answering+forums%2E+In%3A+Proc%2E+of+the+28th+ACM+Int%E2%80%99l+Conf%2E+on+Information+and+Knowledge+Ma)
59. Cambria E, Li Y, Xing FZ, Poria S, Kwok K. SenticNet 6: Ensemble application of symbolic and subsymbolic AI for sentiment analysis. In: Proc. of the 29th ACM Int’l Conf. on Information & Knowledge Management. Ireland: ACM, 2020. 105–114. [doi: 10.1145/3340531.3412003] — [doi:10.1145/3340531.3412003](https://doi.org/10.1145/3340531.3412003) [find](https://scholar.google.com/scholar?q=Cambria+E%2C+Li+Y%2C+Xing+FZ%2C+Poria+S%2C+Kwok+K%2E+SenticNet+6%3A+Ensemble+application+of+symbolic+and+subsymbolic+AI+for+sentiment+analysis%2E+In%3A+Proc%2E+of+the+29th+ACM+Int%E2%80%99l+Conf%2E+on+Information+%26+Knowledge+Man)
60. Bhakthavatsalam S, Richardson K, Tandon N, Clark P. Do dogs have whiskers? A new knowledge base of haspart relations. arXiv: 2006.07510, 2020. [find](https://scholar.google.com/scholar?q=Bhakthavatsalam+S%2C+Richardson+K%2C+Tandon+N%2C+Clark+P%2E+Do+dogs+have+whiskers%3F+A+new+knowledge+base+of+haspart+relations%2E+arXiv%3A+2006%2E07510%2C+2020%2E)
61. Wu WT, Li HS, Wang HX, Zhu KQ. Probase: A probabilistic taxonomy for text understanding. In: Proc. of the 2012 ACM SIGMOD Int’l Conf. on Management of Data. Scottsdale: ACM, 2012. 481–492. [doi: 10.1145/2213836.2213891] — [doi:10.1145/2213836.2213891](https://doi.org/10.1145/2213836.2213891) [find](https://scholar.google.com/scholar?q=Wu+WT%2C+Li+HS%2C+Wang+HX%2C+Zhu+KQ%2E+Probase%3A+A+probabilistic+taxonomy+for+text+understanding%2E+In%3A+Proc%2E+of+the+2012+ACM+SIGMOD+Int%E2%80%99l+Conf%2E+on+Management+of+Data%2E+Scottsdale%3A+ACM%2C+2012%2E+481%E2%80%93492%2E+%5Bdoi%3A+10%2E11)
62. Cambria E, Song YQ, Wang HX, Howard N. Semantic multidimensional scaling for open-domain sentiment analysis. IEEE Intelligent Systems, 2014, 29(2): 44–51. [doi: 10.1109/MIS.2012.118] — [doi:10.1109/mis.2012.118](https://doi.org/10.1109/mis.2012.118) [find](https://scholar.google.com/scholar?q=Cambria+E%2C+Song+YQ%2C+Wang+HX%2C+Howard+N%2E+Semantic+multidimensional+scaling+for+open%2Ddomain+sentiment+analysis%2E+IEEE+Intelligent+Systems%2C+2014%2C+29%282%29%3A+44%E2%80%9351%2E+%5Bdoi%3A+10%2E1109%2FMIS%2E2012%2E118%5D+%E2%80%94+%5Bdoi%3A10%2E1109%2Fmi)
63. Tanon TP, Weikum G, Suchanek F. YAGO 4: A reason-able knowledge base. In: Proc. of the 17th Int ’l Conf. on the Semantic Web. Heraklion: Springer, 2020. 583–596. [doi: 10.1007/978-3-030-49461-2_34] [find](https://scholar.google.com/scholar?q=Tanon+TP%2C+Weikum+G%2C+Suchanek+F%2E+YAGO+4%3A+A+reason%2Dable+knowledge+base%2E+In%3A+Proc%2E+of+the+17th+Int+%E2%80%99l+Conf%2E+on+the+Semantic+Web%2E+Heraklion%3A+Springer%2C+2020%2E+583%E2%80%93596%2E+%5Bdoi%3A+10%2E1007%2F978%2D3%2D030%2D49461%2D2%5F34%5D)
64. Guha RV, Brickley D, Macbeth S. Schema.org: Evolution of structured data on the Web. Communications of the ACM, 2016, 59(2): 44–51. [doi: 10.1145/2844544] — [doi:10.1145/2844544](https://doi.org/10.1145/2844544) [find](https://scholar.google.com/scholar?q=Guha+RV%2C+Brickley+D%2C+Macbeth+S%2E+Schema%2Eorg%3A+Evolution+of+structured+data+on+the+Web%2E+Communications+of+the+ACM%2C+2016%2C+59%282%29%3A+44%E2%80%9351%2E+%5Bdoi%3A+10%2E1145%2F2844544%5D+%E2%80%94+%5Bdoi%3A10%2E1145%2F2844544%5D%28https%3A%2F%2Fdoi%2Eorg%2F10%2E11)
65. Gangemi A, Guarino N, Masolo C, Oltramari A, Schneider L. Sweetening ontologies with DOLCE. In: Knowledge Engineering and Knowledge Management: Ontologies and the Semantic Web. Berlin: Springer, 2002. 166–181. [doi: 10.1007/3-540-45810-7_18] — [doi:10.1007/3-540-45810-7_18](https://doi.org/10.1007/3-540-45810-7_18) [find](https://scholar.google.com/scholar?q=Gangemi+A%2C+Guarino+N%2C+Masolo+C%2C+Oltramari+A%2C+Schneider+L%2E+Sweetening+ontologies+with+DOLCE%2E+In%3A+Knowledge+Engineering+and+Knowledge+Management%3A+Ontologies+and+the+Semantic+Web%2E+Berlin%3A+Springer%2C+2002%2E)
66. Niles I, Pease A. Towards a standard upper ontology. In: Proc. of the 2001 Int ’l Conf. on Formal Ontology in Information Systems. Ogunquit: ACM, 2001. 2–9. [doi: 10.1145/505168.505170] — [doi:10.1145/505168.505170](https://doi.org/10.1145/505168.505170) [find](https://scholar.google.com/scholar?q=Niles+I%2C+Pease+A%2E+Towards+a+standard+upper+ontology%2E+In%3A+Proc%2E+of+the+2001+Int+%E2%80%99l+Conf%2E+on+Formal+Ontology+in+Information+Systems%2E+Ogunquit%3A+ACM%2C+2001%2E+2%E2%80%939%2E+%5Bdoi%3A+10%2E1145%2F505168%2E505170%5D+%E2%80%94+%5Bdoi%3A10%2E1145)
67. Bennett JS. ROGET: A knowledge-based system for acquiring the conceptual structure of a diagnostic expert system. Journal of Automated Reasoning, 1985, 1(1): 49–74. [doi: 10.1007/BF00244289] — [doi:10.1007/bf00244289](https://doi.org/10.1007/bf00244289) [find](https://scholar.google.com/scholar?q=Bennett+JS%2E+ROGET%3A+A+knowledge%2Dbased+system+for+acquiring+the+conceptual+structure+of+a+diagnostic+expert+system%2E+Journal+of+Automated+Reasoning%2C+1985%2C+1%281%29%3A+49%E2%80%9374%2E+%5Bdoi%3A+10%2E1007%2FBF00244289%5D+%E2%80%94+%5Bdoi%3A10)
68. Baker CF, Fillmore CJ, Lowe JB. The berkeley framenet project. In: Proc. of the 36th Annual Meeting of the Association for Computational Linguistics and the 17th Int’l Conf. on Computational Linguistics. Montreal: ACM, 1998. 86–90. [doi: 10.3115/980845.980860] [find](https://scholar.google.com/scholar?q=Baker+CF%2C+Fillmore+CJ%2C+Lowe+JB%2E+The+berkeley+framenet+project%2E+In%3A+Proc%2E+of+the+36th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+and+the+17th+Int%E2%80%99l+Conf%2E+on+Computational+Linguisti) [our card](https://md.research.elamur.ai/free/papers/lex-1998-baker-berkeley-framenet/)
69. Dodge EK, Hong J, Stickles E. MetaNet: Deep semantic automatic metaphor analysis. In: Proc. of the 3rd Workshop on Metaphor in NLP. Denver: Association for Computational Linguistics, 2015. 40–49. [doi: 10.3115/v1/W15-1405] [find](https://scholar.google.com/scholar?q=Dodge+EK%2C+Hong+J%2C+Stickles+E%2E+MetaNet%3A+Deep+semantic+automatic+metaphor+analysis%2E+In%3A+Proc%2E+of+the+3rd+Workshop+on+Metaphor+in+NLP%2E+Denver%3A+Association+for+Computational+Linguistics%2C+2015%2E+40%E2%80%9349%2E+%5Bdoi)
70. Schuler KK. VerbNet: A Broad-coverage, Comprehensive Verb Lexicon. Philadelphia: University of Pennsylvania, 2005. [find](https://scholar.google.com/scholar?q=Schuler+KK%2E+VerbNet%3A+A+Broad%2Dcoverage%2C+Comprehensive+Verb+Lexicon%2E+Philadelphia%3A+University+of+Pennsylvania%2C+2005%2E)
71. Bhakthavatsalam S, Anastasiades C, Clark P. GenericsKB: A knowledge base of generic statements. arXiv:200500660, 2020. [find](https://scholar.google.com/scholar?q=Bhakthavatsalam+S%2C+Anastasiades+C%2C+Clark+P%2E+GenericsKB%3A+A+knowledge+base+of+generic+statements%2E+arXiv%3A200500660%2C+2020%2E)
72. Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I. Language models are unsupervised multitask learners. OpenAI blog, 2019, 1(8): 9. [find](https://scholar.google.com/scholar?q=Radford+A%2C+Wu+J%2C+Child+R%2C+Luan+D%2C+Amodei+D%2C+Sutskever+I%2E+Language+models+are+unsupervised+multitask+learners%2E+OpenAI+blog%2C+2019%2C+1%288%29%3A+9%2E)
73. Bosselut A, Rashkin H, Sap M, Malaviya C, Celikyilmaz A, Choi Y. COMET: Commonsense transformers for automatic knowledge graph construction. In: Proc. of the 57th Annual Meeting of the Association for Computational Linguistics. Florence: Association for Computational Linguistics, 2019. 4762–4779. [d… [find](https://scholar.google.com/scholar?q=Bosselut+A%2C+Rashkin+H%2C+Sap+M%2C+Malaviya+C%2C+Celikyilmaz+A%2C+Choi+Y%2E+COMET%3A+Commonsense+transformers+for+automatic+knowledge+graph+construction%2E+In%3A+Proc%2E+of+the+57th+Annual+Meeting+of+the+Association+for) [our card](https://md.research.elamur.ai/free/papers/bosselut-2019-comet-commonsense-transformers-automatic-knowledge/)
74. Xu YH, Zhu CG, Xu RC, Liu Y, Zeng M, Huang XD. Fusing context into knowledge graph for commonsense question answering. In: Proc. of the 2021 Findings of the Association for Computational Linguistics. Association for Computational Linguistics, 2021. 1201–1207. [doi: 10.18653/v1/2021.findings-acl.102] [find](https://scholar.google.com/scholar?q=Xu+YH%2C+Zhu+CG%2C+Xu+RC%2C+Liu+Y%2C+Zeng+M%2C+Huang+XD%2E+Fusing+context+into+knowledge+graph+for+commonsense+question+answering%2E+In%3A+Proc%2E+of+the+2021+Findings+of+the+Association+for+Computational+Linguistics%2E+)
75. Feng YL, Chen XY, Lin BY, Wang PF, Yan J, Ren X. Scalable multi-hop relational reasoning for knowledge-aware question answering. In: Proc. of the 2020 Conf. on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2020. 1295–1309. [doi: 10.18653/v1/2020.emnlp-m… [find](https://scholar.google.com/scholar?q=Feng+YL%2C+Chen+XY%2C+Lin+BY%2C+Wang+PF%2C+Yan+J%2C+Ren+X%2E+Scalable+multi%2Dhop+relational+reasoning+for+knowledge%2Daware+question+answering%2E+In%3A+Proc%2E+of+the+2020+Conf%2E+on+Empirical+Methods+in+Natural+Language+Pr)
76. Yasunaga M, Ren HY, Bosselut A, Liang P, Leskovec J. QA-GNN: Reasoning with language models and knowledge graphs for question answering. In: Proc. of the 2021 Conf. of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computatio… [find](https://scholar.google.com/scholar?q=Yasunaga+M%2C+Ren+HY%2C+Bosselut+A%2C+Liang+P%2C+Leskovec+J%2E+QA%2DGNN%3A+Reasoning+with+language+models+and+knowledge+graphs+for+question+answering%2E+In%3A+Proc%2E+of+the+2021+Conf%2E+of+the+North+American+Chapter+of+th)
77. Sun YQ, Shi Q, Qi L, Zhang Y. JointLK: Joint reasoning with language models and knowledge graphs for commonsense question answering. In: Proc. of the 2022 Conf. of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Seattle: Association for Compu… [find](https://scholar.google.com/scholar?q=Sun+YQ%2C+Shi+Q%2C+Qi+L%2C+Zhang+Y%2E+JointLK%3A+Joint+reasoning+with+language+models+and+knowledge+graphs+for+commonsense+question+answering%2E+In%3A+Proc%2E+of+the+2022+Conf%2E+of+the+North+American+Chapter+of+the+As)
78. Wang JX, Li XY, Tan Z, Zhao X, Xiao WD. Relation-aware bidirectional path reasoning for commonsense question answering. In: Proc. of the 25th Conf. on Computational Natural Language Learning. Association for Computational Linguistics, 2021. 445 –453. [doi: 10.18653/v1/2021.conll-1.35] [find](https://scholar.google.com/scholar?q=Wang+JX%2C+Li+XY%2C+Tan+Z%2C+Zhao+X%2C+Xiao+WD%2E+Relation%2Daware+bidirectional+path+reasoning+for+commonsense+question+answering%2E+In%3A+Proc%2E+of+the+25th+Conf%2E+on+Computational+Natural+Language+Learning%2E+Associat)
79. Yan J, Raman M, Chan A, Zhang TY, Rossi R, Zhao HD, Kim S, Lipka N, Ren X. Learning contextualized knowledge structures for commonsense reasoning. In: Proc. of the 2021 Findings of the Association for Computational Linguistics (ACL-IJCNLP 2021). Association for Computational Linguistics, 2021. 4038–… [find](https://scholar.google.com/scholar?q=Yan+J%2C+Raman+M%2C+Chan+A%2C+Zhang+TY%2C+Rossi+R%2C+Zhao+HD%2C+Kim+S%2C+Lipka+N%2C+Ren+X%2E+Learning+contextualized+knowledge+structures+for+commonsense+reasoning%2E+In%3A+Proc%2E+of+the+2021+Findings+of+the+Association+for)
80. Ye ZX, Chen Q, Wang W, Ling ZH. Align, mask and select: A simple method for incorporating commonsense knowledge into language representation models. arXiv:1908.06725, 2020. — [arXiv:1908.06725](https://arxiv.org/abs/1908.06725) [find](https://scholar.google.com/scholar?q=Ye+ZX%2C+Chen+Q%2C+Wang+W%2C+Ling+ZH%2E+Align%2C+mask+and+select%3A+A+simple+method+for+incorporating+commonsense+knowledge+into+language+representation+models%2E+arXiv%3A1908%2E06725%2C+2020%2E+%E2%80%94+%5BarXiv%3A1908%2E06725%5D%28https%3A)
81. Niu YL, Huang F, Liang JM, Chen WK, Zhu XY, Huang ML. A semantic-based method for unsupervised commonsense question answering. In: Proc. of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th Int ’l Joint Conf. on Natural Language Processing (Vol. 1: Long Papers). A… [find](https://scholar.google.com/scholar?q=Niu+YL%2C+Huang+F%2C+Liang+JM%2C+Chen+WK%2C+Zhu+XY%2C+Huang+ML%2E+A+semantic%2Dbased+method+for+unsupervised+commonsense+question+answering%2E+In%3A+Proc%2E+of+the+59th+Annual+Meeting+of+the+Association+for+Computational)
82. Lourie N, Le Bras R, Bhagavatula C, Choi Y. Unicorn on rainbow: A universal commonsense reasoning model on a new multitask benchmark. Proc. of the AAAI Conf. on Artificial Intelligence, 2021, 35(15): 13480–13488. [doi: 10.1609/aaai.v35i15.17590] [find](https://scholar.google.com/scholar?q=Lourie+N%2C+Le+Bras+R%2C+Bhagavatula+C%2C+Choi+Y%2E+Unicorn+on+rainbow%3A+A+universal+commonsense+reasoning+model+on+a+new+multitask+benchmark%2E+Proc%2E+of+the+AAAI+Conf%2E+on+Artificial+Intelligence%2C+2021%2C+35%2815%29%3A+)
83. Khashabi D, Min S, Khot T, Sabharwal A, Tafjord O, Clark P, Hajishirzi H. UNIFIEDQA: Crossing format boundaries with a single QA system. In: Proc. of the 2020 Findings of the Association for Computational Linguistics: EMNLP 2020. Association for Computational Linguistics, 2020. 1896–1907. [doi: 10.1… [find](https://scholar.google.com/scholar?q=Khashabi+D%2C+Min+S%2C+Khot+T%2C+Sabharwal+A%2C+Tafjord+O%2C+Clark+P%2C+Hajishirzi+H%2E+UNIFIEDQA%3A+Crossing+format+boundaries+with+a+single+QA+system%2E+In%3A+Proc%2E+of+the+2020+Findings+of+the+Association+for+Computati) [our card](https://md.research.elamur.ai/free/papers/khashabi-2020-unifiedqa-crossing-format-boundaries-single/)
84. Clark K, Luong MT, Le QV, Manning CD. ELECTRA: Pre-training text encoders as discriminators rather than generators. arXiv:2003.10555, 2020. [find](https://scholar.google.com/scholar?q=Clark+K%2C+Luong+MT%2C+Le+QV%2C+Manning+CD%2E+ELECTRA%3A+Pre%2Dtraining+text+encoders+as+discriminators+rather+than+generators%2E+arXiv%3A2003%2E10555%2C+2020%2E)
85. Ilievski F, Szekely P, Zhang B. CSKG: The commonsense knowledge graph. In: Proc. of the 18th Int ’l Conf. on the Semantic Web. Springer, 2021. 680–696. [doi: 10.1007/978-3-030-77385-4_41] [find](https://scholar.google.com/scholar?q=Ilievski+F%2C+Szekely+P%2C+Zhang+B%2E+CSKG%3A+The+commonsense+knowledge+graph%2E+In%3A+Proc%2E+of+the+18th+Int+%E2%80%99l+Conf%2E+on+the+Semantic+Web%2E+Springer%2C+2021%2E+680%E2%80%93696%2E+%5Bdoi%3A+10%2E1007%2F978%2D3%2D030%2D77385%2D4%5F41%5D)
86. Kavumba P, Inoue N, Heinzerling B, Heinzerling B, Singh K, Reisert P, Inui K. When choosing plausible alternatives, clever hans can be clever. In: Proc. of the 1st Workshop on Commonsense Inference in Natural Language Processing. Hong Kong: Association for Computational Linguistics, 2019. 33–42. [do… [find](https://scholar.google.com/scholar?q=Kavumba+P%2C+Inoue+N%2C+Heinzerling+B%2C+Heinzerling+B%2C+Singh+K%2C+Reisert+P%2C+Inui+K%2E+When+choosing+plausible+alternatives%2C+clever+hans+can+be+clever%2E+In%3A+Proc%2E+of+the+1st+Workshop+on+Commonsense+Inference+in)
87. Da J, Kasai J. Cracking the contextual commonsense code: Understanding commonsense reasoning aptitude of deep contextual representations. In: Proc. of the 1st Workshop on Commonsense Inference in Natural Language Processing. Hong Kong: Association for Computational Linguistics, 2019. 1–12. [doi: 10.… [find](https://scholar.google.com/scholar?q=Da+J%2C+Kasai+J%2E+Cracking+the+contextual+commonsense+code%3A+Understanding+commonsense+reasoning+aptitude+of+deep+contextual+representations%2E+In%3A+Proc%2E+of+the+1st+Workshop+on+Commonsense+Inference+in+Natu)
88. Petroni F, Rocktäschel T, Riedel S, Lewis P, Bakhtin A, Wu YX, Miller A. Language models as knowledge bases? In: Proc. of the 2019 Conf. on Empirical Methods in Natural Language Processing and the 9th Int’l Joint Conf. on Natural Language Processing. Hong Kong: Association for Computational Linguist… [find](https://scholar.google.com/scholar?q=Petroni+F%2C+Rockt%C3%A4schel+T%2C+Riedel+S%2C+Lewis+P%2C+Bakhtin+A%2C+Wu+YX%2C+Miller+A%2E+Language+models+as+knowledge+bases%3F+In%3A+Proc%2E+of+the+2019+Conf%2E+on+Empirical+Methods+in+Natural+Language+Processing+and+the+9th) [our card](https://md.research.elamur.ai/free/papers/petroni-2019-language-models-as-knowledge-bases/)
89. Poerner N, Waltinger U, Schütze H. E-BERT: Efficient-yet-effective entity embeddings for BERT. In: Proc. of the 2020 Findings of the Association for Computational Linguistics: EMNLP 2020. Association for Computational Linguistics, 2020. 803–818. [doi: 10.18653/v1/2020.findings-emnlp.71] [find](https://scholar.google.com/scholar?q=Poerner+N%2C+Waltinger+U%2C+Sch%C3%BCtze+H%2E+E%2DBERT%3A+Efficient%2Dyet%2Deffective+entity+embeddings+for+BERT%2E+In%3A+Proc%2E+of+the+2020+Findings+of+the+Association+for+Computational+Linguistics%3A+EMNLP+2020%2E+Association+)
90. Li DW, Li YR, Zhang JY, Li K, Wei C, Cui JW, Wang B. C 3 KG: A Chinese commonsense conversation knowledge graph. In: Proc. of the 2022 Findings of the Association for Computational Linguistics: ACL 2022. Dublin: Association for Computational Linguistics, 2022. 1369–1383. [doi: 10.18653/v1/2022.findi… [find](https://scholar.google.com/scholar?q=Li+DW%2C+Li+YR%2C+Zhang+JY%2C+Li+K%2C+Wei+C%2C+Cui+JW%2C+Wang+B%2E+C+3+KG%3A+A+Chinese+commonsense+conversation+knowledge+graph%2E+In%3A+Proc%2E+of+the+2022+Findings+of+the+Association+for+Computational+Linguistics%3A+ACL+20)