---
title: "Knowledge-driven Natural Language Understanding of English"
description: "The paper argues that systems which answer questions or hold conversations should first turn text into… 27 references, cited by 1 paper here."
authors: ["Kinjal Basu", "Sarat Varanasi", "Farhad Shakerin", "Joaquin Arias", "Gopal Gupta"]
year: 2021
venue: "arXiv:2101.11707"
source: "https://arxiv.org/abs/2101.11707"
doi: "10.48550/arxiv.2101.11707"
arxiv: "2101.11707"
licence: "arXiv — non-exclusive license to distribute"
licence_url: "http://arxiv.org/licenses/nonexclusive-distrib/1.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/basu-2021-knowledge-driven-natural-language-understanding/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/basu-2021-knowledge-driven-natural-language-understanding/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2021](https://md.research.elamur.ai/free/en/papers/2021/page/7/) / Knowledge-driven Natural Language Understanding of English Text and its Applications

# Knowledge-driven Natural Language Understanding of English Text and its Applications

**Authors:** Kinjal Basu, Sarat Varanasi, Farhad Shakerin, Joaquin Arias and Gopal Gupta · **Year:** 2021 · **Venue:** [arXiv:2101.11707](https://md.research.elamur.ai/free/en/venues/proceedings-of-the-aaai-conference-on-artificial-intelligence/) ([Proceedings of the AAAI Conference on Artificial Intelligence 2021](https://md.research.elamur.ai/free/en/venues/proceedings-of-the-aaai-conference-on-artificial-intelligence/2021/)) · **Publisher:** [Association for the Advancement of Artificial Intelligence](https://md.research.elamur.ai/free/en/publishers/association-for-the-advancement-of-artificial-intelligence/) · **Licence:** [arXiv — non-exclusive license to distribute](http://arxiv.org/licenses/nonexclusive-distrib/1.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2101.11707) · [PDF](https://arxiv.org/pdf/2101.11707) · [DOI 10.48550/arxiv.2101.11707](https://doi.org/10.48550/arxiv.2101.11707) · [arXiv 2101.11707](https://arxiv.org/abs/2101.11707) · [OpenAlex](https://openalex.org/W3124385450)

**Citations:** 3 citations (OpenAlex, 2026-10-14) · 1 in our library, of the 141,840 papers whose bibliographies we read

## Summary
The paper argues that systems which answer questions or hold conversations should first turn text into an explicit meaning representation and then reason over it, rather than rely on word correlations. The authors treat English like a programming language with a denotational semantics. A Stanford CoreNLP parse tree is the syntax. VerbNet's primitive predicates act as the semantic algebra. VerbNet's frames work as the valuation function. Their algorithm partially matches a sentence's parse tree against the frame syntax of the verb's VerbNet classes. It then binds the thematic roles (AGENT, THEME, …) and emits the frame semantics as answer set programming (ASP) facts. Reusable, hand-written commonsense rules are added, and the s(CASP) engine runs the reasoning and produces justifications. Two applications are built on this: SQuARE, a reading-comprehension QA system, and StaCACK, a goal-oriented chatbot. Both reach essentially perfect accuracy on the bAbI benchmarks, beating neural baselines, and both explain their answers in natural language.

## Key points
- Pipeline: CoreNLP parse tree → partial match to VerbNet frame syntax → grounded thematic roles → ASP facts → s(CASP) query with commonsense rules → answer plus proof-tree justification.
- s(CASP) is goal-directed and avoids grounding the program. It visits only the parts of the knowledge base a query needs and returns a natural-language proof. The authors present these properties as the key to scalability.
- On the 20 bAbI QA tasks, SQuARE scores 100% on almost every task, with 99.8 on Three Arg. Relation and 98.2 on Indefinite Knowledge. MemNN (AM+NG+NL) averages 94, falling to 60 on Positional Reasoning and 35 on Path Finding.
- On bAbI dialog Tasks 1–5 and their OOV variants, StaCACK gets 100% both per response and per dialog. On Task 5 (OOV), Mem2Seq scores 84.5 (2.3) and BoSsNET 91.7 (18.5).
- Nonmonotonic reasoning, implemented as negation-as-failure, handles defaults, exceptions and preferences. Classical negation separately marks facts that are known to be false.

## Interesting ideas
- VerbNet works as a ready-made table from syntax patterns to meanings: match the dependency structure against a class's frame syntax, fill the role slots, and copy out its semantic predicates
- Framing NLU as denotational semantics (syntax, semantic algebra, valuation function) gives a clean, compositional contract for each layer
- Goal-directed reasoning explores only the facts relevant to a question and hands back the proof tree as a human-readable justification
- Defaults with exceptions through negation-as-failure, kept separate from explicit "definitely false" facts, separates "not stated" from "denied"
- Reporting per-dialog accuracy next to per-response accuracy, plus OOV splits, exposes failures that average scores hide, as in BoSsNET's 18.5% per-dialog result

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (frames): prag could adopt this "partial match + role binding" as its main route from UD trees to VerbNet-based who-did-what-to-whom frames, with the matched frame recorded as the explanation.
- **I2** (world): the world builder could use VerbNet predicates as its fixed primitive vocabulary, so frames compile into entity, state and holding facts in one well-defined algebra.
- **I3** (answer): the readers answering fable QA or school tests could search backward from the question over the text's world and print the derivation as the answer's explanation.
- **I4** (world): the compiled knowledge layer could hold commonsense defaults that a text can override, while preserving the unknown/false distinction for honest answers.
- **I5** (learn): evaluation could add whole-document or whole-problem correctness and out-of-vocabulary splits as stricter controls beside per-item scores.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [The University of Texas at Dallas](https://md.research.elamur.ai/free/en/universities/the-university-of-texas-at-dallas/) — University, Richardson, United States · 47 works · 5,363 citations

Also on the byline: [Universidad Rey Juan Carlos](https://ror.org/01v5cv687) · [LinkedIn](https://ror.org/02fyxhe35).

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,086 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,889 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works

🧭 Topics (1): [English](https://md.research.elamur.ai/free/en/topics/english/) · 1,373 works

## Cite

Cite as: Kinjal Basu, Sarat Varanasi, Farhad Shakerin, Joaquin Arias and Gopal Gupta. 2021. Knowledge-driven Natural Language Understanding of English Text and its Applications. arXiv:2101.11707.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{basu2021knowledge,
  title = {{Knowledge-driven Natural Language Understanding of English Text and its Applications}},
  author = {Kinjal Basu, Sarat Varanasi, Farhad Shakerin, Joaquin Arias and Gopal Gupta},
  year = {2021},
  doi = {10.48550/arxiv.2101.11707},
  eprint = {2101.11707},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2101.11707}
}
```

- [← previous Intensionalizing Abstract Meaning Representations: Non-Veridicality and Scope](https://md.research.elamur.ai/free/en/papers/williamson-2021-intensionalizing-abstract-meaning-representations-non/)
- [next → Leveraging English Word Embeddings for Semi-Automatic Semantic Classification in Nêhiyawêwin (Plains Cree)](https://md.research.elamur.ai/free/en/papers/harrigan-2021-leveraging-english-word-embeddings-semi/)
- [↑ back to papers of 2021](https://md.research.elamur.ai/free/en/papers/2021/page/7/)

## References

27 references, 5 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Arias, J.; Carro, M.; Salazar, E.; Marple, K.; and Gupta, G. 2018. Constraint answer set programming without grounding. TPLP 18(3-4):337– 354. [↗](https://doi.org/10.1017/s1471068418000285)
2. Arias, J.; Carro, M.; Chen, Z.; and Gupta, G. 2020. Justifications for goal-directed constraint answer set programming. arXiv preprint arXiv:2009.10238. [↗](https://arxiv.org/abs/2009.10238)
3. Baral, C. 2003. Knowledge representation, reasoning and declarative problem solving. Cambridge University Press. [↗](https://doi.org/10.1017/cbo9780511543357)
4. Basu, K.; Varanasi, S. C.; Shakerin, F.; and Gupta, G. 2020. SQuARE: Semantics-based Question Answering and Reasoning Engine. In Proc. 36th ICLP (Technical Communications), volume 325 of EPTCS, 73–86. [↗](https://doi.org/10.4204/eptcs.325.13)
5. Basu, K.; Shakerin, F.; and Gupta, G. 2020. AQuA: ASP-Based Visual Question Answering. In Practical Aspects of Declarative Languages, 57–72. Cham: Springer International Publishing. [find](https://scholar.google.com/scholar?q=Basu%2C+K%2E%3B+Shakerin%2C+F%2E%3B+and+Gupta%2C+G%2E+2020%2E+AQuA%3A+ASP%2DBased+Visual+Question+Answering%2E+In+Practical+Aspects+of+Declarative+Languages%2C+57%E2%80%9372%2E+Cham%3A+Springer+International+Publishing%2E)
6. Bordes, A.; Boureau, Y.-L.; and Weston, J. 2016. Learning end-to-end goal-oriented dialog. arXiv preprint arXiv:1605.07683. [↗](https://arxiv.org/abs/1605.07683)
7. Brown, T. B.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; Askell, A.; et al. 2020. [Language models are few-shot learners](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/). arXiv preprint arXiv:2005.14165. [↗](https://arxiv.org/abs/2005.14165)
8. Chan, A.; Ma, L.; Juefei-Xu, F.; Xie, X.; Liu, Y.; and Ong, Y. S. 2018. Metamorphic relation based adversarial attacks on differentiable neural computer. arXiv preprint arXiv:1809.02444. [↗](https://arxiv.org/abs/1809.02444)
9. Colby, K. M.; Weber, S.; and Hilf, F. D. 1971. Artificial paranoia. Artificial Intelligence 2(1):1–25. [find](https://scholar.google.com/scholar?q=Colby%2C+K%2E+M%2E%3B+Weber%2C+S%2E%3B+and+Hilf%2C+F%2E+D%2E+1971%2E+Artificial+paranoia%2E+Artificial+Intelligence+2%281%29%3A1%E2%80%9325%2E)
10. Devlin, J.; Chang, M.-W.; Lee, K.; and Toutanova, K. 2018. [BERT: Pre-training of deep bidirectional transformers for language understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/). arXiv preprint arXiv:1810.04805. [↗](https://arxiv.org/abs/1810.04805)
11. Gelfond, M., and Kahl, Y. 2014. Knowledge representation, reasoning, and the design of intelligent agents: The answer-set programming approach. Cambridge University Press. [find](https://scholar.google.com/scholar?q=Gelfond%2C+M%2E%2C+and+Kahl%2C+Y%2E+2014%2E+Knowledge+representation%2C+reasoning%2C+and+the+design+of+intelligent+agents%3A+The+answer%2Dset+programming+approach%2E+Cambridge+University+Press%2E)
12. Gelfond, M., and Lifschitz, V. 1988. The stable model semantics for logic programming. In ICLP/SLP, volume 88, 1070–1080. [find](https://scholar.google.com/scholar?q=Gelfond%2C+M%2E%2C+and+Lifschitz%2C+V%2E+1988%2E+The+stable+model+semantics+for+logic+programming%2E+In+ICLP%2FSLP%2C+volume+88%2C+1070%E2%80%931080%2E)
13. Honnibal, M., and Montani, I. 2017. spaCy 2: Natural language understanding with Bloom embeddings, convolutional neural networks and incremental parsing. To appear. [find](https://scholar.google.com/scholar?q=Honnibal%2C+M%2E%2C+and+Montani%2C+I%2E+2017%2E+spaCy+2%3A+Natural+language+understanding+with+Bloom+embeddings%2C+convolutional+neural+networks+and+incremental+parsing%2E+To+appear%2E)
14. Kipper, K.; Korhonen, A.; Ryant, N.; and Palmer, M. 2008. A large-scale classification of english verbs. Language Resources and Evaluation 42(1):21–40. [↗](https://doi.org/10.1007/s10579-007-9048-2)
15. Kumar, A., et al. 2016. [Ask me anything: Dynamic memory networks for natural language processing](https://md.research.elamur.ai/free/en/papers/kumar-2015-ask-me-anything-dynamic-memory/). In ICML, 1378–1387. [↗](https://doi.org/10.48550/arxiv.1506.07285)
16. Levin, B. 1993. English verb classes and alternations: A preliminary investigation. U. Chicago Press. [find](https://scholar.google.com/scholar?q=Levin%2C+B%2E+1993%2E+English+verb+classes+and+alternations%3A+A+preliminary+investigation%2E+U%2E+Chicago+Press%2E)
17. Lierler, Y.; Inclezan, D.; and Gelfond, M. 2017. Action languages and question answering. In IWCS 2017—12th International Conference on Computational Semantics—Short papers. [find](https://scholar.google.com/scholar?q=Lierler%2C+Y%2E%3B+Inclezan%2C+D%2E%3B+and+Gelfond%2C+M%2E+2017%2E+Action+languages+and+question+answering%2E+In+IWCS+2017%E2%80%9412th+International+Conference+on+Computational+Semantics%E2%80%94Short+papers%2E)
18. Ling, G. 2018. From Narrative Text to VerbNet-based DRSes: System Text2DRS. [find](https://scholar.google.com/scholar?q=Ling%2C+G%2E+2018%2E+From+Narrative+Text+to+VerbNet%2Dbased+DRSes%3A+System+Text2DRS%2E)
19. Madotto, A.; Wu, C.-S.; and Fung, P. 2018. [Mem2Seq: Effectively incorporating knowledge bases into end-to-end task-oriented dialog systems](https://md.research.elamur.ai/free/en/papers/madotto-2018-mem2seq-effectively-incorporating-knowledge-bases/). arXiv preprint arXiv:1804.08217. [↗](https://arxiv.org/abs/1804.08217)
20. Manning, C. D.; Surdeanu, M.; Bauer, J.; Finkel, J.; Bethard, S. J.; and McClosky, D. 2014. The Stanford CoreNLP NLP toolkit. In ACL System Demonstrations, 55–60. [find](https://scholar.google.com/scholar?q=Manning%2C+C%2E+D%2E%3B+Surdeanu%2C+M%2E%3B+Bauer%2C+J%2E%3B+Finkel%2C+J%2E%3B+Bethard%2C+S%2E+J%2E%3B+and+McClosky%2C+D%2E+2014%2E+The+Stanford+CoreNLP+NLP+toolkit%2E+In+ACL+System+Demonstrations%2C+55%E2%80%9360%2E)
21. McFate, C. 2010. Expanding verb coverage in Cyc with VerbNet. In Proceedings of the ACL 2010 Student Research Workshop, 61–66. [find](https://scholar.google.com/scholar?q=McFate%2C+C%2E+2010%2E+Expanding+verb+coverage+in+Cyc+with+VerbNet%2E+In+Proceedings+of+the+ACL+2010+Student+Research+Workshop%2C+61%E2%80%9366%2E)
22. Pendharkar, D., and Gupta, G. 2019. An ASP Based Approach to Answering Questions for Natural Language Text. In Proc. Practical Aspects of Declarative Languages, Springer LNCS 11372, pp. 46-63, volume 11372 of Lecture Notes in Computer Science, 46–63. Springer. [find](https://scholar.google.com/scholar?q=Pendharkar%2C+D%2E%2C+and+Gupta%2C+G%2E+2019%2E+An+ASP+Based+Approach+to+Answering+Questions+for+Natural+Language+Text%2E+In+Proc%2E+Practical+Aspects+of+Declarative+Languages%2C+Springer+LNCS+11372%2C+pp%2E+46%2D63%2C+volume+)
23. Raghu, D.; Gupta, N.; et al. 2018. Disentangling language and knowledge in task-oriented dialogs. arXiv preprint arXiv:1805.01216. [↗](https://arxiv.org/abs/1805.01216)
24. Schmidt, D. A. 1986. Denotational semantics: a methodology for language development, William C. Brown Publishers, Dubuque, IA, USA. [find](https://scholar.google.com/scholar?q=Schmidt%2C+D%2E+A%2E+1986%2E+Denotational+semantics%3A+a+methodology+for+language+development%2C+William+C%2E+Brown+Publishers%2C+Dubuque%2C+IA%2C+USA%2E)
25. Schmitz, M.; Soderland, S.; Bart, R.; Etzioni, O.; et al. 2012. Open language learning for information extraction. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, 523–534. [find](https://scholar.google.com/scholar?q=Schmitz%2C+M%2E%3B+Soderland%2C+S%2E%3B+Bart%2C+R%2E%3B+Etzioni%2C+O%2E%3B+et+al%2E+2012%2E+Open+language+learning+for+information+extraction%2E+In+Proceedings+of+the+2012+Joint+Conference+on+Empirical+Methods+in+Natural+Language+)
26. Weizenbaum, J. 1966. ELIZA—a computer program for the study of natural language communication between man and machine. CACM 9(1):36–45. [↗](https://doi.org/10.1145/365153.365168)
27. Weston, J., et al. 2015. [Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks](https://md.research.elamur.ai/free/en/papers/weston-2015-towards-ai-complete-question-answering/). arXiv preprint arXiv:1502.05698. [↗](https://arxiv.org/abs/1502.05698)

*Updated 24 October 2026*