---
title: "Syntactic/Semantic Structures for Textual Entailment Recognition"
description: "The authors propose a supervised alternative built from off-the-shelf parsers and lexical resources. 36 references, cited by 16 papers here."
authors: ["Yashar Mehdad", "Alessandro Moschitti", "Fabio Massimo Zanzotto"]
year: 2010
venue: "Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics"
source: "https://aclanthology.org/N10-1146/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/mehdad-2010-syntactic-semantic-structures-textual-entailment/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/mehdad-2010-syntactic-semantic-structures-textual-entailment/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2010](https://md.research.elamur.ai/free/en/papers/2010/page/2/) / Syntactic/Semantic Structures for Textual Entailment Recognition

# Syntactic/Semantic Structures for Textual Entailment Recognition

**Authors:** [Yashar Mehdad](https://md.research.elamur.ai/free/en/authors/yashar-mehdad/), [Alessandro Moschitti](https://md.research.elamur.ai/free/en/authors/alessandro-moschitti/) and [Fabio Massimo Zanzotto](https://md.research.elamur.ai/free/en/authors/fabio-massimo-zanzotto/) · **Year:** 2010 · **Venue:** [Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/naacl/) ([NAACL 2010](https://md.research.elamur.ai/free/en/venues/naacl/2010/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/N10-1146/) · [PDF](https://aclanthology.org/N10-1146.pdf) · [OpenAlex](https://openalex.org/W2101871539)

**Citations:** 27 citations (OpenAlex, 2026-10-14) · [16](https://md.research.elamur.ai/free/en/papers/mehdad-2010-syntactic-semantic-structures-textual-entailment/cited-by/) in our library, of the 141,840 papers whose bibliographies we read

## Summary
The paper addresses Recognizing Textual Entailment (RTE): deciding whether a hypothesis follows from a text. Many systems rely on lexical-syntactic rewrite rules. Rules mined without supervision from corpora are noisy and sparse, and semantic rules are usually written by hand. The authors propose a supervised alternative built from off-the-shelf parsers and lexical resources. Text and hypothesis are represented by constituency parse trees and compared with a syntactic/semantic tree kernel (SSTK). This kernel lets two tree fragments match when their leaf words are semantically related, not only when they are identical. Word relatedness comes from two sources:
- WordNet path-based measures (Path, WUP);
- LSA, computed over Wikipedia or the BNC.

Within a kernel-based RTE system, these kernels are combined with a word-overlap kernel and placeholder-based rule kernels. Experiments on RTE2, RTE3 and RTE5 show that Wikipedia-based LSA consistently beats the purely syntactic baseline of Zanzotto and Moschitti, with statistically significant gains. The system ranks near the top of each challenge without task-specific tuning. LSA also turns out to be cheaper and broader in coverage than WordNet.

## Key points
- Lexical similarity is plugged into the tree kernel of Collins and Duffy (STK), giving SSTK; "max" variants (maxSTK, maxSSTK) model rules with variables. The gains over the no-semantics kernel are significant (p \<\< 0.05).
- The word-overlap kernel WOK alone reaches 60.62 (RTE2), 66.75 (RTE3) and 60.67 (RTE5), and removing it always hurts badly.
- maxSSTK+WOK improves on WOK on all three datasets. STK and maxSTK fail to help on RTE3.
- Coverage of dataset content words is about 0.83 for Wikipedia, versus 0.41–0.55 for BNC and 0.34–0.42 for WordNet. One similarity lookup costs 0.54 ms with LSA, compared with 5.3 ms (WordNet with POS) and 15.2 ms (WordNet without POS).
- The system ranks 3rd of 23 (RTE2), 4th of 26 (RTE3) and 4th of 20 (RTE5). On RTE2 it beats the best FrameNet-based system, which scored 62.5.

## Interesting ideas
- Soft structural matching: tree fragments count as shared when their words are related by a similarity score, so "killed Kennedy" can align with "murdered JFK" without a hand-written rule.
- Generalizing rules through lexical relatedness: a rule learned from one example should transfer only to cases whose words are semantically close. This stops a pattern like "X verb Y → Y died" from firing on "met".
- Choose the knowledge source by coverage and speed, not only by accuracy. Wikipedia LSA covered about twice as many words and was roughly 10× faster than WordNet, at comparable accuracy.
- Ablate each component, including the simple lexical-overlap baseline. The overlap kernel proved essential, and syntax helped on some datasets but not on RTE3.
- Tune only one interpretable knob, the positive/negative cost ratio. Because semantics tends to raise recall, they lowered j slightly to recover precision.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (tree): Our tree comparisons could match UD subtrees whose lemmas are near-synonyms, using a graded match while keeping explicit, inspectable alignments.
- **I2** (frames): When frames induce role-mapping rules (killer/victim → protagonist of DEATH), they could gate transfer to new verbs by VerbNet class or similarity, which blocks spurious inferences.
- **I3** (world): Our compiled knowledge layer could measure per-resource coverage on real test texts and fall back to a broad distributional table when WordNet/FrameNet has no entry.
- **I4** (learn): Evaluations should always report a shallow-overlap control alongside the structured pipeline, to show where the tree and frame steps actually add value.
- **I5** (answer): Entailment-style readers could expose a single precision/recall bias parameter, set once on validation data rather than per test set.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Trento](https://md.research.elamur.ai/free/en/universities/university-of-trento/) — University, Trento, Italy · 62 works · 14,868 citations
- [University of Rome Tor Vergata](https://md.research.elamur.ai/free/en/universities/university-of-rome-tor-vergata/) — University, Rome, Italy · 6 works · 1,251 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,085 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,888 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works

🧭 Topics (1): [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 510 works

## Cite

Cite as: Yashar Mehdad, Alessandro Moschitti and Fabio Massimo Zanzotto. 2010. Syntactic/Semantic Structures for Textual Entailment Recognition. Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{mehdad2010syntactic,
  title = {{Syntactic/Semantic Structures for Textual Entailment Recognition}},
  author = {Yashar Mehdad, Alessandro Moschitti and Fabio Massimo Zanzotto},
  booktitle = {Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics},
  year = {2010},
  url = {https://aclanthology.org/N10-1146/}
}
```

- [← previous Learning Recursive Segments for Discourse Parsing](https://md.research.elamur.ai/free/en/papers/afantenos-2010-learning-recursive-segments-discourse-parsing/)
- [next → Dialogue Act Modeling in a Complex Task-Oriented Domain](https://md.research.elamur.ai/free/en/papers/boyer-2010-dialogue-act-modeling-complex-task/)
- [↑ back to papers of 2010](https://md.research.elamur.ai/free/en/papers/2010/page/2/)

## References

36 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. E. Agirre, E. Alfonseca, K. Hall, J. Kravalova, M. Paşca, and A. Soroa. 2009. [A study on similarity and relatedness using distributional and wordnet-based approaches](https://md.research.elamur.ai/free/en/papers/agirre-2009-study-similarity-relatedness-distributional-wordnet/). In NAACL ’09: Proc. HLT/NAACL.
2. R. Bar-Haim, I. Dagan, B. Dolan, L. Ferro, D. Giampiccolo, and I. Magnini, B. Szpektor. 2006. The ii PASCAL recognising textual entailment challenge. In Proc. of the II PASCAL Challenges Workshop. [find](https://scholar.google.com/scholar?q=R%2E+Bar%2DHaim%2C+I%2E+Dagan%2C+B%2E+Dolan%2C+L%2E+Ferro%2C+D%2E+Giampiccolo%2C+and+I%2E+Magnini%2C+B%2E+Szpektor%2E+2006%2E+The+ii+PASCAL+recognising+textual+entailment+challenge%2E+In+Proc%2E+of+the+II+PASCAL+Challenges+Workshop%2E)
3. R. Bar-Haim, I. Dagan, I. Greental, and E. Shnarch. 2007. Semantic inference at the lexical-syntactic level. In AAAI’07: Proc. of the 22nd national conference on Artificial intelligence. [find](https://scholar.google.com/scholar?q=R%2E+Bar%2DHaim%2C+I%2E+Dagan%2C+I%2E+Greental%2C+and+E%2E+Shnarch%2E+2007%2E+Semantic+inference+at+the+lexical%2Dsyntactic+level%2E+In+AAAI%E2%80%9907%3A+Proc%2E+of+the+22nd+national+conference+on+Artificial+intelligence%2E)
4. R. Bar-Haim, J. Berant, and I. Dagan. 2009. A compact forest for scalable inference over entailment and paraphrase rules. In Proc. of EMNLP. [find](https://scholar.google.com/scholar?q=R%2E+Bar%2DHaim%2C+J%2E+Berant%2C+and+I%2E+Dagan%2E+2009%2E+A+compact+forest+for+scalable+inference+over+entailment+and+paraphrase+rules%2E+In+Proc%2E+of+EMNLP%2E)
5. R. Basili, M. Cammisa, and A. Moschitti. 2005. Effective use of wordnet semantics via kernel-based learning. In CoNLL. [find](https://scholar.google.com/scholar?q=R%2E+Basili%2C+M%2E+Cammisa%2C+and+A%2E+Moschitti%2E+2005%2E+Effective+use+of+wordnet+semantics+via+kernel%2Dbased+learning%2E+In+CoNLL%2E)
6. R. Basili, M. Cammisa, and A. Moschitti. 2006. A semantic kernel to classify texts with very few training examples. In Informatica. [find](https://scholar.google.com/scholar?q=R%2E+Basili%2C+M%2E+Cammisa%2C+and+A%2E+Moschitti%2E+2006%2E+A+semantic+kernel+to+classify+texts+with+very+few+training+examples%2E+In+Informatica%2E)
7. S. Bloehdorn and A. Moschitti. 2007a. Combined syntactic and semantic kernels for text classification. In ECIR. [find](https://scholar.google.com/scholar?q=S%2E+Bloehdorn+and+A%2E+Moschitti%2E+2007a%2E+Combined+syntactic+and+semantic+kernels+for+text+classification%2E+In+ECIR%2E)
8. S. Bloehdorn and A. Moschitti. 2007b. Structure and semantics for expressive text kernels. In Proc. of CIKM ’07. [find](https://scholar.google.com/scholar?q=S%2E+Bloehdorn+and+A%2E+Moschitti%2E+2007b%2E+Structure+and+semantics+for+expressive+text+kernels%2E+In+Proc%2E+of+CIKM+%E2%80%9907%2E)
9. S. Bloehdorn, R. Basili, M. Cammisa, and A. Moschitti. 2006. Semantic kernels for text classification based on topological measures of feature similarity. In Proc. of ICDM 06, Hong Kong, 2006. [find](https://scholar.google.com/scholar?q=S%2E+Bloehdorn%2C+R%2E+Basili%2C+M%2E+Cammisa%2C+and+A%2E+Moschitti%2E+2006%2E+Semantic+kernels+for+text+classification+based+on+topological+measures+of+feature+similarity%2E+In+Proc%2E+of+ICDM+06%2C+Hong+Kong%2C+2006%2E)
10. J. Bos and K. Markert. 2005. [Recognising textual entailment with logical inference](https://md.research.elamur.ai/free/en/papers/bos-2005-recognising-textual-entailment-logical-inference/). In HLT ’05: Proc. of the conference on HLT and EMNLP.
11. A. Burchardt, N. Reiter, S. Thater, and A. Frank. 2007. Semantic Approach to Textual Entailment: System Evaluation and Task Analysis. In Proc. of the 3rd-PASCAL Workshop on Textual Entailment, Prague. [find](https://scholar.google.com/scholar?q=A%2E+Burchardt%2C+N%2E+Reiter%2C+S%2E+Thater%2C+and+A%2E+Frank%2E+2007%2E+Semantic+Approach+to+Textual+Entailment%3A+System+Evaluation+and+Task+Analysis%2E+In+Proc%2E+of+the+3rd%2DPASCAL+Workshop+on+Textual+Entailment%2C+Prague%2E)
12. Y. S. Chan and H. T. Ng. 2005. Word sense disambiguation with distribution estimation. In Proc. of IJCAI’05. [find](https://scholar.google.com/scholar?q=Y%2E+S%2E+Chan+and+H%2E+T%2E+Ng%2E+2005%2E+Word+sense+disambiguation+with+distribution+estimation%2E+In+Proc%2E+of+IJCAI%E2%80%9905%2E)
13. Eugene Charniak. 2000. [A maximum-entropy-inspired parser](https://md.research.elamur.ai/free/en/papers/charniak-2000-maximum-entropy-inspired-parser/). In Proc. of the 1st NAACL conference.
14. M. Collins and N. Duffy. 2002. New ranking algorithms for parsing and tagging: kernels over discrete structures, and the voted perceptron. In Proc. of ACL ’02. [find](https://scholar.google.com/scholar?q=M%2E+Collins+and+N%2E+Duffy%2E+2002%2E+New+ranking+algorithms+for+parsing+and+tagging%3A+kernels+over+discrete+structures%2C+and+the+voted+perceptron%2E+In+Proc%2E+of+ACL+%E2%80%9902%2E)
15. N. Cristianini and R. Holloway. 2001. Latent semantic kernels. [↗](https://doi.org/10.1023/a:1013625426931)
16. G. Dinu and R. Wang. 2009. Inference rules and their application to recognizing textual entailment. In Proc. of the EACL ’09. [find](https://scholar.google.com/scholar?q=G%2E+Dinu+and+R%2E+Wang%2E+2009%2E+Inference+rules+and+their+application+to+recognizing+textual+entailment%2E+In+Proc%2E+of+the+EACL+%E2%80%9909%2E)
17. D. Giampiccolo, B. Magnini, Ido Dagan, and B. Dolan. 2007. The third pascal recognizing textual entailment challenge. In Proc. of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing. [find](https://scholar.google.com/scholar?q=D%2E+Giampiccolo%2C+B%2E+Magnini%2C+Ido+Dagan%2C+and+B%2E+Dolan%2E+2007%2E+The+third+pascal+recognizing+textual+entailment+challenge%2E+In+Proc%2E+of+the+ACL%2DPASCAL+Workshop+on+Textual+Entailment+and+Paraphrasing%2E)
18. Claudio Giuliano. 2007. jLSI a for latent semantic indexing. [http://tcc.itc.it/research/textec/tools-resources/jLSI.html](http://tcc.itc.it/research/textec/tools-resources/jLSI.html). [↗](http://tcc.itc.it/research/textec/tools-resources/jLSI.html)
19. A. D. Haghighi, A. Y. Ng, and C. D. Manning. 2005. Robust textual inference via graph matching. In HLT ’05: Proc. of the conference on HLT and EMNLP. [find](https://scholar.google.com/scholar?q=A%2E+D%2E+Haghighi%2C+A%2E+Y%2E+Ng%2C+and+C%2E+D%2E+Manning%2E+2005%2E+Robust+textual+inference+via+graph+matching%2E+In+HLT+%E2%80%9905%3A+Proc%2E+of+the+conference+on+HLT+and+EMNLP%2E)
20. David Haussler. 1999. Convolution kernels on discrete structures. Technical report. [find](https://scholar.google.com/scholar?q=David+Haussler%2E+1999%2E+Convolution+kernels+on+discrete+structures%2E+Technical+report%2E)
21. J. J. Jiang and D. W. Conrath. 1997. Semantic similarity based on corpus statistics and lexical taxonomy. In Proc. of the 10th ROCLING. [↗](https://doi.org/10.48550/arxiv.cmp-lg/9709008)
22. Thorsten Joachims. 1999. Making large-scale support vector machine learning practical. [↗](https://doi.org/10.7551/mitpress/1130.003.0015)
23. Landauer, Foltz, and Laham. 1998. Introduction to latent semantic analysis. In Discourse Processes 25. [find](https://scholar.google.com/scholar?q=Landauer%2C+Foltz%2C+and+Laham%2E+1998%2E+Introduction+to+latent+semantic+analysis%2E+In+Discourse+Processes+25%2E)
24. D. Lin and P. Pantel. 2001. DIRT-discovery of inference rules from text. In Proc. of the ACM KDD-01. [find](https://scholar.google.com/scholar?q=D%2E+Lin+and+P%2E+Pantel%2E+2001%2E+DIRT%2Ddiscovery+of+inference+rules+from+text%2E+In+Proc%2E+of+the+ACM+KDD%2D01%2E)
25. R. Mihalcea, C. Corley, and C. Strapparava. 2006. Corpus-based and knowledge-based measures of text semantic similarity. In Proc. of AAAI06. [find](https://scholar.google.com/scholar?q=R%2E+Mihalcea%2C+C%2E+Corley%2C+and+C%2E+Strapparava%2E+2006%2E+Corpus%2Dbased+and+knowledge%2Dbased+measures+of+text+semantic+similarity%2E+In+Proc%2E+of+AAAI06%2E)
26. Alessandro Moschitti. 2006. Making tree kernels practical for natural language learning. In Proc. of EACL. [find](https://scholar.google.com/scholar?q=Alessandro+Moschitti%2E+2006%2E+Making+tree+kernels+practical+for+natural+language+learning%2E+In+Proc%2E+of+EACL%2E)
27. Peter Norvig. 1987. A unified theory of inference for text understanding. Technical report, USA. [find](https://scholar.google.com/scholar?q=Peter+Norvig%2E+1987%2E+A+unified+theory+of+inference+for+text+understanding%2E+Technical+report%2C+USA%2E)
28. Sebastian Padó, 2006. User’s guide to sigf: Significance testing by approximate randomisation. [find](https://scholar.google.com/scholar?q=Sebastian+Pado%CC%81%2C+2006%2E+User%E2%80%99s+guide+to+sigf%3A+Significance+testing+by+approximate+randomisation%2E)
29. T. Pedersen, S. Patwardhan, and J. Michelizzi. 2004. Wordnet::similarity - measuring the relatedness of concepts. In Proc. of 5th NAACL. [find](https://scholar.google.com/scholar?q=T%2E+Pedersen%2C+S%2E+Patwardhan%2C+and+J%2E+Michelizzi%2E+2004%2E+Wordnet%3A%3Asimilarity+%2D+measuring+the+relatedness+of+concepts%2E+In+Proc%2E+of+5th+NAACL%2E)
30. D. Roth and M. Sammons. 2007. Semantic and logical inference model for textual entailment. In Proc. of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing. [find](https://scholar.google.com/scholar?q=D%2E+Roth+and+M%2E+Sammons%2E+2007%2E+Semantic+and+logical+inference+model+for+textual+entailment%2E+In+Proc%2E+of+the+ACL%2DPASCAL+Workshop+on+Textual+Entailment+and+Paraphrasing%2E)
31. I. Szpektor and I. Dagan. 2008. Learning entailment rules for unary templates. In Proc. of COLING ’08. [find](https://scholar.google.com/scholar?q=I%2E+Szpektor+and+I%2E+Dagan%2E+2008%2E+Learning+entailment+rules+for+unary+templates%2E+In+Proc%2E+of+COLING+%E2%80%9908%2E)
32. M. Tatu and D. Moldovan. 2005. A semantic approach to recognizing textual entailment. In HLT ’05: Proc. of HLT/EMNLP. [find](https://scholar.google.com/scholar?q=M%2E+Tatu+and+D%2E+Moldovan%2E+2005%2E+A+semantic+approach+to+recognizing+textual+entailment%2E+In+HLT+%E2%80%9905%3A+Proc%2E+of+HLT%2FEMNLP%2E)
33. Z. Wu and M. Palmer. 1994. [Verb semantics and lexical selection](https://md.research.elamur.ai/free/en/papers/wu-1994-verb-semantics-lexical-selection/). In Proc. of ACL. [↗](https://doi.org/10.48550/arxiv.cmp-lg/9406033)
34. Alexander Yeh. 2000. More accurate tests for the statistical significance of result differences. In Proc. of ACL 2000, Morristown, NJ, USA. [↗](https://doi.org/10.48550/arxiv.cs/0008005)
35. F. M. Zanzotto and A. Moschitti. 2006. Automatic learning of textual entailments with cross-pair similarities. In Proc. of ACL ’06. [find](https://scholar.google.com/scholar?q=F%2E+M%2E+Zanzotto+and+A%2E+Moschitti%2E+2006%2E+Automatic+learning+of+textual+entailments+with+cross%2Dpair+similarities%2E+In+Proc%2E+of+ACL+%E2%80%9906%2E)
36. F. M. Zanzotto, M. Pennacchiotti, and A. Moschitti. 2009. A machine learning approach to textual entailment recognition. NATURAL LANGUAGE ENGI-NEERING. [↗](https://doi.org/10.1017/s1351324909990143)

*Updated 24 October 2026*