--- title: "Semantic Inference at the Lexical-Syntactic — Bar-Haim 2007" description: "The paper proposes a proof system for textual entailment that works directly on dependency trees. Entailment rules, manual or acquired from WordNet and…" authors: ["Roy Bar-Haim", "Ido Dagan", "Iddo Greental", "Idan Szpektor", "Moshe Friedman"] year: 2007 venue: "Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing" source: "https://aclanthology.org/W07-1422/" doi: "10.3115/1654536.1654563" licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)" licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/haim-2007-semantic-inference-lexical-syntactic-level/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/haim-2007-semantic-inference-lexical-syntactic-level/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2007](https://md.research.elamur.ai/free/en/papers/2007/) / Semantic Inference at the Lexical-Syntactic Level for Textual Entailment Recognition # Semantic Inference at the Lexical-Syntactic Level for Textual Entailment Recognition **Authors:** [Roy Bar-Haim](https://md.research.elamur.ai/free/en/authors/roy-bar-haim/), [Ido Dagan](https://md.research.elamur.ai/free/en/authors/ido-dagan/), Iddo Greental, [Idan Szpektor](https://md.research.elamur.ai/free/en/authors/idan-szpektor/) and Moshe Friedman · **Year:** 2007 · **Venue:** Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing **Link:** [aclanthology.org/W07-1422](https://aclanthology.org/W07-1422/) · **Licence:** [CC BY-NC-SA 3.0](https://creativecommons.org/licenses/by-nc-sa/3.0/) (ACL Anthology, before 2016) — summary only [**33** citations](https://openalex.org/works?filter=cites:W1976871717) OpenAlex · 2026-10-14 · [**6** citations in our library](https://md.research.elamur.ai/free/en/papers/haim-2007-semantic-inference-lexical-syntactic-level/cited-by/) of the 140884 papers whose bibliographies we read · [Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing](https://aclanthology.org/volumes/W07-14/) · [licence](https://creativecommons.org/licenses/by-nc-sa/3.0/) - [Publisher's page](https://aclanthology.org/W07-1422/) - [PDF](https://aclanthology.org/W07-1422.pdf) - [DOI 10.3115/1654536.1654563](https://doi.org/10.3115/1654536.1654563) - [OpenAlex](https://openalex.org/W1976871717) **Authors (5)** 1. Roy Bar-Haim 2. [Ido Dagan](https://openalex.org/A5033006575) [ORCID](https://orcid.org/0000-0003-3415-3374) · [Semantic Scholar](https://www.semanticscholar.org/author/7465342) · h 59 · 16076 citations · 427 works 3. [Iddo Greental](https://openalex.org/A5058244094) [Semantic Scholar](https://www.semanticscholar.org/author/1710952) · h 5 · 255 citations · 6 works 4. [Idan Szpektor](https://openalex.org/A5026091724) [ORCID](https://orcid.org/0009-0002-2746-4027) · [Semantic Scholar](https://www.semanticscholar.org/author/1711977) · h 30 · 2605 citations · 145 works 5. Moshe Friedman [Semantic Scholar](https://www.semanticscholar.org/author/40031551) Citations and author metrics: OpenAlex, 2026-10-14; authors with the same name are not always told apart. ## What it is about The paper proposes a proof system for textual entailment that works directly on dependency trees. Entailment rules, manual or acquired from WordNet and from DIRT-style paraphrase data, rewrite the text tree step by step towards the hypothesis, and a cost function measures the remaining distance when no full proof is found. Proofs are limited to depth four, and the parser is Minipar. On the RTE-3 test set the full system reaches 62.4% accuracy with an optimal threshold, and the lexical-only configuration 62.9%, so the richer rules give no consistent gain. On the development set exact proofs have 92% precision but only 4.3% recall; lexical-syntactic rules fire in about 3% of attempted proofs, and missing world knowledge is the main cause of failure. ## Ideas - I1. `en/src/morph.rs` and the tree code: a small rule base in the paper's form, a left template matched on a UD tree, a right template generated, and alignment rules that copy the modifiers. Start with the passive-to-active rule and check it on tree pairs built from the school lessons. - I2. Negation and modality as annotation rules: they set features on nodes and block later rewrites (for example under "never"). Measure how many false entailments appear when the blocking is switched off, on a small negative control set. - I3. Report exact-proof precision and recall separately, and use a cost threshold only when no proof is found, as the paper does. This keeps every "yes" traceable to the rules that produced it. - I4. A polarity column for complement-taking verbs: "know that p" licenses p in a positive context, "believe that p" does not. Put the list in the complementation chapter and test it on paired sentences. ## For Mova The chapters are [languages/en/28-voice-and-passive.md](https://mova.elamur.ai/free/en/docs/languages/en/28-voice-and-passive/) (the passive rule), [languages/en/27-negation.md](https://mova.elamur.ai/free/en/docs/languages/en/27-negation/) (negation and polarity) and [languages/en/23-complementation.md](https://mova.elamur.ai/free/en/docs/languages/en/23-complementation/) (complement polarity). The code is in `prag/src/infer.rs` and `world/src/qa.rs`. Measure exact-proof precision and recall on a held-out set of pairs, and run it twice to check determinism. ## Cite The paper itself, not this card. BibTeX from the library's record of the work. [DOI 10.3115/1654536.1654563](https://doi.org/10.3115/1654536.1654563) ```bibtex @inproceedings{barhaim2007semantic, title = {{Semantic Inference at the Lexical-Syntactic Level for Textual Entailment Recognition}}, author = {Bar-Haim, Roy and Dagan, Ido and Greental, Iddo and Szpektor, Idan and Friedman, Moshe}, booktitle = {Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing}, year = {2007}, doi = {10.3115/1654536.1654563}, url = {https://doi.org/10.3115/1654536.1654563} } ``` - [← previous Semantic Composition with (Robust) Minimal Recursion Semantics](https://md.research.elamur.ai/free/en/papers/aclbulk-2007-copestake-semantic-composition-robust-minimal-recursion/) - [next → SemEval-2007 Task 07: Coarse-Grained English All-Words Task](https://md.research.elamur.ai/free/en/papers/navigli-2007-semeval-2007-task-07-coarse/) - [↑ back to papers of 2007](https://md.research.elamur.ai/free/en/papers/2007/) ## References 10 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Roy Bar-Haim, Ido Dagan, Iddo Greental, and Eyal Shnarch. 2007. Semantic inference at the lexical-syntactic level. In AAAI (to appear). [find](https://scholar.google.com/scholar?q=Roy+Bar%2DHaim%2C+Ido+Dagan%2C+Iddo+Greental%2C+and+Eyal+Shnarch%2E+2007%2E+Semantic+inference+at+the+lexical%2Dsyntactic+level%2E+In+AAAI+%28to+appear%29%2E) 2. Christiane Fellbaum, editor. 1998. WordNet: An Electronic Lexical Database. Language, Speech and Communication. MIT Press. [find](https://scholar.google.com/scholar?q=Christiane+Fellbaum%2C+editor%2E+1998%2E+WordNet%3A+An+Electronic+Lexical+Database%2E+Language%2C+Speech+and+Communication%2E+MIT+Press%2E) 3. Dekang Lin and Patrik Pantel. 2001. Discovery of inference rules for question answering. Natural Language Engineering, 4(7):343–360. [find](https://scholar.google.com/scholar?q=Dekang+Lin+and+Patrik+Pantel%2E+2001%2E+Discovery+of+inference+rules+for+question+answering%2E+Natural+Language+Engineering%2C+4%287%29%3A343%E2%80%93360%2E) 4. Dekang Lin. 1998a. Automatic retrieval and clustering of similar words. In Proceedings of COLING/ACL. [find](https://scholar.google.com/scholar?q=Dekang+Lin%2E+1998a%2E+Automatic+retrieval+and+clustering+of+similar+words%2E+In+Proceedings+of+COLING%2FACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/lin-1998-automatic-retrieval-clustering-similar-words/) 5. Dekang Lin. 1998b. Dependency-based evaluation of minipar. In Proceedings of the Workshop on Evaluation of Parsing Systems at LREC. [find](https://scholar.google.com/scholar?q=Dekang+Lin%2E+1998b%2E+Dependency%2Dbased+evaluation+of+minipar%2E+In+Proceedings+of+the+Workshop+on+Evaluation+of+Parsing+Systems+at+LREC%2E) 6. C. Macleod, R. Grishman, A. Meyers, L. Barrett, and R. Reeves. 1998. Nomlex: A lexicon of nominalizations. In EURALEX. [find](https://scholar.google.com/scholar?q=C%2E+Macleod%2C+R%2E+Grishman%2C+A%2E+Meyers%2C+L%2E+Barrett%2C+and+R%2E+Reeves%2E+1998%2E+Nomlex%3A+A+lexicon+of+nominalizations%2E+In+EURALEX%2E) 7. Ruslan Mitkov, Richard Evans, and Constantin Orasan. 2002. A new, fully automatic version of Mitkov’s knowledge-poor pronoun resolution method. In Proceedings of CICLing. [find](https://scholar.google.com/scholar?q=Ruslan+Mitkov%2C+Richard+Evans%2C+and+Constantin+Orasan%2E+2002%2E+A+new%2C+fully+automatic+version+of+Mitkov%E2%80%99s+knowledge%2Dpoor+pronoun+resolution+method%2E+In+Proceedings+of+CICLing%2E) 8. Rowan Nairn, Cleo Condoravdi, and Lauri Karttunen. 2006. Computing relative polarity for textual inference. In Proceedings of ICoS-5. [find](https://scholar.google.com/scholar?q=Rowan+Nairn%2C+Cleo+Condoravdi%2C+and+Lauri+Karttunen%2E+2006%2E+Computing+relative+polarity+for+textual+inference%2E+In+Proceedings+of+ICoS%2D5%2E) [our card](https://md.research.elamur.ai/free/en/papers/lingbulk-2006-nairn-computing-relative-polarity-textual-inference/) 9. Jeffrey C. Reynar and Adwait Ratnaparkhi. 1997. A maximum entropy approach to identifying sentence boundaries. In Proceedings of ANLP. [find](https://scholar.google.com/scholar?q=Jeffrey+C%2E+Reynar+and+Adwait+Ratnaparkhi%2E+1997%2E+A+maximum+entropy+approach+to+identifying+sentence+boundaries%2E+In+Proceedings+of+ANLP%2E) [our card](https://md.research.elamur.ai/free/en/papers/reynar-1997-maximum-entropy-approach-identifying-sentence/) 10. Tal Ron. 2006. Generating entailment rules based on online lexical resources. Master’s thesis, Computer Science Department, Bar-Ilan University, Ramat-Gan, Israel. [find](https://scholar.google.com/scholar?q=Tal+Ron%2E+2006%2E+Generating+entailment+rules+based+on+online+lexical+resources%2E+Master%E2%80%99s+thesis%2C+Computer+Science+Department%2C+Bar%2DIlan+University%2C+Ramat%2DGan%2C+Israel%2E)