--- title: "Dependency-based paraphrasing for recognizing — Marsi 2007" description: "The paper applies DIRT paraphrases, derived from about 1 GB of newspaper text, to the Minipar dependency trees of RTE-3 text. A paraphrase is applied only…" authors: ["Erwin Marsi", "Emiel Krahmer", "Wauter Bosma"] year: 2007 venue: "Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing" source: "https://aclanthology.org/W07-1414/" doi: "10.3115/1654536.1654554" licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)" licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/marsi-2007-dependency-based-paraphrasing-recognizing-textual/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/marsi-2007-dependency-based-paraphrasing-recognizing-textual/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2007](https://md.research.elamur.ai/free/en/papers/2007/) / Dependency-based paraphrasing for recognizing textual entailment # Dependency-based paraphrasing for recognizing textual entailment **Authors:** [Erwin Marsi](https://md.research.elamur.ai/free/en/authors/erwin-marsi/), [Emiel Krahmer](https://md.research.elamur.ai/free/en/authors/emiel-krahmer/) and Wauter Bosma · **Year:** 2007 · **Venue:** Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing **Link:** [aclanthology.org/W07-1414](https://aclanthology.org/W07-1414/) · **Licence:** [CC BY-NC-SA 3.0](https://creativecommons.org/licenses/by-nc-sa/3.0/) (ACL Anthology, before 2016) — summary only [**29** citations](https://openalex.org/works?filter=cites:W2117301214) OpenAlex · 2026-10-14 · [**6** citations in our library](https://md.research.elamur.ai/free/en/papers/marsi-2007-dependency-based-paraphrasing-recognizing-textual/cited-by/) of the 140673 papers whose bibliographies we read · [Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing](https://aclanthology.org/volumes/W07-14/) · [licence](https://creativecommons.org/licenses/by-nc-sa/3.0/) - [Publisher's page](https://aclanthology.org/W07-1414/) - [PDF](https://aclanthology.org/W07-1414.pdf) - [DOI 10.3115/1654536.1654554](https://doi.org/10.3115/1654536.1654554) - [OpenAlex](https://openalex.org/W2117301214) **Authors (3)** 1. [Erwin Marsi](https://openalex.org/A5056067236) [Semantic Scholar](https://www.semanticscholar.org/author/1748039) · h 16 · 2371 citations · 98 works 2. [Emiel Krahmer](https://openalex.org/A5069734813) [ORCID](https://orcid.org/0000-0002-6304-7549) · [Semantic Scholar](https://www.semanticscholar.org/author/1404704044) · h 49 · 10841 citations · 599 works 3. [Wauter Bosma](https://openalex.org/A5078971564) [Semantic Scholar](https://www.semanticscholar.org/author/2215716) · h 11 · 424 citations · 54 works Citations and author metrics: OpenAlex, 2026-10-14; authors with the same name are not always told apart. ## What it is about The paper applies DIRT paraphrases, derived from about 1 GB of newspaper text, to the Minipar dependency trees of RTE-3 text. A paraphrase is applied only when the source path occurs in the text and the translation path occurs in the hypothesis, so the rewrite moves the text closer to the hypothesis. Of 38,207 text nodes, 6,173 have a paraphrase with the same lemma, 2,211 match a source path, and only 228 are actually substituted; about one text sentence in six is changed, and more often in true pairs than in false ones. The effect on the simple alignment-based RTE system is small: overall accuracy on the development set rises from 66.9 to 68.2 and on the test set from 58.6 to 59.1. Most paraphrases concern verbs, and the authors note that many required paraphrases are missing and that some DIRT rules are false. ## Ideas - I1. Keep the double constraint of the paper as a gate: accept a rewrite only if the source occurs in the text and the target occurs in the hypothesis. Put this in `prag/src/infer.rs` for every paraphrase table, and measure the dev gain, run twice. - I2. Report paraphrase coverage by word class, as the paper's Table 1 does. Mova can see where its lexicon lacks nouns and adjectives, using the word-class chapter [languages/en/10-word-classes.md](https://mova.elamur.ai/free/en/docs/languages/en/10-word-classes/). - I3. Audit the rules for direction: the paper's examples "X feeds Y entails Y feeds X" show symmetric errors. Mark which pairs are symmetric and check them against the dictionary in the dictionary builder. - I4. Use the count of applied rewrites per pair as a feature for a decision list, instead of a hard decision, and check whether it separates true from false pairs on the school lessons. ## For Mova The chapters are [languages/en/19-lexicon-mwe-register.md](https://mova.elamur.ai/free/en/docs/languages/en/19-lexicon-mwe-register/) and [languages/en/10-word-classes.md](https://mova.elamur.ai/free/en/docs/languages/en/10-word-classes/). The code is `prag/src/infer.rs` and the dictionary the dictionary builder. Any paraphrase resource must have its licence checked in [licence/DATA.md](https://mova.elamur.ai/free/en/docs/licence/DATA/) before it is used in a build. The measure is dev accuracy with and without the gate, run twice. ## Cite The paper itself, not this card. BibTeX from the library's record of the work. [DOI 10.3115/1654536.1654554](https://doi.org/10.3115/1654536.1654554) ```bibtex @inproceedings{marsi2007dependency, title = {{Dependency-based paraphrasing for recognizing textual entailment}}, author = {Marsi, Erwin and Krahmer, Emiel and Bosma, Wauter}, booktitle = {Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing}, year = {2007}, doi = {10.3115/1654536.1654554}, url = {https://doi.org/10.3115/1654536.1654554} } ``` - [← previous Dependency-Based Construction of Semantic Space Models](https://md.research.elamur.ai/free/en/papers/pado-2007-dependency-based-construction-semantic-space/) - [next → ElixirFM – Implementation of Functional Arabic Morphology](https://md.research.elamur.ai/free/en/papers/aclbulk-2007-smrz-elixirfm-implementation-functional-arabic-morphology/) - [↑ back to papers of 2007](https://md.research.elamur.ai/free/en/papers/2007/) ## References 11 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. R. Bar-Haim, I. Dagan, B. Dolan, L. Ferro, D. Giampiccolo, B. Magnini, and I. Szpektor. 2006. The second pascal recognising textual entailment challenge. In Proceedings of the Second PASCAL Challenges Workshop on Recognising Textual Entailment, pages 1–9, Venice, Italy. [find](https://scholar.google.com/scholar?q=R%2E+Bar%2DHaim%2C+I%2E+Dagan%2C+B%2E+Dolan%2C+L%2E+Ferro%2C+D%2E+Giampiccolo%2C+B%2E+Magnini%2C+and+I%2E+Szpektor%2E+2006%2E+The+second+pascal+recognising+textual+entailment+challenge%2E+In+Proceedings+of+the+Second+PASCAL+Challenges) 2. W. Bosma and C. Callison-Burch. 2006. Paraphrase substitution for recognizing textual entailment. In Proceedings of CLEF. [find](https://scholar.google.com/scholar?q=W%2E+Bosma+and+C%2E+Callison%2DBurch%2E+2006%2E+Paraphrase+substitution+for+recognizing+textual+entailment%2E+In+Proceedings+of+CLEF%2E) 3. R. de Salvo Braz, R. Girju, V. Punyakanok, D. Roth, and M. Sammons. 2005. An inference model for semantic entailemnt in natural language. In Proceedings of the First Pascal Challenge Workshop on Recognizing Textual Entailment, pages 29–32. [find](https://scholar.google.com/scholar?q=R%2E+de+Salvo+Braz%2C+R%2E+Girju%2C+V%2E+Punyakanok%2C+D%2E+Roth%2C+and+M%2E+Sammons%2E+2005%2E+An+inference+model+for+semantic+entailemnt+in+natural+language%2E+In+Proceedings+of+the+First+Pascal+Challenge+Workshop+on+Recog) 4. A. Hickl, J. Williams, J. Bensley, K. Roberts, B. Rink, and Y. Shi. 2006. Recognizing textual entailment with lccs groundhog system. In Proceedings of the Second PASCAL Challenges Workshop on Recognising Textual Entailment, pages 80–85, Venice, Italy. [find](https://scholar.google.com/scholar?q=A%2E+Hickl%2C+J%2E+Williams%2C+J%2E+Bensley%2C+K%2E+Roberts%2C+B%2E+Rink%2C+and+Y%2E+Shi%2E+2006%2E+Recognizing+textual+entailment+with+lccs+groundhog+system%2E+In+Proceedings+of+the+Second+PASCAL+Challenges+Workshop+on+Recognis) 5. Dekang Lin and Patrick Pantel. 2001. Discovery of inference rules for question answering. Natural Language Engineering, 7(4):343–360. [↗](https://doi.org/10.1017/s1351324901002765) 6. Dekang Lin. 1998. Dependency-based evaluation of minipar. In Proceedings of the Workshop on Evaluation of Parsing Systems at LREC 1998, pages 317–330, Granada, Spain. [find](https://scholar.google.com/scholar?q=Dekang+Lin%2E+1998%2E+Dependency%2Dbased+evaluation+of+minipar%2E+In+Proceedings+of+the+Workshop+on+Evaluation+of+Parsing+Systems+at+LREC+1998%2C+pages+317%E2%80%93330%2C+Granada%2C+Spain%2E) 7. E. Marsi, E. Krahmer, W. Bosma, and M. Theune. 2006. Normalized alignment of dependency trees for detecting textual entailment. In Proceedings of the Second PASCAL Challenges Workshop on Recognising Textual Entailment, pages 56–61, venice, Italy. [find](https://scholar.google.com/scholar?q=E%2E+Marsi%2C+E%2E+Krahmer%2C+W%2E+Bosma%2C+and+M%2E+Theune%2E+2006%2E+Normalized+alignment+of+dependency+trees+for+detecting+textual+entailment%2E+In+Proceedings+of+the+Second+PASCAL+Challenges+Workshop+on+Recognising+T) 8. Adam Meyers, Roman Yangarber, and Ralph Grisham. 1996. Alignment of shared forests for bilingual corpora. In Proceedings of 16th International Conference on Computational Linguistics (COLING-96), pages 460–465, Copenhagen, Denmark. [find](https://scholar.google.com/scholar?q=Adam+Meyers%2C+Roman+Yangarber%2C+and+Ralph+Grisham%2E+1996%2E+Alignment+of+shared+forests+for+bilingual+corpora%2E+In+Proceedings+of+16th+International+Conference+on+Computational+Linguistics+%28COLING%2D96%29%2C+page) 9. R. Nielsen, W. Ward, and J.H. Martin. 2006. Toward dependency path based entailment. In Proceedings of the Second PASCAL Challenges Workshop on Recognising Textual Entailment, pages 44–49, Venice, Italy. [find](https://scholar.google.com/scholar?q=R%2E+Nielsen%2C+W%2E+Ward%2C+and+J%2EH%2E+Martin%2E+2006%2E+Toward+dependency+path+based+entailment%2E+In+Proceedings+of+the+Second+PASCAL+Challenges+Workshop+on+Recognising+Textual+Entailment%2C+pages+44%E2%80%9349%2C+Venice%2C+Ita) 10. R. Raina, A. Haghighi, C. Cox, J. Finkel, J. Michels, K. Toutanova, B. MacCartney, M.C. de Marneffe, C.D. Manning, and A.Y. Ng. 2005. Robust textual inference using diverse knowledge sources. In Proceedings of PASCAL Recognising Textual Entailment Workshop. [find](https://scholar.google.com/scholar?q=R%2E+Raina%2C+A%2E+Haghighi%2C+C%2E+Cox%2C+J%2E+Finkel%2C+J%2E+Michels%2C+K%2E+Toutanova%2C+B%2E+MacCartney%2C+M%2EC%2E+de+Marneffe%2C+C%2ED%2E+Manning%2C+and+A%2EY%2E+Ng%2E+2005%2E+Robust+textual+inference+using+diverse+knowledge+sources%2E+In+Proce) 11. J. C. Reynar and A. Ratnaparkhi. 1997. A maximum entropy approach to identifying sentence boundaries. In Proceedings of the Fifth Conference on Applied Natural Language Processing, Washington, D.C. buy mod obj by ... pcomp-n ... Baikalfinansgroup mod nn known company whn i be which pred later subj {which} sell mod obj to ... pcomp-n ... Baikalfinansgroup sell s mod obj subj Baikalfinansgroup to {US$ 9.4 billion} {Baikalfinansgroup} mod nn rel pcomp-n known company {fin} Rosneft det whn i mod mod which the Russian be state-owned pred lex-mod lex-mod later - state subj {which} Figure 2: Alignment of paraphrase source to text (top), alignment of paraphrase translation to hypothesis (mid), and alignment of hypothesis to paraphrased text (bottom) for pair 1 from RTE3 dev set buy s mod subj obj by {Baikalfinansgroup} {US$ 9.4 billion} pcomp-n rel {fin} Rosneft det mod mod nn the Russian state-owned oil company lex-mod lex-mod lex-mod state - oil sell s be mod obj be to {Baikalfinansgroup} pcomp-n Rosneft sell s obj be mod Baikalfinansgroup be to {Baikalfinansgroup} nn pcomp-n oil company Rosneft lex-mod oil [find](https://scholar.google.com/scholar?q=J%2E+C%2E+Reynar+and+A%2E+Ratnaparkhi%2E+1997%2E+A+maximum+entropy+approach+to+identifying+sentence+boundaries%2E+In+Proceedings+of+the+Fifth+Conference+on+Applied+Natural+Language+Processing%2C+Washington%2C+D%2EC%2E+bu)