--- title: "Hypothesis Transformation and Semantic Variability Rules Used" description: "The paper describes a system from Iasi built for the RTE-3 textual entailment… 0.6913 accuracy. 5 references, cited by 11 papers here." authors: ["Adrian Iftene", "Alexandra Balahur-Dobrescu"] year: 2007 venue: "Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing" source: "https://aclanthology.org/W07-1421/" licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)" licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/iftene-2007-hypothesis-transformation-semantic-variability-rules/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/iftene-2007-hypothesis-transformation-semantic-variability-rules/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2007](https://md.research.elamur.ai/free/en/papers/2007/) / Hypothesis Transformation and Semantic Variability Rules Used in Recognizing Textual Entailment # Hypothesis Transformation and Semantic Variability Rules Used in Recognizing Textual Entailment **Authors:** Adrian Iftene and Alexandra Balahur-Dobrescu · **Year:** 2007 · **Venue:** [Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing](https://md.research.elamur.ai/free/en/venues/acl-pascal-workshop-on-textual-entailment-and-paraphrasing/) ([ACL-PASCAL Workshop on Textual Entailment and Paraphrasing 2007](https://md.research.elamur.ai/free/en/venues/acl-pascal-workshop-on-textual-entailment-and-paraphrasing/2007/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/) **Links:** [Publisher's page](https://aclanthology.org/W07-1421/) · [PDF](https://aclanthology.org/W07-1421.pdf) · [OpenAlex](https://openalex.org/W2065249013) **Citations:** 46 citations (OpenAlex, 2026-10-14) · [11](https://md.research.elamur.ai/free/en/papers/iftene-2007-hypothesis-transformation-semantic-variability-rules/cited-by/) in our library, of the 149,439 papers whose bibliographies we read ## Summary The paper describes a system from Iasi built for the RTE-3 textual entailment challenge. The task is to decide whether a hypothesis can be inferred from a text. Both sentences are parsed into dependency trees with MINIPAR, and named entities are tagged with LingPipe. The method starts from tree edit distance, but instead of scoring raw differences it first rewrites the hypothesis tree so it looks more like the text tree. The rewriting draws on several sources: - DIRT paraphrase templates for verbs, - Extended WordNet synonyms for other words, - an acronym database, - background knowledge mined semi-automatically from Wikipedia for named entities and numbers. Each hypothesis node then gets a combined fitness score from four parts: its own mapping, its parent's mapping, edge-label agreement and left/right position. A count of negation and certainty markers can flip the score. A threshold tuned on development data turns the final score into a yes/no decision. The system reached 0.6913 accuracy, with QA pairs easiest and IE pairs hardest. Ablation showed that named-entity checking contributes most. The work shows how far explicit, inspectable tree transformations with lexical resources can go on entailment. ## Key points - Pipeline: MINIPAR dependency parsing and LingPipe NER, then a core module that uses DIRT, WordNet (Extended WordNet), an acronym list and Wikipedia-derived background knowledge. It runs on a peer-to-peer distributed setup to save time. - Each node's extended local fitness has four components and a maximum of 4. Total fitness is averaged over the hypothesis nodes. A negation value (the share of non-negated verbs) blends that total with its complement, 4 − TF. The decision threshold is 2.06. - If a named entity in the hypothesis cannot be mapped to the text, even after acronym and background-knowledge lookup, the system answers "no entailment" outright. - Both submitted runs scored 0.6913 overall. Per task: IE 0.57, IR about 0.69, QA about 0.87, SUM about 0.64. - Ablation (accuracy without each component): | Component removed | Accuracy | Drop | |---|---|---| | Named entities | 0.5758 | 16.71% | | Negations | 0.6763 | 2.17% | | Background knowledge | — | 2.00% | | WordNet | — | 1.63% | | Acronyms | — | 1.08% | | DIRT | — | 0.54% | ## Interesting ideas - Rewrite the hypothesis toward the text with DIRT verb templates. When the relation slots cross, as with passive "attacked by" versus active subject/object, swap the argument subtrees, which normalizes voice before any comparison. - Each node is identified by a triple of its lemma, its parent's lemma and its edge label. This separates repeated words, such as the same name acting as subject in one place and object in another. - Edge agreement is checked by looking for the hypothesis edge label anywhere on the path between the mapped text nodes. The penalty grows with path length or applies when the label is absent, which tolerates extra intervening structure. - Negation is treated as parity over markers found below a verb (not, modals and similar). A special rule covers infinitives: words like "allow", "necessary" or "attempt" before "to" keep the action certain, while other contexts weaken it. Hand-built lists of certainty-raising and certainty-lowering words support this. - Remove one component at a time and measure the accuracy drop. Combine this with a hard veto when a named entity cannot be grounded. The veto proved by far the most valuable signal. ## For Mova How these ideas could serve Mova, our small open language model — its files, stages and tests: - **I1** (frames): Frame building could apply the same slot-alignment step so that passive and active paraphrases reach identical who-did-what-to-whom frames, with the template used recorded as the explanation. - **I2** (world): Entity and mention bookkeeping could key on this triple to keep distinct roles of the same lemma apart when filling the world of a text. - **I3** (answer): A reader that matches a question tree against a story tree could use path-based edge matching with graded penalties instead of demanding exact adjacency. - **I4** (frames): Speech-act and modality handling could attach a certainty flag to each event frame using such trigger lists, so later steps know whether an event actually happened. - **I5** (learn): Evaluation could routinely run leave-one-resource-out ablations as a negative control, revealing which knowledge sources really carry the answers. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [Alexandru Ioan Cuza University](https://md.research.elamur.ai/free/en/universities/alexandru-ioan-cuza-university/) — University, Iași, Romania · 8 works · 402 citations 📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works 🧭 Topics (1): [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 1,426 works ## Cite Cite as: Adrian Iftene and Alexandra Balahur-Dobrescu. 2007. Hypothesis Transformation and Semantic Variability Rules Used in Recognizing Textual Entailment. Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{iftene2007hypothesis, title = {{Hypothesis Transformation and Semantic Variability Rules Used in Recognizing Textual Entailment}}, author = {Adrian Iftene and Alexandra Balahur-Dobrescu}, booktitle = {Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing}, year = {2007}, doi = {10.3115/1654536.1654562}, url = {https://doi.org/10.3115/1654536.1654562} } ``` - [← previous Determining Case in Arabic: Learning Complex Linguistic Behavior Requires Complex Linguistic Features](https://md.research.elamur.ai/free/en/papers/habash-2007-determining-case-arabic-learning-complex/) - [next → A Multidimensional Approach to Utterance Segmentation and Dialogue Act Classification](https://md.research.elamur.ai/free/en/papers/geertzen-2007-multidimensional-approach-utterance-segmentation-dialogue/) - [↑ back to papers of 2007](https://md.research.elamur.ai/free/en/papers/2007/) ## References 5 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Dagan, I., Glickman, O., and Magnini, B. 2006. The PASCAL Recognising Textual Entailment Challenge. In Quiñonero-Candela et al., editors, MLCW 2005, LNAI Volume 3944, pages 177-190. Springer-Verlag. [find](https://scholar.google.com/scholar?q=Dagan%2C+I%2E%2C+Glickman%2C+O%2E%2C+and+Magnini%2C+B%2E+2006%2E+The+PASCAL+Recognising+Textual+Entailment+Challenge%2E+In+Qui%C3%B1onero%2DCandela+et+al%2E%2C+editors%2C+MLCW+2005%2C+LNAI+Volume+3944%2C+pages+177%2D190%2E+Springer%2DVerlag%2E) 2. Fellbaum, C. 1998. WordNet: An Electronic Lexical Database. MIT Press, Cambridge, Mass. [find](https://scholar.google.com/scholar?q=Fellbaum%2C+C%2E+1998%2E+WordNet%3A+An+Electronic+Lexical+Database%2E+MIT+Press%2C+Cambridge%2C+Mass%2E) 3. Kouylekov, M. and Magnini, B. 2005. Recognizing Textual Entailment with Tree Edit Distance Algorithms. In Proceedings of the First Challenge Workshop Recognising Textual Entailment, Pages 17-20, 25–28 April, 2005, Southampton, U.K. [find](https://scholar.google.com/scholar?q=Kouylekov%2C+M%2E+and+Magnini%2C+B%2E+2005%2E+Recognizing+Textual+Entailment+with+Tree+Edit+Distance+Algorithms%2E+In+Proceedings+of+the+First+Challenge+Workshop+Recognising+Textual+Entailment%2C+Pages+17%2D20%2C+25%E2%80%9328) 4. Lin, D. 1998. Dependency-based Evaluation of MINIPAR. In Workshop on the Evaluation of Parsing Systems, Granada, Spain, May, 1998. [find](https://scholar.google.com/scholar?q=Lin%2C+D%2E+1998%2E+Dependency%2Dbased+Evaluation+of+MINIPAR%2E+In+Workshop+on+the+Evaluation+of+Parsing+Systems%2C+Granada%2C+Spain%2C+May%2C+1998%2E) 5. Lin, D., and Pantel, P. 2001. DIRT - Discovery of Inference Rules from Text. In Proceedings of ACM Conference on Knowledge Discovery and Data Mining (KDD-01). pp. 323-328. San Francisco, CA. [find](https://scholar.google.com/scholar?q=Lin%2C+D%2E%2C+and+Pantel%2C+P%2E+2001%2E+DIRT+%2D+Discovery+of+Inference+Rules+from+Text%2E+In+Proceedings+of+ACM+Conference+on+Knowledge+Discovery+and+Data+Mining+%28KDD%2D01%29%2E+pp%2E+323%2D328%2E+San+Francisco%2C+CA%2E) *Updated 30 October 2026*