--- title: "Multilingual Coreference Resolution — Harabagiu 2000" description: "The paper asks whether aligned bilingual text can improve identity coreference resolution, the MUC-style task of linking nouns, pronouns and noun phrases…" authors: ["Sanda M. Harabagiu", "Steven J. Maiorano"] year: 2000 venue: "Sixth Applied Natural Language Processing Conference" source: "https://aclanthology.org/A00-1020/" doi: "10.3115/974147.974167" licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)" licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/harabagiu-2000-multilingual-coreference-resolution/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/harabagiu-2000-multilingual-coreference-resolution/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2000](https://md.research.elamur.ai/free/en/papers/2000/) / Multilingual Coreference Resolution # Multilingual Coreference Resolution **Authors:** Sanda M. Harabagiu, Steven J. Maiorano · **Year:** 2000 · **Venue:** Sixth Applied Natural Language Processing Conference · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/) **Links:** [Publisher's page](https://aclanthology.org/A00-1020/) · [PDF](https://aclanthology.org/A00-1020.pdf) · [DOI 10.3115/974147.974167](https://doi.org/10.3115/974147.974167) · [OpenAlex](https://openalex.org/W2093719614) **Citations:** 44 citations (openalex-snapshot · 2026-10-14) · [15](#cited-by) in our library, of the 140673 papers whose bibliographies we read ## Summary The paper asks whether aligned bilingual text can improve identity coreference resolution, the MUC-style task of linking nouns, pronouns and noun phrases to their antecedents. The authors had native speakers produce Romanian translations of the coreference training texts from MUC-6 and MUC-7. Where possible, they reused the English coreference identifiers. Their starting point is COCKTAIL, a knowledge-poor resolver that applies priority-ordered heuristics mined from annotated data. Its training data was enlarged automatically by enumerating every coreference structure that yields the same chain. SWIZZLE extends COCKTAIL. It runs the resolver on both languages and compares the results across aligned expressions. When the resolutions disagree, it adds, reprioritizes or removes heuristics, for example when the antecedents are not translations of each other or one antecedent opens a new chain. Scored with the official MUC scorer, SWIZZLE raised precision in both languages. Recall fell slightly, because unreliable links were discarded. The work matters because translations can supply extra coreference cues: Romanian referential expressions help resolve difficult English cases. ## Key points - Overall precision rose from 84% to 87% for English and from 72% to 76% for Romanian. Overall recall dropped from 78% to 77% for English and from 72% to 70% for Romanian. These figures come from tables that were garbled in the PDF extraction. - Data expansion: the 1,626 MUC-6 and 2,245 MUC-7 coreference relations grew to 6,095,142 and 8,269,403 relations respectively. The authors report an expansion factor of 3,710. Average chain lengths are 7.21 for MUC-6 and 8.57 for MUC-7. - In the ideal case, both antecedents are translations of each other. This held for 63.3% of MUC-6 references and 58.7% of MUC-7 references, and over half of these cases are pronouns or named entities. - COCKTAIL handles five pronoun types and three nominal forms. Its heuristics fall into three classes: strong indicators, semantic consistency checks using WordNet and Treebank statistics, and coercion via morphology, meronyms and hypernyms. - In 64% of cases, the English link was resolved by a higher-priority heuristic than its Romanian counterpart. The authors use this to explain why English precision gained more. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/) Topics: [Coreference resolution](https://md.research.elamur.ai/free/en/topics/coreference-resolution/) ## Cited by Cited by 15 papers of our library cite it (of the 140673 whose bibliographies we read); 7 of them have a page here, 8 not yet. - [Knowledge-lean projection of coreference chains across languages](https://md.research.elamur.ai/free/en/papers/grishina-2015-knowledge-lean-projection-coreference-chains/) - [Transferring Coreference Resolvers with Posterior Regularization](https://md.research.elamur.ai/free/en/papers/martins-2015-transferring-coreference-resolvers-posterior-regularization/) - [Cross-lingual Coreference Resolution of Pronouns](https://md.research.elamur.ai/free/en/papers/novak-2014-cross-lingual-coreference-resolution-pronouns/) - [Creating a Coreference Resolution System for Italian](https://md.research.elamur.ai/free/en/papers/poesio-2010-creating-coreference-resolution-system-italian/) - [Transferring Coreference Chains through Word Alignment](https://md.research.elamur.ai/free/en/papers/postolache-2006-transferring-coreference-chains-through-word/) - [Translation-Based Projection for Multilingual Coreference Resolution](https://md.research.elamur.ai/free/en/papers/rahman-2012-translation-based-projection-multilingual-coreference/) - [UBIU: A Language-Independent System for Coreference Resolution](https://md.research.elamur.ai/free/en/papers/zhekova-2010-ubiu-language-independent-system-coreference/) ## Cite The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{harabagiu2000multilingual, title = {{Multilingual Coreference Resolution}}, author = {Harabagiu, Sanda M. and Maiorano, Steven J.}, booktitle = {Sixth Applied Natural Language Processing Conference}, year = {2000}, doi = {10.3115/974147.974167}, url = {https://doi.org/10.3115/974147.974167} } ``` - [← previous Introduction to the CoNLL-2000 Shared Task Chunking](https://md.research.elamur.ai/free/en/papers/sang-2000-introduction-conll-2000-shared-task/) - [next → Multitiered Nonlinear Morphology Using Multitape Finite Automata: A Case Study on Syriac and Arabic](https://md.research.elamur.ai/free/en/papers/cl-2000-kiraz-multitiered-nonlinear-morphology-multitape-finite/) - [↑ back to papers of 2000](https://md.research.elamur.ai/free/en/papers/2000/) ## References 22 references, 11 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Douglas E. Appelt, Jerry R. Hobbs, John Bear, David Israel, Megumi Kameyama and Mabry Tyson. 1993. The SRI MUC-5 JV-FASTUS Information Extraction System. In Proceedings of the Fifth Message Understanding Conference (MUC-5). [find](https://scholar.google.com/scholar?q=Douglas+E%2E+Appelt%2C+Jerry+R%2E+Hobbs%2C+John+Bear%2C+David+Israel%2C+Megumi+Kameyama+and+Mabry+Tyson%2E+1993%2E+The+SRI+MUC%2D5+JV%2DFASTUS+Information+Extraction+System%2E+In+Proceedings+of+the+Fifth+Message+Understand) 2. Brack Baldwin. 1997. CogNIAC: high precision coreference with limited knowledge and linguistic resources. In Proceedings of the ACL '97/EACL '97 Workshop on Operational factors in practical, robust anaphora resolution, pages 38-45, Madrid, Spain. [find](https://scholar.google.com/scholar?q=Brack+Baldwin%2E+1997%2E+CogNIAC%3A+high+precision+coreference+with+limited+knowledge+and+linguistic+resources%2E+In+Proceedings+of+the+ACL+%2797%2FEACL+%2797+Workshop+on+Operational+factors+in+practical%2C+robust+an) [our card](https://md.research.elamur.ai/free/en/papers/baldwin-1997-cogniac-high-precision-coreference-limited/) 3. Andrei Bantam. 1969. Dic~ionar Rom£n-Englez, Enlgez-Romfi~. Editura ~tiin~ific~, Bucure~ti. [find](https://scholar.google.com/scholar?q=Andrei+Bantam%2E+1969%2E+Dic%7Eionar+Rom%C2%A3n%2DEnglez%2C+Enlgez%2DRomfi%7E%2E+Editura+%7Etiin%7Eific%7E%2C+Bucure%7Eti%2E) 4. David Bean and Ellen Riloff. 1999. Corpus-Based Identification of Non-Anaphoric Noun Phrases. In Proceedings of the 37th Conference of the Assosiation for Computatioanl Linguistics (A CL-99), pages 373-380. [find](https://scholar.google.com/scholar?q=David+Bean+and+Ellen+Riloff%2E+1999%2E+Corpus%2DBased+Identification+of+Non%2DAnaphoric+Noun+Phrases%2E+In+Proceedings+of+the+37th+Conference+of+the+Assosiation+for+Computatioanl+Linguistics+%28A+CL%2D99%29%2C+pages+37) [our card](https://md.research.elamur.ai/free/en/papers/bean-1999-corpus-based-identification-non-anaphoric/) 5. Eric Brill. A simple rule-based part of speech tagger. In Proceedings of the Third Conference on Applied Natural Language Processing, pages 152-155, 1992. [find](https://scholar.google.com/scholar?q=Eric+Brill%2E+A+simple+rule%2Dbased+part+of+speech+tagger%2E+In+Proceedings+of+the+Third+Conference+on+Applied+Natural+Language+Processing%2C+pages+152%2D155%2C+1992%2E) [our card](https://md.research.elamur.ai/free/en/papers/brill-1992-simple-rule-based-part-speech/) 6. Joseph F. Cameron-Jones and Ross Quinlan. 1993. Avoiding Pitfalls When Learning Recursive Theories. In Proceedings of the 13th International Joint Conference on Artificial Intelligence (IJCAI-93), pages 1050-1055. [find](https://scholar.google.com/scholar?q=Joseph+F%2E+Cameron%2DJones+and+Ross+Quinlan%2E+1993%2E+Avoiding+Pitfalls+When+Learning+Recursive+Theories%2E+In+Proceedings+of+the+13th+International+Joint+Conference+on+Artificial+Intelligence+%28IJCAI%2D93%29%2C+pag) 7. Claire Cardie and Kiri Wagstaff. 1999. Noun phrase coreference as clustering. In Proceedings of the Joint Conference on Empirical Methods in NLP and Very Large Corpora, pages 82-89. [find](https://scholar.google.com/scholar?q=Claire+Cardie+and+Kiri+Wagstaff%2E+1999%2E+Noun+phrase+coreference+as+clustering%2E+In+Proceedings+of+the+Joint+Conference+on+Empirical+Methods+in+NLP+and+Very+Large+Corpora%2C+pages+82%2D89%2E) [our card](https://md.research.elamur.ai/free/en/papers/cardie-1999-noun-phrase-coreference-as-clustering/) 8. Niyu Ge, John Gale and Eugene Charniak. Anaphora Resolution: A Multi-Strategy Approach. In Proceedings of the 6th Workshop on Very Large Corpora, (COLING/A CL '98). [find](https://scholar.google.com/scholar?q=Niyu+Ge%2C+John+Gale+and+Eugene+Charniak%2E+Anaphora+Resolution%3A+A+Multi%2DStrategy+Approach%2E+In+Proceedings+of+the+6th+Workshop+on+Very+Large+Corpora%2C+%28COLING%2FA+CL+%2798%29%2E) [our card](https://md.research.elamur.ai/free/en/papers/carbonell-1988-anaphora-resolution-multi-strategy-approach/) 9. Ido Dagan and Ken W. Church. 1994. TERMIGHT: Identifying and translating technical terminology. In Proceedings of the ~th ACL Conference on Applied Natural Language Processing (ANLP-94). [find](https://scholar.google.com/scholar?q=Ido+Dagan+and+Ken+W%2E+Church%2E+1994%2E+TERMIGHT%3A+Identifying+and+translating+technical+terminology%2E+In+Proceedings+of+the+%7Eth+ACL+Conference+on+Applied+Natural+Language+Processing+%28ANLP%2D94%29%2E) 10. Sanda M. Harabagiu. 1999. Lexical Acquisition for a Romanian WordNet. Proceeding of the 3rd European Summer School on Computational Linguistics. [find](https://scholar.google.com/scholar?q=Sanda+M%2E+Harabagiu%2E+1999%2E+Lexical+Acquisition+for+a+Romanian+WordNet%2E+Proceeding+of+the+3rd+European+Summer+School+on+Computational+Linguistics%2E) 11. Sanda M. Harabagiu and Steve J. Maiorano. 1999. Knowledge-Lean Coreference Resolution and its Relation to Textual Cohesion and Coherence. In Proceedings of the Workshop on the Relation of Discourse/Dialogue Structure and Reference, ACL'98, pages 29-38. [find](https://scholar.google.com/scholar?q=Sanda+M%2E+Harabagiu+and+Steve+J%2E+Maiorano%2E+1999%2E+Knowledge%2DLean+Coreference+Resolution+and+its+Relation+to+Textual+Cohesion+and+Coherence%2E+In+Proceedings+of+the+Workshop+on+the+Relation+of+Discourse%2FDi) 12. Jerry R. Hobbs. Resolving pronoun references. Lingua, 44:311-338. [find](https://scholar.google.com/scholar?q=Jerry+R%2E+Hobbs%2E+Resolving+pronoun+references%2E+Lingua%2C+44%3A311%2D338%2E) [our card](https://md.research.elamur.ai/free/en/papers/hobbs-1978-resolving-pronoun-references/) 13. Andrew Kehler. 1997. Probabilistic Coreference in Information Extraction. In Proceedings of the Second Conference on Empirical Methods in Natural Language Processing (SIGDAT), pages 163-173. [find](https://scholar.google.com/scholar?q=Andrew+Kehler%2E+1997%2E+Probabilistic+Coreference+in+Information+Extraction%2E+In+Proceedings+of+the+Second+Conference+on+Empirical+Methods+in+Natural+Language+Processing+%28SIGDAT%29%2C+pages+163%2D173%2E) [our card](https://md.research.elamur.ai/free/en/papers/kehler-1997-probabilistic-coreference-information-extraction/) 14. Shalom Lappin and Herbert Leass. 1994. An algorithm for pronominal anaphora resolution. Computational Linguistics, 20(4):535-562. [find](https://scholar.google.com/scholar?q=Shalom+Lappin+and+Herbert+Leass%2E+1994%2E+An+algorithm+for+pronominal+anaphora+resolution%2E+Computational+Linguistics%2C+20%284%29%3A535%2D562%2E) [our card](https://md.research.elamur.ai/free/en/papers/lappin-1994-algorithm-pronominal-anaphora-resolution/) 15. Rosie Jones, Andrew McCallum, Kevin Nigam and Ellen Riloff. 1999. Bootstrapping for Text Learning Tasks. In Proceedings of the IJCAI-99 Workshop on Text Mining: Foundations, Techniques, and Applications. [find](https://scholar.google.com/scholar?q=Rosie+Jones%2C+Andrew+McCallum%2C+Kevin+Nigam+and+Ellen+Riloff%2E+1999%2E+Bootstrapping+for+Text+Learning+Tasks%2E+In+Proceedings+of+the+IJCAI%2D99+Workshop+on+Text+Mining%3A+Foundations%2C+Techniques%2C+and+Applicatio) 16. Megumi Kameyama. 1997. Recognizing Referential Links: An Information Extraction Perspective. In Proceedings of the Workshop on Operational Factors in Practical, Robust Anaphora Resolution for Unrestricted Texts, (ACL-97/EACL-97), pages 46-53, Madrid, Spain. [find](https://scholar.google.com/scholar?q=Megumi+Kameyama%2E+1997%2E+Recognizing+Referential+Links%3A+An+Information+Extraction+Perspective%2E+In+Proceedings+of+the+Workshop+on+Operational+Factors+in+Practical%2C+Robust+Anaphora+Resolution+for+Unrestri) 17. Christopher Kennedy and Branimir Bogureav. 1996. Anaphora for everyone: Pronominal anaphora resolution without a parser. In Proceedings of the 16th International Conference on Computational Linguistics (COLING-96). [find](https://scholar.google.com/scholar?q=Christopher+Kennedy+and+Branimir+Bogureav%2E+1996%2E+Anaphora+for+everyone%3A+Pronominal+anaphora+resolution+without+a+parser%2E+In+Proceedings+of+the+16th+International+Conference+on+Computational+Linguistic) [our card](https://md.research.elamur.ai/free/en/papers/kennedy-1996-anaphora-everyone-pronominal-anaphora-resolution/) 18. George A. Miller. 1995. WordNet: A Lexical Database. Communication of the A CM, 38(11):39-41. [find](https://scholar.google.com/scholar?q=George+A%2E+Miller%2E+1995%2E+WordNet%3A+A+Lexical+Database%2E+Communication+of+the+A+CM%2C+38%2811%29%3A39%2D41%2E) 19. Ruslan Mitkov. 1 9 9 8 . Robust pronoun resolution with limited knowledge. In Proceedings of COLING-ACL'98, pages 869-875. 1996. Proceedings of the Sixth Message Understanding Conference (MUC-6),Morgan Kaufmann, San Mateo, CA. 1998. Proceedings of the Seventh Message Understanding Conference (MUC-7)… [find](https://scholar.google.com/scholar?q=Ruslan+Mitkov%2E+1+9+9+8+%2E+Robust+pronoun+resolution+with+limited+knowledge%2E+In+Proceedings+of+COLING%2DACL%2798%2C+pages+869%2D875%2E+1996%2E+Proceedings+of+the+Sixth+Message+Understanding+Conference+%28MUC%2D6%29%2CMorga) [our card](https://md.research.elamur.ai/free/en/papers/mitkov-1998-robust-pronoun-resolution-limited-knowledge/) 20. Philip Resnik and I. Dan Melamed. 1 9 9 7 . Semi-Automatic Acquisition of Domain-Specific Translation 1998. Lexicons. In Proceedings of the 5th ACL Conference on Applied Natural Language Processing (ANLP-97). [find](https://scholar.google.com/scholar?q=Philip+Resnik+and+I%2E+Dan+Melamed%2E+1+9+9+7+%2E+Semi%2DAutomatic+Acquisition+of+Domain%2DSpecific+Translation+1998%2E+Lexicons%2E+In+Proceedings+of+the+5th+ACL+Conference+on+Applied+Natural+Language+Processing+%28A) 21. Ellen Riloff and Rosie Jones. 1999. Learning Dictionaries for Information Extraction by Multi-Level Bootstrapping. In Proceedings of the Sixteenth National Conference on Artificial Intelligence (AAAI-99). [find](https://scholar.google.com/scholar?q=Ellen+Riloff+and+Rosie+Jones%2E+1999%2E+Learning+Dictionaries+for+Information+Extraction+by+Multi%2DLevel+Bootstrapping%2E+In+Proceedings+of+the+Sixteenth+National+Conference+on+Artificial+Intelligence+%28AAAI%2D) 22. Frank Smadja, Katheleen R. McKeown and Vasileios Hatzivassiloglou. 1996. Translating collocations for bilingual lexicons: A statistical approach. Computational Linguistics , 21(1):1-38. [find](https://scholar.google.com/scholar?q=Frank+Smadja%2C+Katheleen+R%2E+McKeown+and+Vasileios+Hatzivassiloglou%2E+1996%2E+Translating+collocations+for+bilingual+lexicons%3A+A+statistical+approach%2E+Computational+Linguistics+%2C+21%281%29%3A1%2D38%2E) [our card](https://md.research.elamur.ai/free/en/papers/smadja-1996-translating-collocations-bilingual-lexicons-statistical/)