--- title: "Inference Protocols for Coreference Resolution — Chang 2011" description: "This paper presents Illinois-Coref, the system the University of Illinois submitted to the closed-track competition of CoNLL-2011, a shared task on…" authors: ["Kai-Wei Chang", "Rajhans Samdani", "Alla Rozovskaya", "Nick Rizzolo", "Mark Sammons", "Dan Roth"] year: 2011 venue: "Proceedings of the Fifteenth Conference on Computational Natural Language Learning: Shared Task" source: "https://aclanthology.org/W11-1904/" licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)" licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/chang-2011-inference-protocols-coreference-resolution/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/chang-2011-inference-protocols-coreference-resolution/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2011](https://md.research.elamur.ai/free/en/papers/2011/) / Inference Protocols for Coreference Resolution # Inference Protocols for Coreference Resolution **Authors:** [Kai-Wei Chang](https://md.research.elamur.ai/free/en/authors/kai-wei-chang/), [Rajhans Samdani](https://md.research.elamur.ai/free/en/authors/rajhans-samdani/), [Alla Rozovskaya](https://md.research.elamur.ai/free/en/authors/alla-rozovskaya/), Nick Rizzolo, Mark Sammons, [Dan Roth](https://md.research.elamur.ai/free/en/authors/dan-roth/) · **Year:** 2011 · **Venue:** Proceedings of the Fifteenth Conference on Computational Natural Language Learning: Shared Task · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/) **Links:** [Publisher's page](https://aclanthology.org/W11-1904/) · [PDF](https://aclanthology.org/W11-1904.pdf) · [OpenAlex](https://openalex.org/W2108505829) **Citations:** 32 citations (openalex-snapshot · 2026-10-14) · [18](#cited-by) in our library, of the 140673 papers whose bibliographies we read ## Summary This paper presents Illinois-Coref, the system the University of Illinois submitted to the closed-track competition of CoNLL-2011, a shared task on resolving coreference in OntoNotes-4.0. The system is built with Learning Based Java and extends the Bengtson and Roth (2008) pipeline. A rule-based mention detector feeds a pairwise compatibility scorer, and a decoder then groups the mentions into entities. The authors compare two decoders, both cast as integer linear programs. Best-Link attaches each mention to its highest-scoring preceding candidate and is trained on pairwise examples. All-Link (correlational clustering) enforces transitivity across whole clusters and is trained with a structured perceptron. The scorer can also take hand-written, high-precision constraints aimed at recall errors involving definite NPs and named-entity heads. Despite its simpler design, Best-Link beat All-Link on both predicted and gold mentions. The constraints helped only marginally. The error analysis points to unlinked coreferent mentions and pronoun ambiguity as the main remaining problems. The work matters because it tests whether global clustering actually helps coreference and offers a modular way to add linguistic knowledge. ## Key points - Because OntoNotes-4.0 does not annotate singletons, mention detection keeps every NE and parser NP, giving about 90% recall and about 35% precision. Mentions left as singletons are removed after inference. - On DEV with predicted mentions, the averaged MUC/BCUB/CEAF score was 56.35 for Best-Link with constraints, 56.22 for Best-Link alone and 55.07 for All-Link. With gold mentions, Best-Link reached 73.65 and All-Link 70.18. - On TEST, the submitted Best-Link system averaged 55.96 with predicted mentions and boundaries, 56.62 with gold boundaries and 73.83 with gold mentions. - Using gold rather than predicted mentions improves results by roughly 15–18 absolute points, so mention detection is a major bottleneck. - Pronouns account for about 35% of mentions, and resolving them when several antecedents are plausible remains a key weakness. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/) Topics: [Coreference resolution](https://md.research.elamur.ai/free/en/topics/coreference-resolution/) ## Cited by Cited by 18 papers of our library cite it (of the 140673 whose bibliographies we read); 7 of them have a page here, 11 not yet. - [A Constrained Latent Variable Model for Coreference Resolution](https://md.research.elamur.ai/free/en/papers/chang-2013-constrained-latent-variable-model-coreference/) - [Latent Trees for Coreference Resolution](https://md.research.elamur.ai/free/en/papers/fernandes-2014-latent-trees-coreference-resolution/) - [Error-Driven Analysis of Challenges in Coreference Resolution](https://md.research.elamur.ai/free/en/papers/kummerfeld-2013-error-driven-analysis-challenges-coreference/) - [Deterministic Coreference Resolution Based on Entity-Centric, Precision-Ranked Rules](https://md.research.elamur.ai/free/en/papers/lee-2013-deterministic-coreference-resolution-based-entity/) - [A Joint Framework for Coreference Resolution and Mention Head Detection](https://md.research.elamur.ai/free/en/papers/peng-2015-joint-framework-coreference-resolution-mention/) - [Solving Hard Coreference Problems](https://md.research.elamur.ai/free/en/papers/peng-2015-solving-hard-coreference-problems/) - [A Mixed Deterministic Model for Coreference Resolution](https://md.research.elamur.ai/free/en/papers/yuan-2012-mixed-deterministic-model-coreference-resolution/) ## Cite The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{chang2011inference, title = {{Inference Protocols for Coreference Resolution}}, author = {Chang, Kai-Wei and Samdani, Rajhans and Rozovskaya, Alla and Rizzolo, Nick and Sammons, Mark and Roth, Dan}, booktitle = {Proceedings of the Fifteenth Conference on Computational Natural Language Learning: Shared Task}, year = {2011}, url = {https://aclanthology.org/W11-1904/} } ``` - [← previous Increasing Informativeness in Temporal Annotation](https://md.research.elamur.ai/free/en/papers/pustejovsky-2011-increasing-informativeness-temporal-annotation/) - [next → Integrating shallow-transfer rules into phrase-based statistical machine translation](https://md.research.elamur.ai/free/en/papers/cartagena-2011-integrating-shallow-transfer-rules-into/) - [↑ back to papers of 2011](https://md.research.elamur.ai/free/en/papers/2011/) ## References 8 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. N. Bansal, A. Blum, and S. Chawla. 2002. Correlation clustering. In Proceedings of the 43rd Symposium on Foundations of Computer Science. [find](https://scholar.google.com/scholar?q=N%2E+Bansal%2C+A%2E+Blum%2C+and+S%2E+Chawla%2E+2002%2E+Correlation+clustering%2E+In+Proceedings+of+the+43rd+Symposium+on+Foundations+of+Computer+Science%2E) 2. E. Bengtson and D. Roth. 2008. Understanding the value of features for coreference resolution. In EMNLP, 10. [find](https://scholar.google.com/scholar?q=E%2E+Bengtson+and+D%2E+Roth%2E+2008%2E+Understanding+the+value+of+features+for+coreference+resolution%2E+In+EMNLP%2C+10%2E) [our card](https://md.research.elamur.ai/free/en/papers/bengtson-2008-understanding-value-features-coreference-resolution/) 3. T. Finley and T. Joachims. 2005. Supervised clustering with support vector machines. In Proceedings of the International Conference on Machine Learning (ICML). [find](https://scholar.google.com/scholar?q=T%2E+Finley+and+T%2E+Joachims%2E+2005%2E+Supervised+clustering+with+support+vector+machines%2E+In+Proceedings+of+the+International+Conference+on+Machine+Learning+%28ICML%29%2E) 4. A. Mccallum and B. Wellner. 2003. Toward conditional models of identity uncertainty with application to proper noun coreference. In The Conference on Advances in Neural Information Processing Systems (NIPS). [find](https://scholar.google.com/scholar?q=A%2E+Mccallum+and+B%2E+Wellner%2E+2003%2E+Toward+conditional+models+of+identity+uncertainty+with+application+to+proper+noun+coreference%2E+In+The+Conference+on+Advances+in+Neural+Information+Processing+Systems+) 5. D. Pascal and J. Baldridge. 2009. Global joint models for coreference resolution and named entity classification. In Procesamiento del Lenguaje Natural. [find](https://scholar.google.com/scholar?q=D%2E+Pascal+and+J%2E+Baldridge%2E+2009%2E+Global+joint+models+for+coreference+resolution+and+named+entity+classification%2E+In+Procesamiento+del+Lenguaje+Natural%2E) 6. S. Pradhan, L. Ramshaw, R. Weischedel, J. MacBride, and L. Micciulla. 2007. Unrestricted Coreference: Identifying Entities and Events in OntoNotes. In in Proceedings of the IEEE International Conference on Semantic Computing (ICSC), September 17-19. [find](https://scholar.google.com/scholar?q=S%2E+Pradhan%2C+L%2E+Ramshaw%2C+R%2E+Weischedel%2C+J%2E+MacBride%2C+and+L%2E+Micciulla%2E+2007%2E+Unrestricted+Coreference%3A+Identifying+Entities+and+Events+in+OntoNotes%2E+In+in+Proceedings+of+the+IEEE+International+Conferen) 7. S. Pradhan, L. Ramshaw, M. Marcus, M. Palmer, R. Weischedel, and N. Xue. 2011. Conll-2011 shared task: Modeling unrestricted coreference in ontonotes. In Proceedings of the Annual Conference on Computational Natural Language Learning (CoNLL). [find](https://scholar.google.com/scholar?q=S%2E+Pradhan%2C+L%2E+Ramshaw%2C+M%2E+Marcus%2C+M%2E+Palmer%2C+R%2E+Weischedel%2C+and+N%2E+Xue%2E+2011%2E+Conll%2D2011+shared+task%3A+Modeling+unrestricted+coreference+in+ontonotes%2E+In+Proceedings+of+the+Annual+Conference+on+Comput) [our card](https://md.research.elamur.ai/free/en/papers/pradhan-2011-conll-2011-shared-task-modeling/) 8. N. Rizzolo and D. Roth. 2010. Learning Based Java for Rapid Development of NLP Systems. In Proceedings of the International Conference on Language Resources and Evaluation (LREC), Valletta, Malta, 5. [find](https://scholar.google.com/scholar?q=N%2E+Rizzolo+and+D%2E+Roth%2E+2010%2E+Learning+Based+Java+for+Rapid+Development+of+NLP+Systems%2E+In+Proceedings+of+the+International+Conference+on+Language+Resources+and+Evaluation+%28LREC%29%2C+Valletta%2C+Malta%2C+5%2E)