---
title: "The Universal Anaphora Scorer — Yu 2022"
description: "Coreference models now perform well on the identity anaphora annotated in ONTONOTES, so research is moving toward harder phenomena such as bridging…"
authors: ["Juntao Yu", "Sopan Khosla", "Nafise Sadat Moosavi", "Silviu Paun", "Sameer Pradhan", "Massimo Poesio"]
year: 2022
venue: "Proceedings of the Thirteenth Language Resources and Evaluation Conference"
source: "https://aclanthology.org/2022.lrec-1.521/"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/papers/yu-2022-universal-anaphora-scorer/"
---
[Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/yu-2022-universal-anaphora-scorer/)

[home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2022](https://md.research.elamur.ai/free/papers/2022/page/4/) / The Universal Anaphora Scorer

# The Universal Anaphora Scorer

**Authors:** [Juntao Yu](https://md.research.elamur.ai/free/authors/juntao-yu/), [Sopan Khosla](https://md.research.elamur.ai/free/authors/sopan-khosla/), [Nafise Sadat Moosavi](https://md.research.elamur.ai/free/authors/nafise-sadat-moosavi/), [Silviu Paun](https://md.research.elamur.ai/free/authors/silviu-paun/), [Sameer Pradhan](https://md.research.elamur.ai/free/authors/sameer-pradhan/), [Massimo Poesio](https://md.research.elamur.ai/free/authors/massimo-poesio/) · **Year:** 2022 · **Venue:** Proceedings of the Thirteenth Language Resources and Evaluation Conference · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2022.lrec-1.521/) · [PDF](https://aclanthology.org/2022.lrec-1.521.pdf) · [OpenAlex](https://openalex.org/W7160232374)

**Citations:** 1 citations (openalex-snapshot · 2026-10-14) · [14](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
Coreference models now perform well on the identity anaphora annotated in ONTONOTES, so research is moving toward harder phenomena such as bridging, discourse deixis and plurals with split antecedents. Evaluation for these has relied on scattered partial tools, or on no tools at all. The authors work within the Universal Anaphora (UA) initiative, an effort modelled on Universal Dependencies to standardise anaphora annotation across languages. They present the UA scorer, a Python tool built on the Reference Coreference Scorer and on Moosavi's Generalized Coreference Scorer.

The scorer reads CONLL-UA, a CONLL-U extension with separate layers for identity, bridging and discourse deixis. It combines identity and bridging evaluation in one package. It also adds the first evaluation for split-antecedent anaphora, using an entirely new method. Discourse deixis becomes scorable too: UA encodes its antecedents like identity markables, so the usual coreference metrics apply. The scorer was the official evaluation tool of the CODI-CRAC 2021 shared task on anaphora in dialogue. It gives the field a common benchmark for anaphoric interpretation beyond plain coreference.

## Key points
- The UA scorer builds on the reference scorer for coreference released by Pradhan et al. (2014) and on coval, the CRAC 2018 Generalized Coreference Scorer. It covers identity anaphora, bridging, split-antecedent anaphora and discourse deixis.
- Split-antecedent evaluation is a novel proposal. Discourse deixis reuses identity metrics such as MUC, B3, CEAF, BLANC, LEA and the CONLL average of MUC, B3 and CEAF F1.
- CONLL-UA exists in two inter-convertible variants. The "compact" variant stores everything in the CONLL-U Misc column and is fully UD-compatible. The "exploded" variant uses separate columns.
- The scorer natively handles the exploded format. A compact-format extension was built for the 2022 CRAC-CorefUD shared task on multilingual coreference.
- The scorer was tested in the CODI-CRAC 2021 shared task and was planned for its 2022 edition.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/)

Topics: [Discourse analysis](https://md.research.elamur.ai/free/topics/discourse-analysis/) · [Coreference resolution](https://md.research.elamur.ai/free/topics/coreference-resolution/) · [Universal Dependencies](https://md.research.elamur.ai/free/topics/universal-dependencies/)

## Cited by

Cited by

14 papers of our library cite it (of the 140673 whose bibliographies we read); 6 of them have a page here, 8 not yet.

- [Findings of the Second Shared Task on Multilingual Coreference Resolution](https://md.research.elamur.ai/free/papers/abokrtsky-2023-findings-second-shared-task-multilingual/)
- [Towards Named-Entity and Coreference Annotation of the Hebrew Bible](https://md.research.elamur.ai/free/papers/coref-2024-swanson-named-entity-coreference-annotation-hebrew/)
- [Assessing the Capabilities of Large Language Models in Coreference: An Evaluation](https://md.research.elamur.ai/free/papers/gan-2024-assessing-capabilities-large-language-models/)
- [Scoring Coreference Chains with Split-Antecedent Anaphors](https://md.research.elamur.ai/free/papers/paun-2023-scoring-coreference-chains-split-antecedent/)
- [The CODI-CRAC 2022 Shared Task on Anaphora, Bridging, and Discourse Deixis in Dialogue](https://md.research.elamur.ai/free/papers/yu-2022-codi-crac-2022-shared-task/)
- [The Universal Anaphora Scorer 2.0](https://md.research.elamur.ai/free/papers/yu-2023-universal-anaphora-scorer-2-0/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{yu2022universal,
  title = {{The Universal Anaphora Scorer}},
  author = {Yu, Juntao and Khosla, Sopan and Moosavi, Nafise Sadat and Paun, Silviu and Pradhan, Sameer and Poesio, Massimo},
  booktitle = {Proceedings of the Thirteenth Language Resources and Evaluation Conference},
  year = {2022},
  doi = {10.63317/4uneskjaxipa},
  url = {https://doi.org/10.63317/4uneskjaxipa}
}
```

- [← previous The Tembusu Treebank: An English Learner Treebank](https://md.research.elamur.ai/free/papers/bank-2022-costa-tembusu-treebank-english-learner-treebank/)
- [next → The Unreliability of Explanations in Few-shot Prompting for Textual Reasoning](https://md.research.elamur.ai/free/papers/ye-2022-unreliability-explanations-few-shot-prompting/)
- [↑ back to papers of 2022](https://md.research.elamur.ai/free/papers/2022/page/4/)

## References

58 references, 30 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Bagga, A. and Baldwin, B. (1998). Algorithms for scoring coreference chains. In The First International Conference on Language Resources and Evaluation (LREC) - Workshop on linguistics coreference, volume 1, pages 563–566. ACL. [find](https://scholar.google.com/scholar?q=Bagga%2C+A%2E+and+Baldwin%2C+B%2E+%281998%29%2E+Algorithms+for+scoring+coreference+chains%2E+In+The+First+International+Conference+on+Language+Resources+and+Evaluation+%28LREC%29+%2D+Workshop+on+linguistics+coreference%2C+vo) [our card](https://md.research.elamur.ai/free/papers/bagga-1998-algorithms-scoring-coreference-chains/)
2. Bamman, D., Lewke, O., and Mansoor, A. (2020). An annotated dataset of coreference in english literature. In Proc. of LREC. European Language Resources Association (ELRA), Association for Computational Linguistics (ACL). [↗](https://doi.org/10.48550/arxiv.1912.01140) [our card](https://md.research.elamur.ai/free/papers/bamman-2020-annotated-dataset-coreference-english-literature/)
3. Clark, H. H. (1977). Bridging. In P. N. Johnson-Laird et al., editors, Thinking: Readings in Cognitive Science, pages 411–420. Cambridge University Press, London and New York. [find](https://scholar.google.com/scholar?q=Clark%2C+H%2E+H%2E+%281977%29%2E+Bridging%2E+In+P%2E+N%2E+Johnson%2DLaird+et+al%2E%2C+editors%2C+Thinking%3A+Readings+in+Cognitive+Science%2C+pages+411%E2%80%93420%2E+Cambridge+University+Press%2C+London+and+New+York%2E)
4. Cohen, K. B., Lanfranchi, A., Choi, M. J.-y., Bada, M., Baumgartner Jr., W. A., Panteleyeva, N., Verspoor, K., Palmer, M., and Hunter, L. E. (2017). Coreference annotation and resolution in the Colorado Richly Annotated Full Text (CRAFT) corpus of biomedical journal articles. BMC Bioinformatics, 18(372). [↗](https://doi.org/10.1186/s12859-017-1775-9)
5. Denis, P. and Baldridge, J. (2009). Global joint models for coreference resolution and named entity classification. Procesamiento del Lenguaje Natural, 42:87– 96. [find](https://scholar.google.com/scholar?q=Denis%2C+P%2E+and+Baldridge%2C+J%2E+%282009%29%2E+Global+joint+models+for+coreference+resolution+and+named+entity+classification%2E+Procesamiento+del+Lenguaje+Natural%2C+42%3A87%E2%80%93+96%2E)
6. Eschenbach, C., Habel, C., Herweg, M., and Rehkämper, K. (1989). Remarks on plural anaphora. In Proceedings of the fourth conference on European chapter of the Association for Computational Linguistics, pages 161–167. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Eschenbach%2C+C%2E%2C+Habel%2C+C%2E%2C+Herweg%2C+M%2E%2C+and+Rehka%CC%88mper%2C+K%2E+%281989%29%2E+Remarks+on+plural+anaphora%2E+In+Proceedings+of+the+fourth+conference+on+European+chapter+of+the+Association+for+Computational+Linguisti) [our card](https://md.research.elamur.ai/free/papers/eschenbach-1989-remarks-plural-anaphora/)
7. Hawkins, J. A. (1978). Definiteness and Indefiniteness. Croom Helm, London. [find](https://scholar.google.com/scholar?q=Hawkins%2C+J%2E+A%2E+%281978%29%2E+Definiteness+and+Indefiniteness%2E+Croom+Helm%2C+London%2E)
8. Hou, Y., Markert, K., and Strube, M. (2018). Unrestricted bridging resolution. Computational Linguistics, 44(2):237–284. [↗](https://doi.org/10.1162/coli_a_00315) [our card](https://md.research.elamur.ai/free/papers/hou-2018-unrestricted-bridging-resolution/)
9. Hou, Y. (2020). Bridging anaphora resolution as question answering. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 1428–1438, Online, July. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Hou%2C+Y%2E+%282020%29%2E+Bridging+anaphora+resolution+as+question+answering%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+pages+1428%E2%80%931438%2C+Online%2C+July%2E+Associati) [our card](https://md.research.elamur.ai/free/papers/hou-2020-bridging-anaphora-resolution-as-question/)
10. Joshi, M., Chen, D., Liu, Y., Weld, D. S., Zettlemoyer, L., and Levy, O. (2020). Spanbert: Improving pre-training by representing and predicting spans. Transactions of the Association for Computational Linguistics, 8:64–77. [↗](https://doi.org/10.1162/tacl_a_00300) [our card](https://md.research.elamur.ai/free/papers/joshi-2019-spanbert-improving-pre-training-representing/)
11. Kamp, H. and Reyle, U. (1993). From Discourse to Logic. D. Reidel, Dordrecht. [↗](https://doi.org/10.1007/978-94-011-2066-1)
12. Kantor, B. and Globerson, A. (2019). Coreference resolution with entity equalization. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 673–677, Florence, Italy, July. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Kantor%2C+B%2E+and+Globerson%2C+A%2E+%282019%29%2E+Coreference+resolution+with+entity+equalization%2E+In+Proceedings+of+the+57th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+pages+673%E2%80%93677%2C+Florenc) [our card](https://md.research.elamur.ai/free/papers/kantor-2019-coreference-resolution-entity-equalization/)
13. Khosla, S., Yu, J., Manuvinakurike, R., Ng, V., Poesio, M., Strube, M., and Rosé, C. (2021). The codi-crac 2021 shared task on anaphora, bridging, and discourse deixis in dialogue. In Proc. of the CODI/CRAC Shared Task Workshop. [find](https://scholar.google.com/scholar?q=Khosla%2C+S%2E%2C+Yu%2C+J%2E%2C+Manuvinakurike%2C+R%2E%2C+Ng%2C+V%2E%2C+Poesio%2C+M%2E%2C+Strube%2C+M%2E%2C+and+Rose%CC%81%2C+C%2E+%282021%29%2E+The+codi%2Dcrac+2021+shared+task+on+anaphora%2C+bridging%2C+and+discourse+deixis+in+dialogue%2E+In+Proc%2E+of+the+CO) [our card](https://md.research.elamur.ai/free/papers/khosla-2021-codi-crac-2021-shared-task/)
14. Kobayashi, H. and Ng, V. (2021). Bridging resolution: Making sense of the state of the art. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 1652–1659, Online, June. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Kobayashi%2C+H%2E+and+Ng%2C+V%2E+%282021%29%2E+Bridging+resolution%3A+Making+sense+of+the+state+of+the+art%2E+In+Proceedings+of+the+2021+Conference+of+the+North+American+Chapter+of+the+Association+for+Computational+Lin) [our card](https://md.research.elamur.ai/free/papers/kobayashi-2021-bridging-resolution-making-sense-state/)
15. Kolhatkar, V. and Hirst, G. (2014). Resolving shell nouns. In Proc. of EMNLP, pages 499–510, Doha, Qatar. [find](https://scholar.google.com/scholar?q=Kolhatkar%2C+V%2E+and+Hirst%2C+G%2E+%282014%29%2E+Resolving+shell+nouns%2E+In+Proc%2E+of+EMNLP%2C+pages+499%E2%80%93510%2C+Doha%2C+Qatar%2E)
16. Kolhatkar, V., Roussel, A., Dipper, S., and Zinsmeister, H. (2018). Anaphora with non-nominal antecedents in computational linguistics: a Survey. Computational Linguistics, 44(3):547–612. [↗](https://doi.org/10.1162/coli_a_00327) [our card](https://md.research.elamur.ai/free/papers/kolhatkar-2018-survey-anaphora-non-nominal-antecedents/)
17. Kuhn, H. W. (1955). The hungarian method for the assignment problem. Naval research logistics quarterly, 2(1-2):83–97. [↗](https://doi.org/10.1002/nav.3800020109)
18. Lee, K., He, L., Lewis, M., and Zettlemoyer, L. (2017). End-to-end neural coreference resolution. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 188– 197, Copenhagen, Denmark, September. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Lee%2C+K%2E%2C+He%2C+L%2E%2C+Lewis%2C+M%2E%2C+and+Zettlemoyer%2C+L%2E+%282017%29%2E+End%2Dto%2Dend+neural+coreference+resolution%2E+In+Proceedings+of+the+2017+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+188%E2%80%93+) [our card](https://md.research.elamur.ai/free/papers/lee-2017-end-end-neural-coreference-resolution/)
19. Lee, K., He, L., and Zettlemoyer, L. (2018). Higher-order coreference resolution with coarse-to-fine inference. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pages 687–692. [find](https://scholar.google.com/scholar?q=Lee%2C+K%2E%2C+He%2C+L%2E%2C+and+Zettlemoyer%2C+L%2E+%282018%29%2E+Higher%2Dorder+coreference+resolution+with+coarse%2Dto%2Dfine+inference%2E+In+Proceedings+of+the+2018+Conference+of+the+North+American+Chapter+of+the+Association+f) [our card](https://md.research.elamur.ai/free/papers/lee-2018-higher-order-coreference-resolution-coarse/)
20. Liu, Q., Jiang, H., Evdokimov, A., Ling, Z.-H., Zhu, X., Wei, S., and Hu, Y. (2017). Cause-effect knowledge acquisition and neural association model for solving a set of winograd schema problems. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI-17, pages 2344–2350. [find](https://scholar.google.com/scholar?q=Liu%2C+Q%2E%2C+Jiang%2C+H%2E%2C+Evdokimov%2C+A%2E%2C+Ling%2C+Z%2E%2DH%2E%2C+Zhu%2C+X%2E%2C+Wei%2C+S%2E%2C+and+Hu%2C+Y%2E+%282017%29%2E+Cause%2Deffect+knowledge+acquisition+and+neural+association+model+for+solving+a+set+of+winograd+schema+problems%2E+In+P)
21. Lu, J. and Ng, V. (2018). Event coreference resolution: A survey of two decades of research. In Proc. of IJCAI, pages 5479–5486. [find](https://scholar.google.com/scholar?q=Lu%2C+J%2E+and+Ng%2C+V%2E+%282018%29%2E+Event+coreference+resolution%3A+A+survey+of+two+decades+of+research%2E+In+Proc%2E+of+IJCAI%2C+pages+5479%E2%80%935486%2E)
22. Luo, X. and Pradhan, S. (2016). Evaluation metrics. In Massimo Poesio, et al., editors, Anaphora Resolution: Algorithms, Resources and Applications, pages 147–170. Springer. [find](https://scholar.google.com/scholar?q=Luo%2C+X%2E+and+Pradhan%2C+S%2E+%282016%29%2E+Evaluation+metrics%2E+In+Massimo+Poesio%2C+et+al%2E%2C+editors%2C+Anaphora+Resolution%3A+Algorithms%2C+Resources+and+Applications%2C+pages+147%E2%80%93170%2E+Springer%2E)
23. Luo, X., Pradhan, S., Recasens, M., and Hovy, E. (2014). An extension of BLANC to system mentions. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 24–29, Baltimore, Maryland, June. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Luo%2C+X%2E%2C+Pradhan%2C+S%2E%2C+Recasens%2C+M%2E%2C+and+Hovy%2C+E%2E+%282014%29%2E+An+extension+of+BLANC+to+system+mentions%2E+In+Proceedings+of+the+52nd+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volume+2%3A)
24. Luo, X. (2005). On coreference resolution performance metrics. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, pages 25–32, Vancouver, British Columbia, Canada, October. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Luo%2C+X%2E+%282005%29%2E+On+coreference+resolution+performance+metrics%2E+In+Proceedings+of+Human+Language+Technology+Conference+and+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+25%E2%80%9332%2C+V) [our card](https://md.research.elamur.ai/free/papers/luo-2005-coreference-resolution-performance-metrics/)
25. Marasović, A., Born, L., Opitz, J., and Frank, A. (2017). A mention-ranking model for abstract anaphora resolution. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 221–232, Copenhagen, Denmark, September. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Marasovic%CC%81%2C+A%2E%2C+Born%2C+L%2E%2C+Opitz%2C+J%2E%2C+and+Frank%2C+A%2E+%282017%29%2E+A+mention%2Dranking+model+for+abstract+anaphora+resolution%2E+In+Proceedings+of+the+2017+Conference+on+Empirical+Methods+in+Natural+Language+Proc) [our card](https://md.research.elamur.ai/free/papers/marasovic-2017-mention-ranking-model-abstract-anaphora/)
26. Moosavi, N. S. and Strube, M. (2016). A proposal for a link-based entity aware metric. In Proc. of ACL, pages 632–642, Berlin. [find](https://scholar.google.com/scholar?q=Moosavi%2C+N%2E+S%2E+and+Strube%2C+M%2E+%282016%29%2E+A+proposal+for+a+link%2Dbased+entity+aware+metric%2E+In+Proc%2E+of+ACL%2C+pages+632%E2%80%93642%2C+Berlin%2E)
27. Müller, M.-C. and Strube, M. (2006). Multi-level annotation of linguistic data with mmax2. In S. Braun, et al., editors, Corpus Technology and Language Pedagogy. New Resources, New Tools, New Methods, volume 3 of English Corpus Linguistics, pages 197–214. Peter Lang. [find](https://scholar.google.com/scholar?q=Mu%CC%88ller%2C+M%2E%2DC%2E+and+Strube%2C+M%2E+%282006%29%2E+Multi%2Dlevel+annotation+of+linguistic+data+with+mmax2%2E+In+S%2E+Braun%2C+et+al%2E%2C+editors%2C+Corpus+Technology+and+Language+Pedagogy%2E+New+Resources%2C+New+Tools%2C+New+Methods)
28. Munkres, J. (1957). Algorithms for the assignment and transportation problems. Journal of the society for industrial and applied mathematics, 5(1):32–38. [↗](https://doi.org/10.1137/0105003)
29. Muzerelle, J., Lefeuvre, A., Schang, E., Antoine, J.-Y., Pelletier, A., Maurel, D., Eshkol, I., and Villaneau, J. (2014). Ancor centre, a large free spoken french coreference corpus. In Proc. of LREC. [find](https://scholar.google.com/scholar?q=Muzerelle%2C+J%2E%2C+Lefeuvre%2C+A%2E%2C+Schang%2C+E%2E%2C+Antoine%2C+J%2E%2DY%2E%2C+Pelletier%2C+A%2E%2C+Maurel%2C+D%2E%2C+Eshkol%2C+I%2E%2C+and+Villaneau%2C+J%2E+%282014%29%2E+Ancor+centre%2C+a+large+free+spoken+french+coreference+corpus%2E+In+Proc%2E+of+LREC%2E)
30. Nedoluzhko, A. (2013). Generic noun phrases and annotation of coreference and bridging relations in the prague dependency treebank. In Proc. of LAW, pages 103–111. [find](https://scholar.google.com/scholar?q=Nedoluzhko%2C+A%2E+%282013%29%2E+Generic+noun+phrases+and+annotation+of+coreference+and+bridging+relations+in+the+prague+dependency+treebank%2E+In+Proc%2E+of+LAW%2C+pages+103%E2%80%93111%2E)
31. O’Gorman, T., Regan, M., Griffitt, K., Hermjakob, U., Knight, K., and Palmer, M. (2018). Amr beyond the sentence: the multi-sentence amr corpus. In Proc. of COLING, pages 3693–3702, Santa Fe, New Mexico, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=O%E2%80%99Gorman%2C+T%2E%2C+Regan%2C+M%2E%2C+Griffitt%2C+K%2E%2C+Hermjakob%2C+U%2E%2C+Knight%2C+K%2E%2C+and+Palmer%2C+M%2E+%282018%29%2E+Amr+beyond+the+sentence%3A+the+multi%2Dsentence+amr+corpus%2E+In+Proc%2E+of+COLING%2C+pages+3693%E2%80%933702%2C+Santa+Fe%2C+New+Mexi)
32. Paun, S., Yu, J., Moosavi, N., and Poesio, M. (2021). Scoring coreference chains with split-antecedent anaphors and other entities constructed from a discourse model. Submitted. [find](https://scholar.google.com/scholar?q=Paun%2C+S%2E%2C+Yu%2C+J%2E%2C+Moosavi%2C+N%2E%2C+and+Poesio%2C+M%2E+%282021%29%2E+Scoring+coreference+chains+with+split%2Dantecedent+anaphors+and+other+entities+constructed+from+a+discourse+model%2E+Submitted%2E) [our card](https://md.research.elamur.ai/free/papers/paun-2023-scoring-coreference-chains-split-antecedent/)
33. Poesio, M. and Artstein, R. (2005). The reliability of anaphoric annotation, reconsidered: Taking ambiguity into account. In A. Meyers, editor, Proc. of ACL Workshop on Frontiers in Corpus Annotation, pages 76–83, June. [find](https://scholar.google.com/scholar?q=Poesio%2C+M%2E+and+Artstein%2C+R%2E+%282005%29%2E+The+reliability+of+anaphoric+annotation%2C+reconsidered%3A+Taking+ambiguity+into+account%2E+In+A%2E+Meyers%2C+editor%2C+Proc%2E+of+ACL+Workshop+on+Frontiers+in+Corpus+Annotation%2C) [our card](https://md.research.elamur.ai/free/papers/poesio-2005-reliability-anaphoric-annotation-reconsidered-taking/)
34. Poesio, M. and Rieser, H. (2010). Completions, coordination, and alignment in dialogue. Dialogue and Discourse, 1(1):1–89. [↗](https://doi.org/10.5087/dad.2010.001)
35. Poesio, M., Mehta, R., Maroudas, A., and Hitzeman, J. (2004). Learning to solve bridging references. In Proc. of ACL, pages 143–150, Barcelona, July. [find](https://scholar.google.com/scholar?q=Poesio%2C+M%2E%2C+Mehta%2C+R%2E%2C+Maroudas%2C+A%2E%2C+and+Hitzeman%2C+J%2E+%282004%29%2E+Learning+to+solve+bridging+references%2E+In+Proc%2E+of+ACL%2C+pages+143%E2%80%93150%2C+Barcelona%2C+July%2E)
36. Poesio, M., Grishina, Y., Kolhatkar, V., Moosavi, N., Roesiger, I., Roussel, A., Simonjetz, F., Uma, A., Uryupina, O., Yu, J., and Zinsmeister, H. (2018). Anaphora resolution with the ARRAU corpus. In Proceedings of the First Workshop on Computational Models of Reference, Anaphora and Coreference, pages 11–22, New Orleans, Louisiana, June. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Poesio%2C+M%2E%2C+Grishina%2C+Y%2E%2C+Kolhatkar%2C+V%2E%2C+Moosavi%2C+N%2E%2C+Roesiger%2C+I%2E%2C+Roussel%2C+A%2E%2C+Simonjetz%2C+F%2E%2C+Uma%2C+A%2E%2C+Uryupina%2C+O%2E%2C+Yu%2C+J%2E%2C+and+Zinsmeister%2C+H%2E+%282018%29%2E+Anaphora+resolution+with+the+ARRAU+corpus%2E+In) [our card](https://md.research.elamur.ai/free/papers/poesio-2018-anaphora-resolution-arrau-corpus/)
37. Poesio, M., Chamberlain, J., Kruschwitz, U., Paun, S., Uma, A., and Yu, J. (2019). A crowdsourced corpus of multiple judgments and disagreement on anaphoric interpretation. In Proc. of NAACL, page 1778–1789, Minneapolis. Association for Computational Linguistics (ACL). [↗](https://doi.org/10.5283/epub.43420) [our card](https://md.research.elamur.ai/free/papers/poesio-2019-crowdsourced-corpus-multiple-judgments-disagreement/)
38. Poesio, M. (2016). Linguistic and cognitive evidence about anaphora. In M. Poesio, et al., editors, Anaphora Resolution: Algorithms, Resources and Applications, chapter 2. Springer. [↗](https://doi.org/10.1007/978-3-662-47909-4_2)
39. Pradhan, S., Moschitti, A., Xue, N., Uryupina, O., and Zhang, Y. (2012). CoNLL-2012 shared task: Modeling multilingual unrestricted coreference in OntoNotes. In Proceedings of the Sixteenth Conference on Computational Natural Language Learning (CoNLL 2012), Jeju, Korea. [find](https://scholar.google.com/scholar?q=Pradhan%2C+S%2E%2C+Moschitti%2C+A%2E%2C+Xue%2C+N%2E%2C+Uryupina%2C+O%2E%2C+and+Zhang%2C+Y%2E+%282012%29%2E+CoNLL%2D2012+shared+task%3A+Modeling+multilingual+unrestricted+coreference+in+OntoNotes%2E+In+Proceedings+of+the+Sixteenth+Conference) [our card](https://md.research.elamur.ai/free/papers/pradhan-2012-conll-2012-shared-task-modeling/)
40. Pradhan, S., Luo, X., Recasens, M., Hovy, E., Ng, V., and Strube, M. (2014). Scoring coreference partitions of predicted mentions: A reference implementation. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 30–35, Baltimore, Maryland, June. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Pradhan%2C+S%2E%2C+Luo%2C+X%2E%2C+Recasens%2C+M%2E%2C+Hovy%2C+E%2E%2C+Ng%2C+V%2E%2C+and+Strube%2C+M%2E+%282014%29%2E+Scoring+coreference+partitions+of+predicted+mentions%3A+A+reference+implementation%2E+In+Proceedings+of+the+52nd+Annual+Meeting) [our card](https://md.research.elamur.ai/free/papers/pradhan-2014-scoring-coreference-partitions-predicted-mentions/)
41. Prince, E. F. (1981). Toward a taxonomy of given-new information. In P. Cole, editor, Radical Pragmatics, pages 223–256. Academic Press, New York. [find](https://scholar.google.com/scholar?q=Prince%2C+E%2E+F%2E+%281981%29%2E+Toward+a+taxonomy+of+given%2Dnew+information%2E+In+P%2E+Cole%2C+editor%2C+Radical+Pragmatics%2C+pages+223%E2%80%93256%2E+Academic+Press%2C+New+York%2E)
42. Rahman, A. and Ng, V. (2012). Resolving complex cases of definite pronouns: The Winograd schema challenge. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pages 777–789, Jeju Island, Korea, July. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Rahman%2C+A%2E+and+Ng%2C+V%2E+%282012%29%2E+Resolving+complex+cases+of+definite+pronouns%3A+The+Winograd+schema+challenge%2E+In+Proceedings+of+the+2012+Joint+Conference+on+Empirical+Methods+in+Natural+Language+Processi) [our card](https://md.research.elamur.ai/free/papers/rahman-2012-resolving-complex-cases-definite-pronouns/)
43. Recasens, M. and Hovy, E. (2011). Blanc: Implementing the rand index for coreference evaluation. Natural Language Engineering. [↗](https://doi.org/10.1017/s135132491000029x)
44. Recasens, M. and Martı́, M. A. (2010). AnCora-CO: Coreferentially annotated corpora for Spanish and Catalan. Language Resources and Evaluation, 44(4):315–345. [↗](https://doi.org/10.1007/s10579-009-9108-x)
45. Recasens, M., Màrquez, L., Sapena, E., Martı́, M. A., Taulé, M., Hoste, V., Poesio, M., and Versley, Y. (2010). Semeval-2010 task 1: Coreference resolution in multiple languages. In Proceedings of the 5th International Workshop on Semantic Evaluation, pages 1–8, Uppsala, Sweden, July. [find](https://scholar.google.com/scholar?q=Recasens%2C+M%2E%2C+Ma%CC%80rquez%2C+L%2E%2C+Sapena%2C+E%2E%2C+Mart%C4%B1%CC%81%2C+M%2E+A%2E%2C+Taule%CC%81%2C+M%2E%2C+Hoste%2C+V%2E%2C+Poesio%2C+M%2E%2C+and+Versley%2C+Y%2E+%282010%29%2E+Semeval%2D2010+task+1%3A+Coreference+resolution+in+multiple+languages%2E+In+Proceedings+of+t) [our card](https://md.research.elamur.ai/free/papers/recasens-2009-semeval-2010-task-1-coreference/)
46. Sakaguchi, K., Le Bras, R., Bhagavatula, C., and Choi, Y. (2020). Winogrande: An adversarial winograd schema challenge at scale. Proceedings of the AAAI Conference on Artificial Intelligence, 34:8732–8740, Apr. [find](https://scholar.google.com/scholar?q=Sakaguchi%2C+K%2E%2C+Le+Bras%2C+R%2E%2C+Bhagavatula%2C+C%2E%2C+and+Choi%2C+Y%2E+%282020%29%2E+Winogrande%3A+An+adversarial+winograd+schema+challenge+at+scale%2E+Proceedings+of+the+AAAI+Conference+on+Artificial+Intelligence%2C+34%3A8732%E2%80%93)
47. Uryupina, O., Artstein, R., Bristot, A., Cavicchio, F., Delogu, F., Rodriguez, K. J., and Poesio, M. (2020). Annotating a broad range of anaphoric phenomena, in a variety of genres: the ARRAU corpus. Journal of Natural Language Engineering. [↗](https://doi.org/10.1017/s1351324919000056)
48. Vala, H., Piper, A., and Ruths, D. (2016). The more antecedents, the merrier: Resolving multi-antecedent anaphors. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2287–2296, Berlin, Germany, August. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Vala%2C+H%2E%2C+Piper%2C+A%2E%2C+and+Ruths%2C+D%2E+%282016%29%2E+The+more+antecedents%2C+the+merrier%3A+Resolving+multi%2Dantecedent+anaphors%2E+In+Proceedings+of+the+54th+Annual+Meeting+of+the+Association+for+Computational+Lingui) [our card](https://md.research.elamur.ai/free/papers/vala-2016-more-antecedents-merrier-resolving-multi/)
49. Vieira, R. and Poesio, M. (2000). An empirically-based system for processing definite descriptions. Computational Linguistics, 26(4):539–593, December. [↗](https://doi.org/10.1162/089120100750105948)
50. Vilain, M., Burger, J., Aberdeen, J., Connolly, D., and Hirschman, L. (1995). A model-theoretic coreference scoring scheme. In Sixth Message Understanding Conference (MUC-6): Proceedings of a Conference Held in Columbia, Maryland, November 6-8, 1995. [find](https://scholar.google.com/scholar?q=Vilain%2C+M%2E%2C+Burger%2C+J%2E%2C+Aberdeen%2C+J%2E%2C+Connolly%2C+D%2E%2C+and+Hirschman%2C+L%2E+%281995%29%2E+A+model%2Dtheoretic+coreference+scoring+scheme%2E+In+Sixth+Message+Understanding+Conference+%28MUC%2D6%29%3A+Proceedings+of+a+Conferen) [our card](https://md.research.elamur.ai/free/papers/vilain-1995-model-theoretic-coreference-scoring-scheme/)
51. Webber, B. L. (1991). Structure and ostension in the interpretation of discourse deixis. Language and Cognitive Processes, 6(2):107–135. [↗](https://doi.org/10.1080/01690969108406940)
52. Webster, K., Recasens, M., Axelrod, V., and Baldridge, J. (2018). Mind the GAP: A balanced corpus of gendered ambiguous pronouns. Transactions of the Association for Computational Linguistics, 6:605–617. [↗](https://doi.org/10.1162/tacl_a_00240) [our card](https://md.research.elamur.ai/free/papers/webster-2018-mind-gap-balanced-corpus-gendered/)
53. Wiseman, S., Rush, A. M., Shieber, S., and Weston, J. (2015). Learning anaphoricity and antecedent ranking features for coreference resolution. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 1416–1426, Beijing, China, July. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Wiseman%2C+S%2E%2C+Rush%2C+A%2E+M%2E%2C+Shieber%2C+S%2E%2C+and+Weston%2C+J%2E+%282015%29%2E+Learning+anaphoricity+and+antecedent+ranking+features+for+coreference+resolution%2E+In+Proceedings+of+the+53rd+Annual+Meeting+of+the+Associa) [our card](https://md.research.elamur.ai/free/papers/wiseman-2015-learning-anaphoricity-antecedent-ranking-features/)
54. Yu, J. and Poesio, M. (2020). Multitask learning based neural bridging reference resolution. In Proceedings of the 28th International Conference on Computational Linguistics, pages 3534–3546, Barcelona, Spain (Online), December. International Committee on Computational Linguistics. [↗](https://doi.org/10.48448/zhch-2784) [our card](https://md.research.elamur.ai/free/papers/yu-2020-multitask-learning-based-neural-bridging/)
55. Yu, J., Moosavi, N. S., Paun, S., and Poesio, M. (2020). Free the plural: Unrestricted split-antecedent anaphora resolution. In Proceedings of the 28th International Conference on Computational Linguistics, pages 6113–6125, Barcelona, Spain (Online), December. International Committee on Computational Linguistics. [find](https://scholar.google.com/scholar?q=Yu%2C+J%2E%2C+Moosavi%2C+N%2E+S%2E%2C+Paun%2C+S%2E%2C+and+Poesio%2C+M%2E+%282020%29%2E+Free+the+plural%3A+Unrestricted+split%2Dantecedent+anaphora+resolution%2E+In+Proceedings+of+the+28th+International+Conference+on+Computational+Lingui) [our card](https://md.research.elamur.ai/free/papers/yu-2020-free-plural-unrestricted-split-antecedent/)
56. Yu, J., Moosavi, N. S., Paun, S., and Poesio, M. (2021). Stay together: A system for single and split-antecedent anaphora resolution. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Yu%2C+J%2E%2C+Moosavi%2C+N%2E+S%2E%2C+Paun%2C+S%2E%2C+and+Poesio%2C+M%2E+%282021%29%2E+Stay+together%3A+A+system+for+single+and+split%2Dantecedent+anaphora+resolution%2E+In+Proceedings+of+the+2021+Conference+of+the+North+American+Chapte) [our card](https://md.research.elamur.ai/free/papers/yu-2021-stay-together-system-single-split/)
57. Zeldes, A. (2017). The GUM corpus: Creating multilayer resources in the classroom. Language Resources and Evaluation, 51(3):581–612. [↗](https://doi.org/10.1007/s10579-016-9343-x)
58. Zhou, E. and Choi, J. D. (2018). They exist! introducing plural mentions to coreference resolution and entity linking. In Proceedings of the 27th International Conference on Computational Linguistics, pages 24–34, Santa Fe, New Mexico, USA, August. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Zhou%2C+E%2E+and+Choi%2C+J%2E+D%2E+%282018%29%2E+They+exist%21+introducing+plural+mentions+to+coreference+resolution+and+entity+linking%2E+In+Proceedings+of+the+27th+International+Conference+on+Computational+Linguistics%2C) [our card](https://md.research.elamur.ai/free/papers/zhou-2018-they-exist-introducing-plural-mentions/)