---
title: "Findings of the Second Shared Task on — Žabokrtský 2023"
description: "This paper describes the second round of the multilingual coreference resolution shared task, held with CRAC 2023."
authors: ["Zdeněk Žabokrtský", "Miloslav Konopik", "Anna Nedoluzhko", "Michal Novák", "Maciej Ogrodniczuk", "Martin Popel", "Ondrej Prazak", "Jakub Sido", "Daniel Zeman"]
year: 2023
venue: "Proceedings of the CRAC 2023 Shared Task on Multilingual Coreference Resolution"
source: "https://aclanthology.org/2023.crac-sharedtask.1/"
doi: "10.18653/v1/2023.crac-sharedtask.1"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/papers/abokrtsky-2023-findings-second-shared-task-multilingual/"
---
[Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/abokrtsky-2023-findings-second-shared-task-multilingual/)

[home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2023](https://md.research.elamur.ai/free/papers/2023/page/3/) / Findings of the Second Shared Task on Multilingual Coreference Resolution

# Findings of the Second Shared Task on Multilingual Coreference Resolution

**Authors:** [Zdeněk Žabokrtský](https://md.research.elamur.ai/free/authors/zdenek-zabokrtsku/), [Miloslav Konopik](https://md.research.elamur.ai/free/authors/miloslav-konopik/), [Anna Nedoluzhko](https://md.research.elamur.ai/free/authors/anna-nedoluzhko/), [Michal Novák](https://md.research.elamur.ai/free/authors/michal-novak/), [Maciej Ogrodniczuk](https://md.research.elamur.ai/free/authors/maciej-ogrodniczuk/), [Martin Popel](https://md.research.elamur.ai/free/authors/martin-popel/), [Ondrej Prazak](https://md.research.elamur.ai/free/authors/ondrej-prazak/), [Jakub Sido](https://md.research.elamur.ai/free/authors/jakub-sido/), [Daniel Zeman](https://md.research.elamur.ai/free/authors/daniel-zeman/) · **Year:** 2023 · **Venue:** Proceedings of the CRAC 2023 Shared Task on Multilingual Coreference Resolution · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2023.crac-sharedtask.1/) · [PDF](https://aclanthology.org/2023.crac-sharedtask.1.pdf) · [DOI 10.18653/v1/2023.crac-sharedtask.1](https://doi.org/10.18653/v1/2023.crac-sharedtask.1) · [OpenAlex](https://openalex.org/W4389519312)

**Citations:** 8 citations (openalex-snapshot · 2026-10-14) · [19](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
This paper describes the second round of the multilingual coreference resolution shared task, held with CRAC 2023. Participants built trainable systems that find mentions and cluster them into identity-coreference entities. The data come from CorefUD 1.1, which harmonizes 17 datasets in 12 languages into a common CoNLL-U-based format. Compared with the 2022 edition, the organizers made three main changes:
- **New data:** Hungarian KorKor, Norwegian NARC (Bokmål and Nynorsk) and Turkish ITCC were added.
- **Predicted features:** gold morpho-syntax in the dev and test inputs was replaced with UDPipe 2 predictions, which makes evaluation more realistic.
- **Head matching:** the primary metric now matches mentions by their heads instead of using partial matching, because partial matching had tempted teams to shrink predicted spans to bare heads.

Seven systems and a baseline were compared with the CorefUD scorer, which builds on the Universal Anaphora scorer. CorPipe led on every dataset. The task matters because it pushes coreference research beyond English. It also exposes open problems, including limited typological diversity, uneven annotation quality across datasets, and macro-averaging over corpora of very different sizes.

## Key points
- CorefUD 1.1 contains 17 datasets in 12 languages from 3 language families. Compared with CorefUD 1.0 it adds 4 datasets and 2 languages (Norwegian and Turkish). Train/dev/test splits are roughly 8/1/1.
- The primary score is the CoNLL F1 with singletons excluded and head-based mention matching. Supplementary scores include MOR and an anaphor-level evaluation of zeros.
- Participants received input documents with zeros (empty nodes) already reconstructed. The organizers plan to move toward raw-text input in future editions.
- On the per-dataset CoNLL scores, CorPipe ranked first everywhere. Examples: 83.39 on es_ancora, 82.59 on ca_ancora and 55.63 on tr_itcc. Turkish ITCC was the hardest dataset for all systems, partly because its annotation is incomplete.
- cs_pcedt is the largest dataset, with about 1.16M words. ParCorFull is among the smallest, with about 11K words.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/)

Topics: [Coreference resolution](https://md.research.elamur.ai/free/topics/coreference-resolution/)

## Cited by

Cited by

19 papers of our library cite it (of the 140673 whose bibliographies we read); 6 of them have a page here, 13 not yet.

- [CorefInst: Leveraging LLMs for Multilingual Coreference Resolution](https://md.research.elamur.ai/free/papers/arslan-2026-corefinst-leveraging-llms-multilingual-coreference/)
- [Findings of the Fourth Shared Task on Multilingual Coreference Resolution: Can LLMs Dethrone Traditional Approaches?](https://md.research.elamur.ai/free/papers/novak-2025-findings-fourth-shared-task-multilingual/)
- [Findings of the Fifth Shared Task on Multilingual Coreference Resolution: Expanding Datasets for Long-Range Entities](https://md.research.elamur.ai/free/papers/novak-2026-findings-fifth-shared-task-multilingual/)
- [Challenges to Evaluating the Generalization of Coreference Resolution Models: A Measurement Modeling Perspective](https://md.research.elamur.ai/free/papers/porada-2024-challenges-evaluating-generalization-coreference-resolution/)
- [Multilingual coreference resolution as text generation](https://md.research.elamur.ai/free/papers/skachkova-2024-multilingual-coreference-resolution-as-text/)
- [ÚFAL CorPipe at CRAC 2023: Larger Context Improves Multilingual Coreference Resolution](https://md.research.elamur.ai/free/papers/straka-2023-fal-corpipe-crac-2023-larger/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zabokrtsku2023findings,
  title = {{Findings of the Second Shared Task on Multilingual Coreference Resolution}},
  author = {Žabokrtský, Zdeněk and Konopik, Miloslav and Nedoluzhko, Anna and Novák, Michal and Ogrodniczuk, Maciej and Popel, Martin and Prazak, Ondrej and Sido, Jakub and Zeman, Daniel},
  booktitle = {Proceedings of the CRAC 2023 Shared Task on Multilingual Coreference Resolution},
  year = {2023},
  doi = {10.18653/v1/2023.crac-sharedtask.1},
  url = {https://doi.org/10.18653/v1/2023.crac-sharedtask.1}
}
```

- [← previous FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN](https://md.research.elamur.ai/free/papers/agarwal-2023-findings-iwslt-2023-evaluation-campaign/)
- [next → Findings of the Second WMT Shared Task on Sign Language Translation (WMT-SLT23)](https://md.research.elamur.ai/free/papers/muller-2023-findings-second-wmt-shared-task/)
- [↑ back to papers of 2023](https://md.research.elamur.ai/free/papers/2023/page/3/)

## References

48 references, 27 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Kenton Lee, Luheng He, Mike Lewis, and Luke Zettlemoyer. 2017. End-to-end neural coreference resolution. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 188–197, Copenhagen, Denmark. Association for Computational Linguistics. [↗](https://doi.org/10.18653/v1/d17-1018) [our card](https://md.research.elamur.ai/free/papers/lee-2017-end-end-neural-coreference-resolution/)
2. Amit Bagga and Breck Baldwin. 1998. Algorithms for scoring coreference chains. In Proceedings of The First International Conference on Language Resources and Evaluation Workshop on Linguistics Coreference, pages 563–566. [find](https://scholar.google.com/scholar?q=Amit+Bagga+and+Breck+Baldwin%2E+1998%2E+Algorithms+for+scoring+coreference+chains%2E+In+Proceedings+of+The+First+International+Conference+on+Language+Resources+and+Evaluation+Workshop+on+Linguistics+Corefer) [our card](https://md.research.elamur.ai/free/papers/bagga-1998-algorithms-scoring-coreference-chains/)
3. Xiaoqiang Luo. 2005. On coreference resolution performance metrics. In Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing, HLT 2005, pages 25–32. Association for Computational Linguistics. [↗](https://doi.org/10.3115/1220575.1220579) [our card](https://md.research.elamur.ai/free/papers/luo-2005-coreference-resolution-performance-metrics/)
4. Peter Bourgonje and Manfred Stede. 2020. The Potsdam Commentary Corpus 2.2: Extending Annotations for Shallow Discourse Parsing. In Proceedings of the 12th Language Resources and Evaluation Conference, pages 1061–1066, Marseille, France. European Language Resources Association. [find](https://scholar.google.com/scholar?q=Peter+Bourgonje+and+Manfred+Stede%2E+2020%2E+The+Potsdam+Commentary+Corpus+2%2E2%3A+Extending+Annotations+for+Shallow+Discourse+Parsing%2E+In+Proceedings+of+the+12th+Language+Resources+and+Evaluation+Conference) [our card](https://md.research.elamur.ai/free/papers/bourgonje-2020-potsdam-commentary-corpus-2-2/)
5. Petter Mæhlum, Dag Haug, Tollef Jørgensen, Andre Kåsen, Anders Nøklestad, Egil Rønningstad, Per Erik Solberg, Erik Velldal, and Lilja Øvrelid. 2022. NARC–Norwegian anaphora resolution corpus. In Proceedings of the Fifth Workshop on Computational Models of Reference, Anaphora and Coreference, pages 48–60, Gyeongju, Korea. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Petter+M%C3%A6hlum%2C+Dag+Haug%2C+Tollef+J%C3%B8rgensen%2C+Andre+K%C3%A5sen%2C+Anders+N%C3%B8klestad%2C+Egil+R%C3%B8nningstad%2C+Per+Erik+Solberg%2C+Erik+Velldal%2C+and+Lilja+%C3%98vrelid%2E+2022%2E+NARC%E2%80%93Norwegian+anaphora+resolution+corpus%2E+In+Proce) [our card](https://md.research.elamur.ai/free/papers/hlum-2022-narc-norwegian-anaphora-resolution-corpus/)
6. Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov. 2020. Unsupervised cross-lingual representation learning at scale. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 8440– 8451, Online. Association for Computational Linguistics. [↗](https://doi.org/10.18653/v1/2020.acl-main.747)
7. Nafise Sadat Moosavi and Michael Strube. 2016. Which coreference evaluation metric do you trust? a proposal for a link-based entity aware metric. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 632–642, Berlin, Germany. Association for Computational Linguistics. [↗](https://doi.org/10.18653/v1/p16-1060) [our card](https://md.research.elamur.ai/free/papers/moosavi-2016-which-coreference-evaluation-metric-do/)
8. Pascal Denis and Jason Baldridge. 2009. Global joint models for coreference resolution and named entity classification. Procesamiento del Lenguaje Natural, (42):87–96. [find](https://scholar.google.com/scholar?q=Pascal+Denis+and+Jason+Baldridge%2E+2009%2E+Global+joint+models+for+coreference+resolution+and+named+entity+classification%2E+Procesamiento+del+Lenguaje+Natural%2C+%2842%29%3A87%E2%80%9396%2E)
9. Vladimir Dobrovolskii. 2021. Word-level coreference resolution. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 7670–7675, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics. [↗](https://doi.org/10.18653/v1/2021.emnlp-main.605) [our card](https://md.research.elamur.ai/free/papers/dobrovolskii-2021-word-level-coreference-resolution/)
10. Anna Nedoluzhko, Michal Novák, Silvie Cinková, Marie Mikulová, and Jiří Mírovský. 2016. Coreference in Prague Czech-English Dependency Treebank. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), pages 169–176, Portorož, Slovenia. European Language Resources Association. [↗](https://doi.org/10.63317/3yqbenvhok5r) [our card](https://md.research.elamur.ai/free/papers/nedoluzhko-2016-coreference-prague-czech-english-dependency/)
11. Jan Hajič, Eduard Bejček, Jaroslava Hlaváčová, Marie Mikulová, Milan Straka, Jan Štěpánek, and Barbora Štěpánková. 2020. Prague Dependency Treebank -Consolidated 1.0. In Proceedings of the 12th International Conference on Language Resources and Evaluation (LREC 2020), pages 5208–5218, Marseille, France. European Language Resources Association. [↗](https://doi.org/10.48550/arxiv.2006.03679)
12. Anna Nedoluzhko, Michal Novák, Martin Popel, Zdeněk Žabokrtský, Amir Zeldes, and Daniel Zeman. 2022. CorefUD 1.0: Coreference meets Universal Dependencies. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 4859–4872, Marseille, France. European Language Resources Association. [↗](https://doi.org/10.63317/5doyxm79bocj) [our card](https://md.research.elamur.ai/free/papers/nedoluzhko-2022-corefud-1-0-coreference-meets/)
13. Mandar Joshi, Omer Levy, Luke Zettlemoyer, and Daniel Weld. 2019. BERT for coreference resolution: Baselines and analysis. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 5803–5808, Hong Kong, China. Association for Computational Linguistics. [↗](https://doi.org/10.18653/v1/d19-1588) [our card](https://md.research.elamur.ai/free/papers/joshi-2019-bert-coreference-resolution-baselines-analysis/)
14. Anna Nedoluzhko, Michal Novák, Martin Popel, Zdeněk Žabokrtský, and Daniel Zeman. 2021. Is one head enough? Mention heads in coreference annotations compared with UD-style heads. In Proceedings of the Sixth International Conference on Dependency Linguistics (Depling, SyntaxFest 2021), pages 101–114, Stroudsburg, PA, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Anna+Nedoluzhko%2C+Michal+Nov%C3%A1k%2C+Martin+Popel%2C+Zdene%CC%8Ck+%C5%BDabokrtsk%C3%BD%2C+and+Daniel+Zeman%2E+2021%2E+Is+one+head+enough%3F+Mention+heads+in+coreference+annotations+compared+with+UD%2Dstyle+heads%2E+In+Proceedings+of+th)
15. Frédéric Landragin. 2021. Le corpus Democrat et son exploitation. Présentation. Langages, 224:11–24. [↗](https://doi.org/10.3917/lang.224.0011)
16. Maciej Ogrodniczuk, Katarzyna Glowińska, Mateusz Kopeć, Agata Savary, and Magdalena Zawisławska. 2013. Polish Coreference Corpus. In Human Language Technology. Challenges for Computer Science and Linguistics — 6th Language and Technology Conference (LTC 2013), Revised Selected Papers, volume 9561 of Lecture Notes in Computer Science, pages 215–226. Springer. [find](https://scholar.google.com/scholar?q=Maciej+Ogrodniczuk%2C+Katarzyna+Glowin%CC%81ska%2C+Mateusz+Kopec%CC%81%2C+Agata+Savary%2C+and+Magdalena+Zawis%C5%82awska%2E+2013%2E+Polish+Coreference+Corpus%2E+In+Human+Language+Technology%2E+Challenges+for+Computer+Science+and+Li)
17. Ekaterina Lapshinova-Koltunski, Christian Hardmeier, and Pauline Krielke. 2018. ParCorFull: a Parallel Corpus Annotated with Full Coreference. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan. European Language Resources Association. [↗](https://doi.org/10.63317/4h7r3ojn4aic) [our card](https://md.research.elamur.ai/free/papers/koltunski-2018-parcorfull-parallel-corpus-annotated-full/)
18. Maciej Ogrodniczuk, Katarzyna Głowińska, Mateusz Kopeć, Agata Savary, and Magdalena Zawisławska. 2015. Coreference in Polish: Annotation, Resolution and Evaluation. Walter De Gruyter. [find](https://scholar.google.com/scholar?q=Maciej+Ogrodniczuk%2C+Katarzyna+G%C5%82owin%CC%81ska%2C+Mateusz+Kopec%CC%81%2C+Agata+Savary%2C+and+Magdalena+Zawis%C5%82awska%2E+2015%2E+Coreference+in+Polish%3A+Annotation%2C+Resolution+and+Evaluation%2E+Walter+De+Gruyter%2E)
19. Marta Recasens, Lluís Màrquez, Emili Sapena, M. Antònia Martí, Mariona Taulé, Véronique Hoste, Massimo Poesio, and Yannick Versley. 2010. SemEval-2010 task 1: Coreference resolution in multiple languages. In Proceedings of the 5th International Workshop on Semantic Evaluation, pages 1–8, Uppsala, Sweden. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Marta+Recasens%2C+Llu%C3%ADs+M%C3%A0rquez%2C+Emili+Sapena%2C+M%2E+Ant%C3%B2nia+Mart%C3%AD%2C+Mariona+Taul%C3%A9%2C+V%C3%A9ronique+Hoste%2C+Massimo+Poesio%2C+and+Yannick+Versley%2E+2010%2E+SemEval%2D2010+task+1%3A+Coreference+resolution+in+multiple+langua) [our card](https://md.research.elamur.ai/free/papers/recasens-2009-semeval-2010-task-1-coreference/)
20. Tuğba Pamay and Gülşen Eryiğit. 2018. Turkish Coreference Resolution. In 2018 Innovations in Intelligent Systems and Applications (INISTA), pages 1–7. [↗](https://doi.org/10.1109/inista.2018.8466293)
21. Marta Recasens and M. Antònia Martí. 2010. AnCora-CO: Coreferentially Annotated Corpora for Spanish and Catalan. Language Resources and Evaluation, 44(4):315–345. [↗](https://doi.org/10.1007/s10579-009-9108-x)
22. Tuğba Pamay Arslan, Kutay Acar, and Gülşen Eryiğit. 2023. Neural End-to-End Coreference Resolution using Morphological Information. In Proceedings of the CRAC 2023 Shared Task on Multilingual Coreference Resolution, pages 34–40. [find](https://scholar.google.com/scholar?q=Tug%CC%86ba+Pamay+Arslan%2C+Kutay+Acar%2C+and+G%C3%BCls%CC%A7en+Eryig%CC%86it%2E+2023%2E+Neural+End%2Dto%2DEnd+Coreference+Resolution+using+Morphological+Information%2E+In+Proceedings+of+the+CRAC+2023+Shared+Task+on+Multilingual+Coref)
23. Milan Straka. 2018. UDPipe 2.0 prototype at CoNLL 2018 UD shared task. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, pages 197–207, Brussels, Belgium. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Milan+Straka%2E+2018%2E+UDPipe+2%2E0+prototype+at+CoNLL+2018+UD+shared+task%2E+In+Proceedings+of+the+CoNLL+2018+Shared+Task%3A+Multilingual+Parsing+from+Raw+Text+to+Universal+Dependencies%2C+pages+197%E2%80%93207%2C+Brusse) [our card](https://md.research.elamur.ai/free/papers/ud-2018-straka-udpipe-2-0-prototype-conll/)
24. Tuğba Pamay Arslan and Gülşen Eryiğit. 2023. Incorporating Dropped Pronouns into Coreference Resolution: The case for Turkish. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop, pages 14–25. [find](https://scholar.google.com/scholar?q=Tug%CC%86ba+Pamay+Arslan+and+G%C3%BCls%CC%A7en+Eryig%CC%86it%2E+2023%2E+Incorporating+Dropped+Pronouns+into+Coreference+Resolution%3A+The+case+for+Turkish%2E+In+Proceedings+of+the+17th+Conference+of+the+European+Chapter+of+the+A)
25. Milan Straka. 2023. ÚFAL CorPipe at CRAC 2023: Larger Context Improves Multilingual Coreference Resolution. In Proceedings of the CRAC 2023 Shared Task on Multilingual Coreference Resolution, pages 41–51. [↗](https://doi.org/10.48448/wbr4-vq92) [our card](https://md.research.elamur.ai/free/papers/straka-2023-fal-corpipe-crac-2023-larger/)
26. Ian Porada and Jackie Chi Kit Cheung. 2023. McGill at CRAC 2023: Multilingual Generalization of Entity-Ranking Coreference Resolution Models. In Proceedings of the CRAC 2023 Shared Task on Multilingual Coreference Resolution, pages 52–57. [find](https://scholar.google.com/scholar?q=Ian+Porada+and+Jackie+Chi+Kit+Cheung%2E+2023%2E+McGill+at+CRAC+2023%3A+Multilingual+Generalization+of+Entity%2DRanking+Coreference+Resolution+Models%2E+In+Proceedings+of+the+CRAC+2023+Shared+Task+on+Multilingua)
27. Milan Straka and Jana Straková. 2022. ÚFAL CorPipe at CRAC 2022: Effectivity of Multilingual Models for Coreference Resolution. In Proceedings of the CRAC 2022 Shared Task on Multilingual Coreference Resolution, pages 28–37. Association for Computational Linguistics. [↗](https://doi.org/10.48550/arxiv.2209.07278) [our card](https://md.research.elamur.ai/free/papers/straka-2022-fal-corpipe-crac-2022-effectivity/)
28. Sameer Pradhan, Xiaoqiang Luo, Marta Recasens, Eduard Hovy, Vincent Ng, and Michael Strube. 2014. Scoring Coreference Partitions of Predicted Mentions: A Reference Implementation. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 30–35, Baltimore, Maryland. Association for Computational Linguistics. [↗](https://doi.org/10.3115/v1/p14-2006) [our card](https://md.research.elamur.ai/free/papers/pradhan-2014-scoring-coreference-partitions-predicted-mentions/)
29. Mariona Taulé, M. Antònia Martí, and Marta Recasens. 2008. AnCora: Multilevel Annotated Corpora for Catalan and Spanish. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC 2008), Marrakech, Morocco. European Language Resources Association. [↗](https://doi.org/10.63317/3e9335sw8bvc)
30. Sameer Pradhan, Alessandro Moschitti, Nianwen Xue, Olga Uryupina, and Yuchen Zhang. 2012. CoNLL-2012 Shared Task: Modeling Multilingual Unrestricted Coreference in OntoNotes. In Joint Conference on EMNLP and CoNLL - Shared Task, pages 1–40, Jeju Island, Korea. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Sameer+Pradhan%2C+Alessandro+Moschitti%2C+Nianwen+Xue%2C+Olga+Uryupina%2C+and+Yuchen+Zhang%2E+2012%2E+CoNLL%2D2012+Shared+Task%3A+Modeling+Multilingual+Unrestricted+Coreference+in+OntoNotes%2E+In+Joint+Conference+on+EM) [our card](https://md.research.elamur.ai/free/papers/pradhan-2012-conll-2012-shared-task-modeling/)
31. Svetlana Toldova, Anna Roytberg, Alina Ladygina, Maria Vasilyeva, Ilya Azerkovich, Matvei Kurzukov, G. Sim, D.V. Gorshkov, A. Ivanova, Anna Nedoluzhko, and Yulia Grishina. 2014. Evaluating Anaphora and Coreference Resolution for Russian. In Komp’juternaja lingvistika i intellektual’nye tehnologii. Po materialam ezhegodnoj Mezhdunarodnoj konferencii Dialog, pages 681–695. [find](https://scholar.google.com/scholar?q=Svetlana+Toldova%2C+Anna+Roytberg%2C+Alina+Ladygina%2C+Maria+Vasilyeva%2C+Ilya+Azerkovich%2C+Matvei+Kurzukov%2C+G%2E+Sim%2C+D%2EV%2E+Gorshkov%2C+A%2E+Ivanova%2C+Anna+Nedoluzhko%2C+and+Yulia+Grishina%2E+2014%2E+Evaluating+Anaphora+an)
32. Ondřej Pražák, Miloslav Konopík, and Jakub Sido. 2021. Multilingual Coreference Resolution with Harmonized Annotations. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021), pages 1119– 1123. [↗](https://doi.org/10.48550/arxiv.2107.12088) [our card](https://md.research.elamur.ai/free/papers/prazak-2021-multilingual-coreference-resolution-harmonized-annotations/)
33. Shubham Toshniwal, Sam Wiseman, Allyson Ettinger, Karen Livescu, and Kevin Gimpel. 2020. Learning to Ignore: Long Document Coreference with Bounded Memory Neural Networks. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 8519–8526, Online. Association for Computational Linguistics. [↗](https://doi.org/10.18653/v1/2020.emnlp-main.685) [our card](https://md.research.elamur.ai/free/papers/toshniwal-2020-learning-ignore-long-document-coreference/)
34. Ondřej Pražák and Miloslav Konopík. 2022. End-to-end Multilingual Coreference Resolution with Mention Head Prediction. In Proceedings of the CRAC 2022 Shared Task on Multilingual Coreference Resolution, pages 23–27. Association for Computational Linguistics. [↗](https://doi.org/10.48550/arxiv.2209.12516) [our card](https://md.research.elamur.ai/free/papers/prazak-2022-end-end-multilingual-coreference-resolution/)
35. Shubham Toshniwal, Patrick Xia, Sam Wiseman, Karen Livescu, and Kevin Gimpel. 2021. On generalization in coreference resolution. In Proceedings of the Fourth Workshop on Computational Models of Reference, Anaphora and Coreference, pages 111–120, Punta Cana, Dominican Republic. Association for Computational Linguistics. [↗](https://doi.org/10.18653/v1/2021.crac-1.12) [our card](https://md.research.elamur.ai/free/papers/toshniwal-2021-generalization-coreference-resolution/)
36. Marta Recasens and Eduard H. Hovy. 2011. BLANC: Implementing the Rand index for coreference evaluation. Natural Language Engineering, 17(4):485– 510. [↗](https://doi.org/10.1017/s135132491000029x)
37. Don Tuggener. 2014. Coreference resolution evaluation for higher level applications. In Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, volume 2: Short Papers, pages 231–235, Gothenburg, Sweden. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Don+Tuggener%2E+2014%2E+Coreference+resolution+evaluation+for+higher+level+applications%2E+In+Proceedings+of+the+14th+Conference+of+the+European+Chapter+of+the+Association+for+Computational+Linguistics%2C+vol) [our card](https://md.research.elamur.ai/free/papers/tuggener-2014-coreference-resolution-evaluation-higher-level/)
38. Language. In Fifth International Conference on Social Networks Analysis, Management and Security, SNAMS 2018, Valencia, Spain, October 15-18, 2018, pages 243–250. IEEE. [find](https://scholar.google.com/scholar?q=Language%2E+In+Fifth+International+Conference+on+Social+Networks+Analysis%2C+Management+and+Security%2C+SNAMS+2018%2C+Valencia%2C+Spain%2C+October+15%2D18%2C+2018%2C+pages+243%E2%80%93250%2E+IEEE%2E)
39. Zdeněk Žabokrtský, Miloslav Konopík, Anna Nedoluzhko, Michal Novák, Maciej Ogrodniczuk, Martin Popel, Ondřej Pražák, Jakub Sido, Daniel Zeman, and Yilun Zhu. 2022. Findings of the Shared Task on Multilingual Coreference Resolution. In Proceedings of the CRAC 2022 Shared Task on Multilingual Coreference Resolution, pages 1–17, Gyeongju, Korea. Association for Computational Linguistics. [↗](https://doi.org/10.18653/v1/2023.crac-sharedtask.1)
40. Olga Uryupina, Ron Artstein, Antonella Bristot, Federica Cavicchio, Francesca Delogu, Kepa J. Rodriguez, and Massimo Poesio. 2020. Annotating a broad range of anaphoric phenomena, in a variety of genres: the ARRAU Corpus. Natural Language Engineering, 26(1):95–128. [↗](https://doi.org/10.1017/s1351324919000056)
41. Noémi Vadász. 2022. Building a manually annotated Hungarian coreference corpus: Workflow and tools. In Proceedings of the Fifth Workshop on Computational Models of Reference, Anaphora and Coreference, pages 38–47, Gyeongju, Korea. Association for Computational Linguistics. [↗](https://doi.org/10.48448/4x6j-qa08) [our card](https://md.research.elamur.ai/free/papers/vadasz-2022-building-manually-annotated-hungarian-coreference/)
42. Marc Vilain, John Burger, John Aberdeen, Dennis Connolly, and Lynette Hirschman. 1995. A model-theoretic coreference scoring scheme. In Sixth Message Understanding Conference (MUC-6): Proceedings of a Conference Held in Columbia, Maryland, November 6-8, 1995. [↗](https://doi.org/10.3115/1072399.1072405) [our card](https://md.research.elamur.ai/free/papers/vilain-1995-model-theoretic-coreference-scoring-scheme/)
43. Veronika Vincze, Klára Hegedűs, Alex Sliz-Nagy, and Richárd Farkas. 2018. SzegedKoref: A Hungarian coreference corpus. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan. European Language Resources Association. [↗](https://doi.org/10.63317/5hghr677923d) [our card](https://md.research.elamur.ai/free/papers/vincze-2018-szegedkoref-hungarian-coreference-corpus/)
44. Linting Xue, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, and Colin Raffel. 2021. mT5: A massively multilingual pre-trained text-to-text transformer. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 483–498, Online. Association for Computational Linguistics. [↗](https://doi.org/10.18653/v1/2021.naacl-main.41)
45. Juntao Yu, Sopan Khosla, Nafise Sadat Moosavi, Silviu Paun, Sameer Pradhan, and Massimo Poesio. 2022. The Universal Anaphora Scorer. In Proceedings of the Language Resources and Evaluation Conference, pages 4873–4883, Marseille, France. European Language Resources Association. [find](https://scholar.google.com/scholar?q=Juntao+Yu%2C+Sopan+Khosla%2C+Nafise+Sadat+Moosavi%2C+Silviu+Paun%2C+Sameer+Pradhan%2C+and+Massimo+Poesio%2E+2022%2E+The+Universal+Anaphora+Scorer%2E+In+Proceedings+of+the+Language+Resources+and+Evaluation+Conference%2C) [our card](https://md.research.elamur.ai/free/papers/yu-2022-universal-anaphora-scorer/)
46. Juntao Yu, Michal Novák, Abdulrahman Aloraini, Nafise Sadat Moosavi, Silviu Paun, Sameer Pradhan, and Massimo Poesio. 2023. The Universal Anaphora Scorer 2.0. In Proceedings of the 15th International Conference on Computational Semantics (IWCS), Nancy, France. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Juntao+Yu%2C+Michal+Nov%C3%A1k%2C+Abdulrahman+Aloraini%2C+Nafise+Sadat+Moosavi%2C+Silviu+Paun%2C+Sameer+Pradhan%2C+and+Massimo+Poesio%2E+2023%2E+The+Universal+Anaphora+Scorer+2%2E0%2E+In+Proceedings+of+the+15th+International+) [our card](https://md.research.elamur.ai/free/papers/yu-2023-universal-anaphora-scorer-2-0/)
47. Amir Zeldes. 2017. The GUM Corpus: Creating Multilayer Resources in the Classroom. Language Resources and Evaluation, 51(3):581–612. [↗](https://doi.org/10.1007/s10579-016-9343-x)
48. Voldemaras Žitkus and Rita Butkienė. 2018. Coreference Annotation Scheme and Corpus for Lithuanian [find](https://scholar.google.com/scholar?q=Voldemaras+%C5%BDitkus+and+Rita+Butkiene%CC%87%2E+2018%2E+Coreference+Annotation+Scheme+and+Corpus+for+Lithuanian)