---
title: "Linear Cross-document Event Coreference — Ahmed 2024"
description: "Resolving event coreference by comparing every pair of mentions scales quadratically."
authors: ["Shafiuddin Rehan Ahmed", "George Arthur Baker", "Evi Judge", "Michael Reagan", "Kristin Wright-Bettner", "Martha Palmer", "James H. Martin"]
year: 2024
venue: "Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)"
source: "https://aclanthology.org/2024.lrec-main.920/"
arxiv: "2404.08656"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/papers/ahmed-2024-linear-cross-document-event-coreference/"
---
[Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/ahmed-2024-linear-cross-document-event-coreference/)

[home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2024](https://md.research.elamur.ai/free/papers/2024/page/2/) / Linear Cross-document Event Coreference Resolution with X-AMR

# Linear Cross-document Event Coreference Resolution with X-AMR

**Authors:** [Shafiuddin Rehan Ahmed](https://md.research.elamur.ai/free/authors/shafiuddin-rehan-ahmed/), [George Arthur Baker](https://md.research.elamur.ai/free/authors/george-arthur-baker/), Evi Judge, Michael Reagan, [Kristin Wright-Bettner](https://md.research.elamur.ai/free/authors/kristin-wright-bettner/), [Martha Palmer](https://md.research.elamur.ai/free/authors/martha-palmer/), [James H. Martin](https://md.research.elamur.ai/free/authors/james-h-martin/) · **Year:** 2024 · **Venue:** Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2024.lrec-main.920/) · [PDF](https://aclanthology.org/2024.lrec-main.920.pdf) · [arXiv 2404.08656](https://arxiv.org/abs/2404.08656) · [OpenAlex](https://openalex.org/W7131868164)

**Citations:** 3 citations (openalex-snapshot · 2026-10-14) · [6](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
Resolving event coreference by comparing every pair of mentions scales quadratically. This becomes very costly with large corpora and especially with LLM prompting. The authors replace pairwise scoring with a compact symbolic representation called X-AMR, a cross-document extension of Abstract Meaning Representation. For each event mention, X-AMR stores:
- a PropBank roleset
- four core arguments: ARG-0, ARG-1, ARG-Loc and ARG-Time

Arguments are linked across documents through a knowledge base (Wikipedia), and synonymous predicates are grouped with VerbNet classes. A multi-hop algorithm then clusters mentions over these graphs in linear time. The method is also interpretable, since each decision can be traced to graph components.

The authors enriched the ECB+ corpus with human X-AMR annotations using a prodi.gy-based model-in-the-loop tool. They then had GPT-4 generate the same graphs in zero-shot and few-shot settings, guided by condensed annotation guidelines, and compared the results with human annotations. The provided excerpt omits the results section, so GPT-4's scores are not reported here. The work offers a cheaper and more transparent route to cross-document ECR and probes where current LLMs fall short at this task.

## Key points
- **X-AMR design:** each event is reduced to a roleset plus ARG-0, ARG-1, ARG-Loc and ARG-Time. Nested (eventive) ARG-1 values are allowed, e.g. sign.02 taking agree.01 as its ARG-1.
- **Annotation coverage:** all ECB+ mentions received roleset IDs, and 5,287 of 6,833 mentions also received full X-AMR. Only the Dev split is completely annotated.
- **Annotation process and agreement:** two linguistics students annotated, with an adjudicator resolving disagreements. Roleset ID inter-annotator agreement was 0.84 (Train), 0.91 (Dev) and 0.80 (Test), so Dev serves as the experimental benchmark.
- **Resources:** PropBank (over 11,000 Frame Files), VerbNet and Wikipedia identifiers, the latter chosen because GPT handles them well. Code and annotations are at github.com/ahmeshaf/gpt_coref.
- **LLM evaluation:** GPT-4 produced X-AMR graphs in zero-shot and few-shot setups. These were fed to the linear ECR algorithm and compared with gold-standard human graphs.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/)

Topics: [Coreference resolution](https://md.research.elamur.ai/free/topics/coreference-resolution/) · [Semantic role labeling](https://md.research.elamur.ai/free/topics/semantic-role-labeling/)

## Cited by

Cited by

6 papers of our library cite it (of the 140673 whose bibliographies we read); 1 of them have a page here, 5 not yet.

- [Okay, Let's Do This! Modeling Event Coreference with Generated Rationales and Knowledge Distillation](https://md.research.elamur.ai/free/papers/nath-2024-okay-let-s-do-this/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{ahmed2024linear,
  title = {{Linear Cross-document Event Coreference Resolution with X-AMR}},
  author = {Ahmed, Shafiuddin Rehan and Baker, George Arthur and Judge, Evi and Reagan, Michael and Wright-Bettner, Kristin and Palmer, Martha and Martin, James H.},
  booktitle = {Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)},
  year = {2024},
  doi = {10.63317/2r4vo8v943yz},
  eprint = {2404.08656},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.63317/2r4vo8v943yz}
}
```

- [← previous LightRAG: Simple and Fast Retrieval-Augmented Generation](https://md.research.elamur.ai/free/papers/guo-2024-lightrag-simple-fast-retrieval-augmented/)
- [next → LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code](https://md.research.elamur.ai/free/papers/jain-2024-livecodebench-holistic-contamination-free-evaluation/)
- [↑ back to papers of 2024](https://md.research.elamur.ai/free/papers/2024/page/2/)

## References

52 references, 21 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. We want to thank the reviewers of LREC-COLING 2024 who helped improve this paper. Part of this work was done during an internship of one of the authors at ExplosionAI GmbH. We would also like to thank Ákos Kádár, Matthew Hannibal, Nikhil Krishnaswamy, Elizabeth Spaulding, and the Boul-derNLP group f… [find](https://scholar.google.com/scholar?q=We+want+to+thank+the+reviewers+of+LREC%2DCOLING+2024+who+helped+improve+this+paper%2E+Part+of+this+work+was+done+during+an+internship+of+one+of+the+authors+at+ExplosionAI+GmbH%2E+We+would+also+like+to+thank)
2. Bibliographical Resources Shafiuddin Rehan Ahmed, Jon Cai, Martha Palmer, and James H. Martin. 2024. X-AMR annotation tool. In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations, Shafiuddin Rehan Ahmed, Abhijnan Nath, Ja… [find](https://scholar.google.com/scholar?q=Bibliographical+Resources+Shafiuddin+Rehan+Ahmed%2C+Jon+Cai%2C+Martha+Palmer%2C+and+James+H%2E+Martin%2E+2024%2E+X%2DAMR+annotation+tool%2E+In+Proceedings+of+the+18th+Conference+of+the+European+Chapter+of+the+Associa)
3. Shafiuddin Rehan Ahmed, Abhijnan Nath, Michael Regan, Adam Pollins, Nikhil Krishnaswamy, and James H. Martin. 2023b. How good is the model in model-in-the-loop event coreference resolution annotation? In Proceedings of the 17th Linguistic Annotation Workshop (LAW-XVII), pages 136–145, Toronto, Canad… [find](https://scholar.google.com/scholar?q=Shafiuddin+Rehan+Ahmed%2C+Abhijnan+Nath%2C+Michael+Regan%2C+Adam+Pollins%2C+Nikhil+Krishnaswamy%2C+and+James+H%2E+Martin%2E+2023b%2E+How+good+is+the+model+in+model%2Din%2Dthe%2Dloop+event+coreference+resolution+annotation%3F)
4. Amit Bagga and Breck Baldwin. 1998. Algorithms for scoring coreference chains. In In The First International Conference on Language Resources and Evaluation Workshop on Linguistics Coreference, pages 563–566. [find](https://scholar.google.com/scholar?q=Amit+Bagga+and+Breck+Baldwin%2E+1998%2E+Algorithms+for+scoring+coreference+chains%2E+In+In+The+First+International+Conference+on+Language+Resources+and+Evaluation+Workshop+on+Linguistics+Coreference%2C+pages+) [our card](https://md.research.elamur.ai/free/papers/bagga-1998-algorithms-scoring-coreference-chains/)
5. Laura Banarescu, Claire Bonial, Shu Cai, Madalina Georgescu, Kira Griffitt, Ulf Hermjakob, Kevin Knight, Philipp Koehn, Martha Palmer, and Nathan Schneider. 2013. Abstract Meaning Representation for sembanking. In Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discou… [find](https://scholar.google.com/scholar?q=Laura+Banarescu%2C+Claire+Bonial%2C+Shu+Cai%2C+Madalina+Georgescu%2C+Kira+Griffitt%2C+Ulf+Hermjakob%2C+Kevin+Knight%2C+Philipp+Koehn%2C+Martha+Palmer%2C+and+Nathan+Schneider%2E+2013%2E+Abstract+Meaning+Representation+for+s) [our card](https://md.research.elamur.ai/free/papers/banarescu-2013-abstract-meaning-representation-sembanking/)
6. Cosmin Bejan and Sanda Harabagiu. 2010. Unsupervised event coreference resolution with rich linguistic features. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 1412–1422, Uppsala, Sweden. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Cosmin+Bejan+and+Sanda+Harabagiu%2E+2010%2E+Unsupervised+event+coreference+resolution+with+rich+linguistic+features%2E+In+Proceedings+of+the+48th+Annual+Meeting+of+the+Association+for+Computational+Linguist) [our card](https://md.research.elamur.ai/free/papers/bejan-2010-unsupervised-event-coreference-resolution-rich/)
7. Iz Beltagy, Matthew E. Peters, and Arman Cohan. 2020. Longformer: The long-document transformer. [find](https://scholar.google.com/scholar?q=Iz+Beltagy%2C+Matthew+E%2E+Peters%2C+and+Arman+Cohan%2E+2020%2E+Longformer%3A+The+long%2Ddocument+transformer%2E)
8. Susan Windisch Brown, Julia Bonn, Ghazaleh Kazeminejad, Annie Zaenen, James Pustejovsky, and Martha Palmer. 2022. Semantic representations for nlp using verbnet and the generative lexicon. Frontiers in Artificial Intelligence, 5. [find](https://scholar.google.com/scholar?q=Susan+Windisch+Brown%2C+Julia+Bonn%2C+Ghazaleh+Kazeminejad%2C+Annie+Zaenen%2C+James+Pustejovsky%2C+and+Martha+Palmer%2E+2022%2E+Semantic+representations+for+nlp+using+verbnet+and+the+generative+lexicon%2E+Frontiers+i)
9. Susan Windisch Brown, Dmitriy Dligach, and Martha Palmer. 2011. VerbNet class assignment as a WSD task. In Proceedings of the Ninth International Conference on Computational Semantics (IWCS 2011). [find](https://scholar.google.com/scholar?q=Susan+Windisch+Brown%2C+Dmitriy+Dligach%2C+and+Martha+Palmer%2E+2011%2E+VerbNet+class+assignment+as+a+WSD+task%2E+In+Proceedings+of+the+Ninth+International+Conference+on+Computational+Semantics+%28IWCS+2011%29%2E)
10. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chri… [find](https://scholar.google.com/scholar?q=Tom+Brown%2C+Benjamin+Mann%2C+Nick+Ryder%2C+Melanie+Subbiah%2C+Jared+D+Kaplan%2C+Prafulla+Dhariwal%2C+Arvind+Neelakantan%2C+Pranav+Shyam%2C+Girish+Sastry%2C+Amanda+Askell%2C+Sandhini+Agarwal%2C+Ariel+Herbert%2DVoss%2C+Gretchen)
11. Agata Cybulska and Piek Vossen. 2013. Semantic relations between events and their time, locations and participants for event coreference resolution. In Proceedings of the International Conference Recent Advances in Natural Language Processing RANLP 2013, pages 156–163, Hissar, Bulgaria. INCOMA Ltd.… [find](https://scholar.google.com/scholar?q=Agata+Cybulska+and+Piek+Vossen%2E+2013%2E+Semantic+relations+between+events+and+their+time%2C+locations+and+participants+for+event+coreference+resolution%2E+In+Proceedings+of+the+International+Conference+Rece) [our card](https://md.research.elamur.ai/free/papers/cybulska-2013-semantic-relations-between-events-their/)
12. Avi Caciularu, Arman Cohan, Iz Beltagy, Matthew Peters, Arie Cattan, and Ido Dagan. 2021. CDLM: Cross-document language modeling. In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 2648–2662, Punta Cana, Dominican Republic. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Avi+Caciularu%2C+Arman+Cohan%2C+Iz+Beltagy%2C+Matthew+Peters%2C+Arie+Cattan%2C+and+Ido+Dagan%2E+2021%2E+CDLM%3A+Cross%2Ddocument+language+modeling%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+EMNLP+20)
13. Donald Davidson. 1969. The Individuation of Events, pages 216–234. Springer Netherlands, Dordrecht. [find](https://scholar.google.com/scholar?q=Donald+Davidson%2E+1969%2E+The+Individuation+of+Events%2C+pages+216%E2%80%93234%2E+Springer+Netherlands%2C+Dordrecht%2E)
14. Jon Cai, Shafiuddin Rehan Ahmed, Julia Bonn, Kristin Wright-Bettner, Martha Palmer, and James H. Martin. 2023. CAMRA: Copilot for AMR annotation. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 381–388, Singapore. Association fo… [find](https://scholar.google.com/scholar?q=Jon+Cai%2C+Shafiuddin+Rehan+Ahmed%2C+Julia+Bonn%2C+Kristin+Wright%2DBettner%2C+Martha+Palmer%2C+and+James+H%2E+Martin%2E+2023%2E+CAMRA%3A+Copilot+for+AMR+annotation%2E+In+Proceedings+of+the+2023+Conference+on+Empirical+Met)
15. Arie Cattan, Alon Eirew, Gabriel Stanovsky, Mandar Joshi, and Ido Dagan. 2021. Cross-document coreference resolution over predicted mentions. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 5100– 5107, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Arie+Cattan%2C+Alon+Eirew%2C+Gabriel+Stanovsky%2C+Mandar+Joshi%2C+and+Ido+Dagan%2E+2021%2E+Cross%2Ddocument+coreference+resolution+over+predicted+mentions%2E+In+Findings+of+the+Association+for+Computational+Linguisti) [our card](https://md.research.elamur.ai/free/papers/cattan-2021-cross-document-coreference-resolution-over/)
16. Prafulla Kumar Choubey and Ruihong Huang. 2017. Event coreference resolution by iteratively unfolding inter-dependencies among events. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 2124–2133, Copenhagen, Denmark. Association for Computational Lingui… [find](https://scholar.google.com/scholar?q=Prafulla+Kumar+Choubey+and+Ruihong+Huang%2E+2017%2E+Event+coreference+resolution+by+iteratively+unfolding+inter%2Ddependencies+among+events%2E+In+Proceedings+of+the+2017+Conference+on+Empirical+Methods+in+Nat) [our card](https://md.research.elamur.ai/free/papers/choubey-2017-event-coreference-resolution-iteratively-unfolding/)
17. Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Eric Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Zhao, Yanping Huang, A… [find](https://scholar.google.com/scholar?q=Hyung+Won+Chung%2C+Le+Hou%2C+Shayne+Longpre%2C+Barret+Zoph%2C+Yi+Tay%2C+William+Fedus%2C+Eric+Li%2C+Xuezhi+Wang%2C+Mostafa+Dehghani%2C+Siddhartha+Brahma%2C+Albert+Webson%2C+Shixiang+Shane+Gu%2C+Zhuyun+Dai%2C+Mirac+Suzgun%2C+Xiny)
18. Agata Cybulska and Piek Vossen. 2014. Using a sledgehammer to crack a nut? lexical diversity and event coreference resolution. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC’14), pages 4545–4552, Reykjavik, Iceland. European Language Resources Associa… [find](https://scholar.google.com/scholar?q=Agata+Cybulska+and+Piek+Vossen%2E+2014%2E+Using+a+sledgehammer+to+crack+a+nut%3F+lexical+diversity+and+event+coreference+resolution%2E+In+Proceedings+of+the+Ninth+International+Conference+on+Language+Resource) [our card](https://md.research.elamur.ai/free/papers/cybulska-2014-sledgehammer-crack-nut-lexical-diversity/)
19. Pascal Denis and Jason Baldridge. 2009. Global joint models for coreference resolution and named entity classification. Procesamiento del Lenguaje Natural. [find](https://scholar.google.com/scholar?q=Pascal+Denis+and+Jason+Baldridge%2E+2009%2E+Global+joint+models+for+coreference+resolution+and+named+entity+classification%2E+Procesamiento+del+Lenguaje+Natural%2E)
20. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,… [find](https://scholar.google.com/scholar?q=Jacob+Devlin%2C+Ming%2DWei+Chang%2C+Kenton+Lee%2C+and+Kristina+Toutanova%2E+2019%2E+BERT%3A+Pre%2Dtraining+of+deep+bidirectional+transformers+for+language+understanding%2E+In+Proceedings+of+the+2019+Conference+of+the+N)
21. Jeffrey Flanigan, Sam Thomson, Jaime Carbonell, Chris Dyer, and Noah A. Smith. 2014. A discriminative graph-based parser for the Abstract Meaning Representation. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1426–1436, Balti… [find](https://scholar.google.com/scholar?q=Jeffrey+Flanigan%2C+Sam+Thomson%2C+Jaime+Carbonell%2C+Chris+Dyer%2C+and+Noah+A%2E+Smith%2E+2014%2E+A+discriminative+graph%2Dbased+parser+for+the+Abstract+Meaning+Representation%2E+In+Proceedings+of+the+52nd+Annual+Meet)
22. Nicola Guarino, Riccardo Baratella, and Giancarlo Guizzardi. 2022. Events, their names, and their synchronic structure. Applied ontology, 17(2):249–283. [find](https://scholar.google.com/scholar?q=Nicola+Guarino%2C+Riccardo+Baratella%2C+and+Giancarlo+Guizzardi%2E+2022%2E+Events%2C+their+names%2C+and+their+synchronic+structure%2E+Applied+ontology%2C+17%282%29%3A249%E2%80%93283%2E)
23. William Held, Dan Iter, and Dan Jurafsky. 2021. Focus on what matters: Applying discourse coherence theory to cross document coreference. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 1406–1417, Online and Punta Cana, Dominican Republic. Association… [find](https://scholar.google.com/scholar?q=William+Held%2C+Dan+Iter%2C+and+Dan+Jurafsky%2E+2021%2E+Focus+on+what+matters%3A+Applying+discourse+coherence+theory+to+cross+document+coreference%2E+In+Proceedings+of+the+2021+Conference+on+Empirical+Methods+in+) [our card](https://md.research.elamur.ai/free/papers/held-2021-focus-what-matters-applying-discourse/)
24. Kian Kenyon-Dean, Jackie Chi Kit Cheung, and Doina Precup. 2018. Resolving event coreference with supervised representation learning and clustering-oriented regularization. preprint arXiv:1805.10985. 2016), pages 47–56, Austin, Texas. Association for Computational Linguistics. arXiv Takeshi Kojima,… [find](https://scholar.google.com/scholar?q=Kian+Kenyon%2DDean%2C+Jackie+Chi+Kit+Cheung%2C+and+Doina+Precup%2E+2018%2E+Resolving+event+coreference+with+supervised+representation+learning+and+clustering%2Doriented+regularization%2E+preprint+arXiv%3A1805%2E10985%2E+) [our card](https://md.research.elamur.ai/free/papers/dean-2018-resolving-event-coreference-supervised-representation/)
25. Sha Li, Heng Ji, and Jiawei Han. 2021. Document-level event argument extraction by conditional generation. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 894–908, Online. Association for Computa… [find](https://scholar.google.com/scholar?q=Sha+Li%2C+Heng+Ji%2C+and+Jiawei+Han%2E+2021%2E+Document%2Dlevel+event+argument+extraction+by+conditional+generation%2E+In+Proceedings+of+the+2021+Conference+of+the+North+American+Chapter+of+the+Association+for+Co) [our card](https://md.research.elamur.ai/free/papers/li-2021-document-level-event-argument-extraction/)
26. Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized bert pre-training approach. [find](https://scholar.google.com/scholar?q=Yinhan+Liu%2C+Myle+Ott%2C+Naman+Goyal%2C+Jingfei+Du%2C+Mandar+Joshi%2C+Danqi+Chen%2C+Omer+Levy%2C+Mike+Lewis%2C+Luke+Zettlemoyer%2C+and+Veselin+Stoyanov%2E+2019%2E+Roberta%3A+A+robustly+optimized+bert+pre%2Dtraining+approach%2E)
27. Lawrence Brian Lombard. 2019. Events: A metaphysical study. Routledge. [find](https://scholar.google.com/scholar?q=Lawrence+Brian+Lombard%2E+2019%2E+Events%3A+A+metaphysical+study%2E+Routledge%2E)
28. Xiaoqiang Luo. 2005. On coreference resolution performance metrics. In Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing, HLT ’05, page 25–32, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Xiaoqiang+Luo%2E+2005%2E+On+coreference+resolution+performance+metrics%2E+In+Proceedings+of+the+Conference+on+Human+Language+Technology+and+Empirical+Methods+in+Natural+Language+Processing%2C+HLT+%E2%80%9905%2C+page+25) [our card](https://md.research.elamur.ai/free/papers/luo-2005-coreference-resolution-performance-metrics/)
29. Xiaoqiang Luo, Sameer Pradhan, Marta Recasens, and Eduard Hovy. 2014. An extension of BLANC to system mentions. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 24–29, Baltimore, Maryland. Association for Computational Linguis… [find](https://scholar.google.com/scholar?q=Xiaoqiang+Luo%2C+Sameer+Pradhan%2C+Marta+Recasens%2C+and+Eduard+Hovy%2E+2014%2E+An+extension+of+BLANC+to+system+mentions%2E+In+Proceedings+of+the+52nd+Annual+Meeting+of+the+Association+for+Computational+Linguisti)
30. Inbal Magar and Roy Schwartz. 2022. Data contamination: From memorization to exploitation. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 157–165, Dublin, Ireland. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Inbal+Magar+and+Roy+Schwartz%2E+2022%2E+Data+contamination%3A+From+memorization+to+exploitation%2E+In+Proceedings+of+the+60th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volume+2%3A+Short+P)
31. Nafise Sadat Moosavi, Leo Born, Massimo Poesio, and Michael Strube. 2019. Using automatically extracted minimum spans to disentangle coreference evaluation from boundary detection. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4168–4178, Florence,… [find](https://scholar.google.com/scholar?q=Nafise+Sadat+Moosavi%2C+Leo+Born%2C+Massimo+Poesio%2C+and+Michael+Strube%2E+2019%2E+Using+automatically+extracted+minimum+spans+to+disentangle+coreference+evaluation+from+boundary+detection%2E+In+Proceedings+of+t) [our card](https://md.research.elamur.ai/free/papers/moosavi-2019-automatically-extracted-minimum-spans-disentangle/)
32. Tim O’Gorman, Kristin Wright-Bettner, and Martha Palmer. 2016. Richer event description: Integrating event coreference with temporal, causal and bridging annotation. In Proceedings of the 2nd Workshop on Computing News Storylines (CNS OpenAI. 2023. Gpt-4 technical report. [find](https://scholar.google.com/scholar?q=Tim+O%E2%80%99Gorman%2C+Kristin+Wright%2DBettner%2C+and+Martha+Palmer%2E+2016%2E+Richer+event+description%3A+Integrating+event+coreference+with+temporal%2C+causal+and+bridging+annotation%2E+In+Proceedings+of+the+2nd+Workshop) [our card](https://md.research.elamur.ai/free/papers/gorman-2016-richer-event-description-integrating-event/)
33. Martha Palmer, Daniel Gildea, and Paul Kingsbury. 2005. The Proposition Bank: An annotated corpus of semantic roles. Computational Linguistics, 31(1):71–106. [find](https://scholar.google.com/scholar?q=Martha+Palmer%2C+Daniel+Gildea%2C+and+Paul+Kingsbury%2E+2005%2E+The+Proposition+Bank%3A+An+annotated+corpus+of+semantic+roles%2E+Computational+Linguistics%2C+31%281%29%3A71%E2%80%93106%2E) [our card](https://md.research.elamur.ai/free/papers/palmer-2005-proposition-bank-annotated-corpus-semantic/)
34. Sameer Pradhan, Julia Bonn, Skatje Myers, Kathryn Conger, Tim O’gorman, James Gung, Kristin Wright-bettner, and Martha Palmer. 2022. PropBank comes of Age—Larger, smarter, and more diverse. In Proceedings of the 11th Joint Conference on Lexical and Computational Semantics, pages 278–288, Seattle, Wa… [find](https://scholar.google.com/scholar?q=Sameer+Pradhan%2C+Julia+Bonn%2C+Skatje+Myers%2C+Kathryn+Conger%2C+Tim+O%E2%80%99gorman%2C+James+Gung%2C+Kristin+Wright%2Dbettner%2C+and+Martha+Palmer%2E+2022%2E+PropBank+comes+of+Age%E2%80%94Larger%2C+smarter%2C+and+more+diverse%2E+In+Proceed) [our card](https://md.research.elamur.ai/free/papers/pradhan-2022-propbank-comes-age-larger-smarter/)
35. Sameer Pradhan, Xiaoqiang Luo, Marta Recasens, Eduard Hovy, Vincent Ng, and Michael Strube. 2014. Scoring coreference partitions of predicted mentions: A reference implementation. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pag… [find](https://scholar.google.com/scholar?q=Sameer+Pradhan%2C+Xiaoqiang+Luo%2C+Marta+Recasens%2C+Eduard+Hovy%2C+Vincent+Ng%2C+and+Michael+Strube%2E+2014%2E+Scoring+coreference+partitions+of+predicted+mentions%3A+A+reference+implementation%2E+In+Proceedings+of+th) [our card](https://md.research.elamur.ai/free/papers/pradhan-2014-scoring-coreference-partitions-predicted-mentions/)
36. Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, et al. 2018. Improving language understanding by generative pre-training. [find](https://scholar.google.com/scholar?q=Alec+Radford%2C+Karthik+Narasimhan%2C+Tim+Salimans%2C+Ilya+Sutskever%2C+et+al%2E+2018%2E+Improving+language+understanding+by+generative+pre%2Dtraining%2E)
37. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9. [find](https://scholar.google.com/scholar?q=Alec+Radford%2C+Jeffrey+Wu%2C+Rewon+Child%2C+David+Luan%2C+Dario+Amodei%2C+Ilya+Sutskever%2C+et+al%2E+2019%2E+Language+models+are+unsupervised+multitask+learners%2E+OpenAI+blog%2C+1%288%29%3A9%2E)
38. Karin Kipper Schuler. 2005. VerbNet: A broad-coverage, comprehensive verb lexicon. University of Pennsylvania. [find](https://scholar.google.com/scholar?q=Karin+Kipper+Schuler%2E+2005%2E+VerbNet%3A+A+broad%2Dcoverage%2C+comprehensive+verb+lexicon%2E+University+of+Pennsylvania%2E)
39. Zhiyi Song, Ann Bies, Justin Mott, Xuansong Li, Stephanie Strassel, and Christopher Caruso. 2018. Cross-document, cross-language event coreference annotation using event hoppers. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan… [find](https://scholar.google.com/scholar?q=Zhiyi+Song%2C+Ann+Bies%2C+Justin+Mott%2C+Xuansong+Li%2C+Stephanie+Strassel%2C+and+Christopher+Caruso%2E+2018%2E+Cross%2Ddocument%2C+cross%2Dlanguage+event+coreference+annotation+using+event+hoppers%2E+In+Proceedings+of+the) [our card](https://md.research.elamur.ai/free/papers/song-2018-cross-document-cross-language-event/)
40. Zhiyi Song, Ann Bies, Stephanie Strassel, Tom Riese, Justin Mott, Joe Ellis, Jonathan Wright, Seth Kulick, Neville Ryant, and Xiaoyi Ma. 2015. From light to rich ERE: Annotation of entities, relations, and events. In Proceedings of the The 3rd Workshop on EVENTS: Definition, Detection, Coreference,… [find](https://scholar.google.com/scholar?q=Zhiyi+Song%2C+Ann+Bies%2C+Stephanie+Strassel%2C+Tom+Riese%2C+Justin+Mott%2C+Joe+Ellis%2C+Jonathan+Wright%2C+Seth+Kulick%2C+Neville+Ryant%2C+and+Xiaoyi+Ma%2E+2015%2E+From+light+to+rich+ERE%3A+Annotation+of+entities%2C+relations)
41. Elizabeth Spaulding, Kathryn Conger, Anatole Gershman, Mahir Morshed, Susan Windisch Brown, James Pustejovsky, Rosario Uceda-Sosa, Sijia Ge, and Martha Palmer. 2024. PropBank goes public: Incorporation into Wikidata. In Proceedings of The 18th Linguistic Annotation Workshop (LAW-XVIII), pages 166–17… [find](https://scholar.google.com/scholar?q=Elizabeth+Spaulding%2C+Kathryn+Conger%2C+Anatole+Gershman%2C+Mahir+Morshed%2C+Susan+Windisch+Brown%2C+James+Pustejovsky%2C+Rosario+Uceda%2DSosa%2C+Sijia+Ge%2C+and+Martha+Palmer%2E+2024%2E+PropBank+goes+public%3A+Incorporatio)
42. Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. 2023. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288. [find](https://scholar.google.com/scholar?q=Hugo+Touvron%2C+Louis+Martin%2C+Kevin+Stone%2C+Peter+Albert%2C+Amjad+Almahairi%2C+Yasmine+Babaei%2C+Nikolay+Bashlykov%2C+Soumya+Batra%2C+Prajjwal+Bhargava%2C+Shruti+Bhosale%2C+et+al%2E+2023%2E+Llama+2%3A+Open+foundation+and+fi)
43. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc. [find](https://scholar.google.com/scholar?q=Ashish+Vaswani%2C+Noam+Shazeer%2C+Niki+Parmar%2C+Jakob+Uszkoreit%2C+Llion+Jones%2C+Aidan+N+Gomez%2C+%C5%81+ukasz+Kaiser%2C+and+Illia+Polosukhin%2E+2017%2E+Attention+is+all+you+need%2E+In+Advances+in+Neural+Information+Process)
44. Marc Vilain, John Burger, John Aberdeen, Dennis Connolly, and Lynette Hirschman. 1995. A model-theoretic coreference scoring scheme. In Proceedings of the 6th Conference on Message Understanding, MUC6 ’95, page 45–52, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Marc+Vilain%2C+John+Burger%2C+John+Aberdeen%2C+Dennis+Connolly%2C+and+Lynette+Hirschman%2E+1995%2E+A+model%2Dtheoretic+coreference+scoring+scheme%2E+In+Proceedings+of+the+6th+Conference+on+Message+Understanding%2C+MUC6) [our card](https://md.research.elamur.ai/free/papers/vilain-1995-model-theoretic-coreference-scoring-scheme/)
45. Xiaozhi Wang, Ziqi Wang, Xu Han, Wangyi Jiang, Rong Han, Zhiyuan Liu, Juanzi Li, Peng Li, Yankai Lin, and Jie Zhou. 2020. MAVEN: A Massive General Domain Event Detection Dataset. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1652–1671, Onlin… [find](https://scholar.google.com/scholar?q=Xiaozhi+Wang%2C+Ziqi+Wang%2C+Xu+Han%2C+Wangyi+Jiang%2C+Rong+Han%2C+Zhiyuan+Liu%2C+Juanzi+Li%2C+Peng+Li%2C+Yankai+Lin%2C+and+Jie+Zhou%2E+2020%2E+MAVEN%3A+A+Massive+General+Domain+Event+Detection+Dataset%2E+In+Proceedings+of+the) [our card](https://md.research.elamur.ai/free/papers/wang-2020-maven-massive-general-domain-event/)
46. Runxin Xu, Peiyi Wang, Tianyu Liu, Shuang Zeng, Baobao Chang, and Zhifang Sui. 2022. A two-stream AMR-enhanced model for document-level event argument extraction. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Tech… [find](https://scholar.google.com/scholar?q=Runxin+Xu%2C+Peiyi+Wang%2C+Tianyu+Liu%2C+Shuang+Zeng%2C+Baobao+Chang%2C+and+Zhifang+Sui%2E+2022%2E+A+two%2Dstream+AMR%2Denhanced+model+for+document%2Dlevel+event+argument+extraction%2E+In+Proceedings+of+the+2022+Conference)
47. Xianjun Yang, Yujie Lu, and Linda Petzold. 2022a. Few-shot document-level event argument extraction. ArXiv, abs/2209.02203. [find](https://scholar.google.com/scholar?q=Xianjun+Yang%2C+Yujie+Lu%2C+and+Linda+Petzold%2E+2022a%2E+Few%2Dshot+document%2Dlevel+event+argument+extraction%2E+ArXiv%2C+abs%2F2209%2E02203%2E)
48. Xiaohan Yang, Eduardo Peynetti, Vasco Meerman, and Chris Tanner. 2022b. What GPT knows about who is who. In Proceedings of the Third Workshop on Insights from Negative Results in NLP, pages 75–81, Dublin, Ireland. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Xiaohan+Yang%2C+Eduardo+Peynetti%2C+Vasco+Meerman%2C+and+Chris+Tanner%2E+2022b%2E+What+GPT+knows+about+who+is+who%2E+In+Proceedings+of+the+Third+Workshop+on+Insights+from+Negative+Results+in+NLP%2C+pages+75%E2%80%9381%2C+Dub)
49. Zhisong Zhang, Emma Strubell, and Eduard Hovy. 2022. Transfer learning from semantic role labeling to event argument extraction with template-based slot querying. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 2627–2647, Abu Dhabi, United Arab Emirat… [find](https://scholar.google.com/scholar?q=Zhisong+Zhang%2C+Emma+Strubell%2C+and+Eduard+Hovy%2E+2022%2E+Transfer+learning+from+semantic+role+labeling+to+event+argument+extraction+with+template%2Dbased+slot+querying%2E+In+Proceedings+of+the+2022+Conference)
50. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, brian ichter, Fei Xia, Ed Chi, Quoc V Le, and Denny Zhou. 2022. Chain-of-thought prompting elicits reasoning in large language models. In Advances in Neural Information Processing Systems, volume 35, pages 24824– 24837. Curran Associates, Inc. [find](https://scholar.google.com/scholar?q=Jason+Wei%2C+Xuezhi+Wang%2C+Dale+Schuurmans%2C+Maarten+Bosma%2C+brian+ichter%2C+Fei+Xia%2C+Ed+Chi%2C+Quoc+V+Le%2C+and+Denny+Zhou%2E+2022%2E+Chain%2Dof%2Dthought+prompting+elicits+reasoning+in+large+language+models%2E+In+Advanc) [our card](https://md.research.elamur.ai/free/papers/wei-2022-chain-thought-prompting-elicits-reasoning/)
51. Kristin Wright-Bettner, Martha Palmer, Guergana Savova, Piet de Groen, and Timothy Miller. 2019. Cross-document coreference: An approach to capturing coreference without context. In Proceedings of the Tenth International Workshop on Health Text Mining and Information Analysis (LOUHI 2019), pages 1–1… [find](https://scholar.google.com/scholar?q=Kristin+Wright%2DBettner%2C+Martha+Palmer%2C+Guergana+Savova%2C+Piet+de+Groen%2C+and+Timothy+Miller%2E+2019%2E+Cross%2Ddocument+coreference%3A+An+approach+to+capturing+coreference+without+context%2E+In+Proceedings+of+the) [our card](https://md.research.elamur.ai/free/papers/bettner-2019-cross-document-coreference-approach-capturing/)
52. Zhaofeng Wu, Linlu Qiu, Alexis Ross, Ekin Akyürek, Boyuan Chen, Bailin Wang, Najoung Kim, Jacob Andreas, and Yoon Kim. 2023. Reasoning or reciting? exploring the capabilities and limitations of language models through counterfactual tasks. arXiv preprint arXiv:2307.02477. [find](https://scholar.google.com/scholar?q=Zhaofeng+Wu%2C+Linlu+Qiu%2C+Alexis+Ross%2C+Ekin+Aky%C3%BCrek%2C+Boyuan+Chen%2C+Bailin+Wang%2C+Najoung+Kim%2C+Jacob+Andreas%2C+and+Yoon+Kim%2E+2023%2E+Reasoning+or+reciting%3F+exploring+the+capabilities+and+limitations+of+langua)