---
title: "A Self-Reflective LLM-based Architecture for Semi-Open Event"
description: "The authors, from the European Commission's Joint Research Centre, propose… 0.7201 recall. 26 references, cited by 1 paper here."
authors: ["Hristo Tanev", "Michel de Bollivier", "Bertrand De Longueville"]
year: 2026
venue: "Proceedings of the 9th Workshop on Event Extraction and Understanding: Challenges and Applications (EEUCA 2026)"
source: "https://aclanthology.org/2026.eeuca-1.8/"
doi: "10.18653/v1/2026.eeuca-1.8"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/tanev-2026-self-reflective-llm-based-architecture/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/tanev-2026-self-reflective-llm-based-architecture/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/9/) / A Self-Reflective LLM-based Architecture for Semi-Open Event Extraction

# A Self-Reflective LLM-based Architecture for Semi-Open Event Extraction

**Authors:** [Hristo Tanev](https://md.research.elamur.ai/free/en/authors/hristo-tanev/), Michel de Bollivier and Bertrand De Longueville · **Year:** 2026 · **Venue:** [Proceedings of the 9th Workshop on Event Extraction and Understanding: Challenges and Applications (EEUCA 2026)](https://md.research.elamur.ai/free/en/venues/eeuca/) ([Workshop on Event Extraction and Understanding: Challenges and Applications 2026](https://md.research.elamur.ai/free/en/venues/eeuca/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.eeuca-1.8/) · [PDF](https://aclanthology.org/2026.eeuca-1.8.pdf) · [DOI 10.18653/v1/2026.eeuca-1.8](https://doi.org/10.18653/v1/2026.eeuca-1.8) · [OpenAlex](https://openalex.org/W7166853464)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · 1 in our library, of the 149,439 papers whose bibliographies we read

## Summary
Event extraction usually involves a trade-off. Closed schemas such as ACE or ERE keep outputs consistent but miss information outside the template. Open event extraction is flexible but can yield inconsistent records. The authors, from the European Commission's Joint Research Centre, propose Semi-Open Event Extraction (SOEE). A user-defined core of fields (event type, date, location and others) stays fixed, and further attributes are added at runtime depending on the article.

Their prototype, MAREA, is a three-layer multi-agent system built on a generative LLM:
- **Expert layer:** builds a few-shot initial template and answers questions.
- **Reflective layer:** asks itself about missing event details and proposes new fields.
- **Coordination layer:** a manager agent controls the workflow.

On health-related news articles, MAREA extracted core fields well, and most reflection-added fields were judged useful. Errors came mostly from misread prompts or misread articles rather than hallucination. The approach matters because it offers comparable records for event databases while still capturing context-specific detail, and its reliable fields could seed silver-standard corpora.

## Key points
- **Reflection mechanism:** an internal question-generation and answering loop with three question strategies, one of them keyword-based. A spatial reasoning agent uses spaCy to find place names, and the LLM then assigns each place a role (e.g., place of infection), creating new candidate fields.
- **Core-field F1:** high for where-country (0.986), measures taken (0.941), actors (0.931) and event_type (0.901). Weaker results were for where-place (0.560) and when-end (0.462).
- **Quality of reflection-added fields:** 36% high, 20% medium, 12% low, 5% irrelevant and 24% duplicates.
- **BERT-suggested questions:** micro precision 0.7201, recall 0.4381 and F1 0.5448, which corresponds to a miss probability of about 0.4 in a small-scale test.
- **Limitations:** a single annotator, small samples and one domain. Planned work includes prompt optimization (e.g., MIPROv2), post-processing filters, other LLM backends, and new domains such as security and disaster relief.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [European Commission](https://md.research.elamur.ai/free/en/government/european-commission/) — Government body, Brussels, Belgium · 5 works · 974 citations
- [Joint Research Centre](https://md.research.elamur.ai/free/en/government/joint-research-centre/) — Government body, Ispra, Italy · 5 works · 974 citations
- [Joint Research Centre](https://md.research.elamur.ai/free/en/government/joint-research-centre-nl/) — Government body, Petten, Netherlands · 3 works · 815 citations

Also on the byline: [Joint Research Centre](https://ror.org/02ptz5951).

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works

🧭 Topics (1): [🔎 Information extraction](https://md.research.elamur.ai/free/en/topics/information-extraction/) · 175 works

## Cite

Cite as: Hristo Tanev, Michel de Bollivier and Bertrand De Longueville. 2026. A Self-Reflective LLM-based Architecture for Semi-Open Event Extraction. Proceedings of the 9th Workshop on Event Extraction and Understanding: Challenges and Applications (EEUCA 2026).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{tanev2026self,
  title = {{A Self-Reflective LLM-based Architecture for Semi-Open Event Extraction}},
  author = {Hristo Tanev, Michel {de Bollivier} and Bertrand {De Longueville}},
  booktitle = {Proceedings of the 9th Workshop on Event Extraction and Understanding: Challenges and Applications (EEUCA 2026)},
  year = {2026},
  doi = {10.18653/v1/2026.eeuca-1.8},
  url = {https://doi.org/10.18653/v1/2026.eeuca-1.8}
}
```

- [← previous A Review of Incorporating Psychological Theories in LLMs](https://md.research.elamur.ai/free/en/papers/liu-2026-review-incorporating-psychological-theories-llms/)
- [next → A Survey of Deep Learning for Geometry Problem Solving](https://md.research.elamur.ai/free/en/papers/ma-2026-survey-deep-learning-geometry-problem/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/9/)

## References

26 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. 1662–1675, New Orleans, Louisiana. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=1662%E2%80%931675%2C+New+Orleans%2C+Louisiana%2E+Association+for+Computational+Linguistics%2E)
2. Chinatsu Aone and Mila Ramos-Santacruz. 2000. Rees: a large-scale relation and event extraction system. In Sixth applied natural language processing conference, pages 76–83. [find](https://scholar.google.com/scholar?q=Chinatsu+Aone+and+Mila+Ramos%2DSantacruz%2E+2000%2E+Rees%3A+a+large%2Dscale+relation+and+event+extraction+system%2E+In+Sixth+applied+natural+language+processing+conference%2C+pages+76%E2%80%9383%2E)
3. Haolin Deng, Yanan Zhang, Yangfan Zhang, Wangyang Ying, Changlong Yu, Jun Gao, Wei Wang, Xiaoling Bai, Nan Yang, Jin Ma, and 1 others. 2022. 2event: Benchmarking open event extraction with a large-scale chinese title dataset. In Proceedings of the 2022 Conference on Empirical Methods in Natural Lang… [find](https://scholar.google.com/scholar?q=Haolin+Deng%2C+Yanan+Zhang%2C+Yangfan+Zhang%2C+Wangyang+Ying%2C+Changlong+Yu%2C+Jun+Gao%2C+Wei+Wang%2C+Xiaoling+Bai%2C+Nan+Yang%2C+Jin+Ma%2C+and+1+others%2E+2022%2E+2event%3A+Benchmarking+open+event+extraction+with+a+large%2Dsca)
4. Asli Celikyilmaz, Antoine Bosselut, Xiaodong He, and Yejin Choi. 2018. [Deep communicating agents for abstractive summarization](https://md.research.elamur.ai/free/en/papers/celikyilmaz-2018-deep-communicating-agents-abstractive-summarization/). In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Long Papers), pages Ralph…
5. Krista Opsahl-Ong, Michael J Ryan, Josh Purtell, David Broman, Christopher Potts, Matei Zaharia, and Omar Khattab. 2024. [Optimizing instructions and demonstrations for multi-stage language model programs](https://md.research.elamur.ai/free/en/papers/ong-2024-optimizing-instructions-demonstrations-multi-stage/). In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, page…
6. Quanjiang Guo, Sijie Wang, Jinchuan Zhang, Ben Zhang, Zhao Kang, Ling Tian, and Ke Yan. 2026. Extracting events like code: A multi-agent programming framework for zero-shot event extraction. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 40, pages 30880–30887. [find](https://scholar.google.com/scholar?q=Quanjiang+Guo%2C+Sijie+Wang%2C+Jinchuan+Zhang%2C+Ben+Zhang%2C+Zhao+Kang%2C+Ling+Tian%2C+and+Ke+Yan%2E+2026%2E+Extracting+events+like+code%3A+A+multi%2Dagent+programming+framework+for+zero%2Dshot+event+extraction%2E+In+Procee)
7. Jakub Piskorski, Nicolas Stefanovitch, Brian Doherty, Jens P Linge, Sopho Kharazi, Jas Mantero, Guillaume Jacquet, Alessio Spadaro, Giulia Teodori, and 1 others. 2023. Multi-label infectious disease news event corpus. In Text2Story@ ECIR, pages 171–183. [find](https://scholar.google.com/scholar?q=Jakub+Piskorski%2C+Nicolas+Stefanovitch%2C+Brian+Doherty%2C+Jens+P+Linge%2C+Sopho+Kharazi%2C+Jas+Mantero%2C+Guillaume+Jacquet%2C+Alessio+Spadaro%2C+Giulia+Teodori%2C+and+1+others%2E+2023%2E+Multi%2Dlabel+infectious+disease+n)
8. Zijin Hong and Jian Liu. 2024. Towards better question generation in QA-based event extraction. In Findings of the Association for Computational Linguistics: ACL 2024, pages 9025–9038, Bangkok, Thailand. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Zijin+Hong+and+Jian+Liu%2E+2024%2E+Towards+better+question+generation+in+QA%2Dbased+event+extraction%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+ACL+2024%2C+pages+9025%E2%80%939038%2C+Bangkok%2C+Thaila)
9. Zhiyi Song, Ann Bies, Stephanie Strassel, Tom Riese, Justin Mott, Joe Ellis, Jonathan Wright, Seth Kulick, Neville Ryant, and Xiaoyi Ma. 2015. [From light to rich ere: Annotation of entities, relations, and events](https://md.research.elamur.ai/free/en/papers/song-2015-light-rich-ere-annotation-entities/). In Proceedings of the 3rd workshop on EVENTS: Definition, detection, coreference, and…
10. Hyuntak Kim and Byung-Hak Kim. 2025. Nexus-Sum: Hierarchical LLM agents for long-form narrative summarization. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 10120– 10157, Vienna, Austria. Association for Computational Lingui… [find](https://scholar.google.com/scholar?q=Hyuntak+Kim+and+Byung%2DHak+Kim%2E+2025%2E+Nexus%2DSum%3A+Hierarchical+LLM+agents+for+long%2Dform+narrative+summarization%2E+In+Proceedings+of+the+63rd+Annual+Meeting+of+the+Association+for+Computational+Linguistic)
11. Ralf Steinberger, Bruno Pouliquen, and Erik Van der Goot. 2013. An introduction to the europe media monitor family of applications. Information Access in a Multilingual World. [find](https://scholar.google.com/scholar?q=Ralf+Steinberger%2C+Bruno+Pouliquen%2C+and+Erik+Van+der+Goot%2E+2013%2E+An+introduction+to+the+europe+media+monitor+family+of+applications%2E+Information+Access+in+a+Multilingual+World%2E)
12. Bobo Li, Xudong Han, Jiang Liu, Yuzhe Ding, Liqiang Jing, Zhaoqi Zhang, Jinheng Li, Xinya Du, Fei Li, Meishan Zhang, and 1 others. 2025. Event extraction in large language model:a holistic survey of method, modality, and future. arXiv preprint arXiv:2512.19537. — [arXiv:2512.19537](https://arxiv.org/abs/2512.19537) [find](https://scholar.google.com/scholar?q=Bobo+Li%2C+Xudong+Han%2C+Jiang+Liu%2C+Yuzhe+Ding%2C+Liqiang+Jing%2C+Zhaoqi+Zhang%2C+Jinheng+Li%2C+Xinya+Du%2C+Fei+Li%2C+Meishan+Zhang%2C+and+1+others%2E+2025%2E+Event+extraction+in+large+language+model%3Aa+holistic+survey+of+m)
13. Hristo Tanev, Nicolas Stefanovitch, Tomáš Harmatha, and Diana F. Sousa. 2025a. Exploring the performance of large language models for event detection and extraction in the health domain. In Proceedings of the 15th International Conference on Recent Advances in Natural Language Processing - Natural L… [find](https://scholar.google.com/scholar?q=Hristo+Tanev%2C+Nicolas+Stefanovitch%2C+Tom%C3%A1%C5%A1+Harmatha%2C+and+Diana+F%2E+Sousa%2E+2025a%2E+Exploring+the+performance+of+large+language+models+for+event+detection+and+extraction+in+the+health+domain%2E+In+Proceeding)
14. Hongzhan Lin, Yang Deng, Yuxuan Gu, Wenxuan Zhang, Jing Ma, See Kiong Ng, and Tat-Seng Chua. 2025. [Fact-audit: An adaptive multi-agent framework for dynamic fact-checking evaluation of large language models](https://md.research.elamur.ai/free/en/papers/lin-2025-fact-audit-adaptive-multi-agent/). In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (…
15. Hristo Tanev, Nicolas Stefanovitch, Tomáš Harmatha, and Diana F Sousa. 2025b. Exploring the performance of large language models for event detection and extraction in the health domain. In Proceedings of the International Conference on Recent Advances in Natural Language Processing. [find](https://scholar.google.com/scholar?q=Hristo+Tanev%2C+Nicolas+Stefanovitch%2C+Tom%C3%A1%C5%A1+Harmatha%2C+and+Diana+F+Sousa%2E+2025b%2E+Exploring+the+performance+of+large+language+models+for+event+detection+and+extraction+in+the+health+domain%2E+In+Proceedings)
16. Jens P Linge, Marco Verile, Hristo Tanev, Vanni Zavarella, Flavio Fuart, and Erik van der Goot. 2012. Media monitoring of public health threats with medisys. C. WILLIAM, CWR. WEB-STER, D. BALAHUR, et al, pages 17–31. [find](https://scholar.google.com/scholar?q=Jens+P+Linge%2C+Marco+Verile%2C+Hristo+Tanev%2C+Vanni+Zavarella%2C+Flavio+Fuart%2C+and+Erik+van+der+Goot%2E+2012%2E+Media+monitoring+of+public+health+threats+with+medisys%2E+C%2E+WILLIAM%2C+CWR%2E+WEB%2DSTER%2C+D%2E+BALAHUR%2C+et+)
17. Di Lu, Shihao Ran, Joel Tetreault, and Alejandro Jaimes. 2023. Event extraction as question generation and answering. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 1666–1688, Toronto, Canada. Association for Computational L… [find](https://scholar.google.com/scholar?q=Di+Lu%2C+Shihao+Ran%2C+Joel+Tetreault%2C+and+Alejandro+Jaimes%2E+2023%2E+Event+extraction+as+question+generation+and+answering%2E+In+Proceedings+of+the+61st+Annual+Meeting+of+the+Association+for+Computational+Lin)
18. Meihan Tong, Bin Xu, Shuai Wang, Yixin Cao, Lei Hou, Juanzi Li, and Jun Xie. 2020. Improving event detection via open-domain event trigger knowledge. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Meihan+Tong%2C+Bin+Xu%2C+Shuai+Wang%2C+Yixin+Cao%2C+Lei+Hou%2C+Juanzi+Li%2C+and+Jun+Xie%2E+2020%2E+Improving+event+detection+via+open%2Ddomain+event+trigger+knowledge%2E+Association+for+Computational+Linguistics%2E)
19. Yuli Vasiliev. 2020. Natural Language Processing with Python and spaCy: A Practical Introduction. No Starch Press. [find](https://scholar.google.com/scholar?q=Yuli+Vasiliev%2E+2020%2E+Natural+Language+Processing+with+Python+and+spaCy%3A+A+Practical+Introduction%2E+No+Starch+Press%2E)
20. Meng Lu, Yuzhang Xie, Zhenyu Bi, Shuxiang Cao, and Xuan Wang. 2025. Crossagentie: Cross-type and cross-task multi-agent llm collaboration for zero-shot information extraction. In Findings of the Association for Computational Linguistics: ACL 2025. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Meng+Lu%2C+Yuzhang+Xie%2C+Zhenyu+Bi%2C+Shuxiang+Cao%2C+and+Xuan+Wang%2E+2025%2E+Crossagentie%3A+Cross%2Dtype+and+cross%2Dtask+multi%2Dagent+llm+collaboration+for+zero%2Dshot+information+extraction%2E+In+Findings+of+the+Assoc)
21. Rui Wang, Jiaoli Liu, Yu Yan, Liwei Zang, Huimin Wang, and Jianyi Liu. 2025. Document-level event extraction framework based on prompt learning. In International Conference on Computer Application and Information Security (ICCAIS 2024), volume 13562, pages 996–1001. SPIE. [find](https://scholar.google.com/scholar?q=Rui+Wang%2C+Jiaoli+Liu%2C+Yu+Yan%2C+Liwei+Zang%2C+Huimin+Wang%2C+and+Jianyi+Liu%2E+2025%2E+Document%2Dlevel+event+extraction+framework+based+on+prompt+learning%2E+In+International+Conference+on+Computer+Application+and)
22. Zihao Meng, Tao Liu, Heng Zhang, Kai Feng, and Peng Zhao. 2024. Cean: Contrastive event aggregation network with llm-based augmentation for event extraction. In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages… [find](https://scholar.google.com/scholar?q=Zihao+Meng%2C+Tao+Liu%2C+Heng+Zhang%2C+Kai+Feng%2C+and+Peng+Zhao%2E+2024%2E+Cean%3A+Contrastive+event+aggregation+network+with+llm%2Dbased+augmentation+for+event+extraction%2E+In+Proceedings+of+the+18th+Conference+of+t)
23. Rui Wang, Deyu Zhou, and Yulan He. 2019. Open event extraction from online text using a generative adversarial network. arXiv preprint arXiv:1908.09246. [find](https://scholar.google.com/scholar?q=Rui+Wang%2C+Deyu+Zhou%2C+and+Yulan+He%2E+2019%2E+Open+event+extraction+from+online+text+using+a+generative+adversarial+network%2E+arXiv+preprint+arXiv%3A1908%2E09246%2E)
24. Sijia Wang and Lifu Huang. 2024. Debate as optimization: Adaptive conformal prediction and diverse retrieval for event extraction. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 16422–16435, Miami, Florida, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Sijia+Wang+and+Lifu+Huang%2E+2024%2E+Debate+as+optimization%3A+Adaptive+conformal+prediction+and+diverse+retrieval+for+event+extraction%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+EMNLP+2)
25. Guangjun Zhang, Hu Zhang, Yazhou Han, Yue Fan, Yuhang Shao, Hongye Tan, and Ru Li. 2026. Learning to generate and extract: A multi-agent collaboration framework for zero-shot document-level event arguments extraction. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 40, pages… [find](https://scholar.google.com/scholar?q=Guangjun+Zhang%2C+Hu+Zhang%2C+Yazhou+Han%2C+Yue+Fan%2C+Yuhang+Shao%2C+Hongye+Tan%2C+and+Ru+Li%2E+2026%2E+Learning+to+generate+and+extract%3A+A+multi%2Dagent+collaboration+framework+for+zero%2Dshot+document%2Dlevel+event+argu)
26. Chang Zong, Yuchen Yan, Weiming Lu, Jian Shao, Yongfeng Huang, Heng Chang, and Yueting Zhuang. 2024. Triad: A framework leveraging a multi-role LLM-based agent to solve knowledge base question answering. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages… [find](https://scholar.google.com/scholar?q=Chang+Zong%2C+Yuchen+Yan%2C+Weiming+Lu%2C+Jian+Shao%2C+Yongfeng+Huang%2C+Heng+Chang%2C+and+Yueting+Zhuang%2E+2024%2E+Triad%3A+A+framework+leveraging+a+multi%2Drole+LLM%2Dbased+agent+to+solve+knowledge+base+question+answeri)

*Updated 31 October 2026*