---
title: "TextMineX — paper by Zhou et al. (2026) — summary and ideas"
description: "Humanitarian Mine Action (HMA) agencies produce extensive operational knowledge about landmine detection and clearance… 97 references."
authors: ["Chenyue Zhou", "Gürkan Solmaz", "Flavio Cirillo", "Kiril Gashteovski", "Jonathan Fürst"]
year: 2026
venue: "Findings of the Association for Computational Linguistics: EACL 2026"
source: "https://aclanthology.org/2026.findings-eacl.130/"
doi: "10.18653/v1/2026.findings-eacl.130"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zhou-2026-textminex-data-evaluation-framework-ontology/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zhou-2026-textminex-data-evaluation-framework-ontology/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/52/) / TextMineX: Data, Evaluation Framework and Ontology-guided LLM Pipeline for Humanitarian Mine Action

# TextMineX: Data, Evaluation Framework and Ontology-guided LLM Pipeline for Humanitarian Mine Action

**Authors:** [Chenyue Zhou](https://md.research.elamur.ai/free/en/authors/chenyue-zhou/), Gürkan Solmaz, Flavio Cirillo, [Kiril Gashteovski](https://md.research.elamur.ai/free/en/authors/kiril-gashteovski/) and Jonathan Fürst · **Year:** 2026 · **Venue:** [Findings of the Association for Computational Linguistics: EACL 2026](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.findings-eacl.130/) · [PDF](https://aclanthology.org/2026.findings-eacl.130.pdf) · [DOI 10.18653/v1/2026.findings-eacl.130](https://doi.org/10.18653/v1/2026.findings-eacl.130) · [OpenAlex](https://openalex.org/W7140114255)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Humanitarian Mine Action (HMA) agencies produce extensive operational knowledge about landmine detection and clearance, but most of it sits in free-form PDF reports that are hard to share between organizations. TextMineX tackles this by turning HMA reports into (subject, relation, object) knowledge triples. The authors collected technical reports from the Cambodian Mine Action Centre (CMAC) and GICHD. They built an HMA ontology by merging six IMSMA Core data models with a filtered portion of the Empathi humanitarian ontology. They then created a human-validated reference set of triples. Their LLM pipeline combines layout-aware chunking with ontology-guided prompting. Evaluation pairs reference-based scoring with an LLM-as-Judge protocol designed to counter position bias. Prompts that include ontology-aligned examples clearly outperform baseline prompting in accuracy, hallucination rate and output format. This is presented as the first dataset, benchmark and LLM extraction pipeline for HMA. The released data and code support structured, queryable knowledge exchange among demining agencies.

## Key points
- **Corpus:** The authors gathered 120 English PDF reports, 60 from CMAC and 60 from GICHD. The annotated portion uses the 5 most recent CMAC reports, covering 233 pages and about 75K words.
- **HMA ontology:** It merges 7 ontologies (IMSMA Core Assistance, Accident, Activity, Land, Location, Victim, plus Empathi) into 160 entity types and 86 relation types.
- **Annotation process:** Combining 360 chunks with 7 templates produced 2,520 prompts. From these, 100 were sampled and run through GPT-4o and Llama3-70B. An expert filtered the outputs into 1,095 unique gold triples.
- **Inter-annotator agreement:** A second annotator labeled 20 sets (286 triples). Agreement scores were Jaccard 0.89, Dice 0.94 and Overlap 0.97.
- **Results:** Ontology-aligned in-context examples improved accuracy by up to 44.2%, cut hallucinations by 22.5% and improved format adherence by 20.9%. Position bias was shown to distort LLM-judge rankings. The current work is English-only, and multilingual extension (including Ukrainian) is planned. The code is available at github.com/nec-research/TextMineX.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [ZHAW Zurich University of Applied Sciences](https://md.research.elamur.ai/free/en/universities/zhaw-zurich-university-of-applied-sciences/) — University, Winterthur, Switzerland · 7 works · 181 citations
- [Ss. Cyril and Methodius University in Skopje](https://md.research.elamur.ai/free/en/universities/ss-cyril-and-methodius-university-in-skopje/) — University, Skopje, North Macedonia · 6 works · 147 citations
- [NEC (Germany)](https://md.research.elamur.ai/free/en/companies/nec-germany/) — Company, Heidelberg, Germany · 4 works · 114 citations

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [🧬 Biochemistry, Genetics and Molecular Biology](https://md.research.elamur.ai/free/en/shelves/biochemistry-genetics-and-molecular-biology/) · 263 works · [🧬 Molecular Biology](https://md.research.elamur.ai/free/en/shelves/biochemistry-genetics-and-molecular-biology/molecular-biology/) · 260 works

🧭 Topics (2): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,894 works · [🕸️ Knowledge graphs & ontologies](https://md.research.elamur.ai/free/en/topics/knowledge-graphs/) · 211 works

## Cite

Cite as: Chenyue Zhou, Gürkan Solmaz, Flavio Cirillo, Kiril Gashteovski and Jonathan Fürst. 2026. TextMineX: Data, Evaluation Framework and Ontology-guided LLM Pipeline for Humanitarian Mine Action. Findings of the Association for Computational Linguistics: EACL 2026.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zhou2026textminex,
  title = {{TextMineX: Data, Evaluation Framework and Ontology-guided LLM Pipeline for Humanitarian Mine Action}},
  author = {Chenyue Zhou, Gürkan Solmaz, Flavio Cirillo, Kiril Gashteovski and Jonathan Fürst},
  booktitle = {Findings of the Association for Computational Linguistics: EACL 2026},
  year = {2026},
  doi = {10.18653/v1/2026.findings-eacl.130},
  url = {https://doi.org/10.18653/v1/2026.findings-eacl.130}
}
```

- [← previous Text2Mem: A Unified Memory Operation Language for Memory Operating System](https://md.research.elamur.ai/free/en/papers/wang-2026-text2mem-unified-memory-operation-language/)
- [next → TG-ASR: Translation-Guided Learning with Parallel Gated Cross Attention for Low-Resource Automatic Speech Recognition](https://md.research.elamur.ai/free/en/papers/yang-2026-tg-asr-translation-guided-learning/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/52/)

## References

97 references, 23 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Vahan Arsenyan, Spartak Bughdaryan, Fadi Shaya, Kent Small, and Davit Shahnazaryan. 2023. Large language models for biomedical knowledge graph construction: information extraction from emr notes. arXiv preprint arXiv:2301.12473. [find](https://scholar.google.com/scholar?q=Vahan+Arsenyan%2C+Spartak+Bughdaryan%2C+Fadi+Shaya%2C+Kent+Small%2C+and+Davit+Shahnazaryan%2E+2023%2E+Large+language+models+for+biomedical+knowledge+graph+construction%3A+information+extraction+from+emr+notes%2E+arXi)
2. Satanjeev Banerjee and Alon Lavie. 2005. [Meteor: An automatic metric for mt evaluation with improved correlation with human judgments](https://md.research.elamur.ai/free/en/papers/banerjee-2005-meteor-automatic-metric-mt-evaluation/). In Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization, pages 65–72.
3. Anna Bavaresco, Raffaella Bernardi, Leonardo Bertolazzi, Desmond Elliott, Raquel Fernández, Albert Gatt, Esam Ghaleb, Mario Giulianelli, Michael Hanna, Alexander Koller, and 1 others. 2024. [Llms instead of human judges? a large scale empirical study across 20 nlp evaluation tasks](https://md.research.elamur.ai/free/en/papers/bavaresco-2024-llms-instead-human-judges-large/). arXiv preprint arX…
4. Hanzhu Chen, Xu Shen, Qitan Lv, Jie Wang, Xiaoqi Ni, and Jieping Ye. 2024. Sac-kg: Exploiting large language models as skilled automatic constructors for domain knowledge graphs. arXiv preprint arXiv:2410.02811. — [arXiv:2410.02811](https://arxiv.org/abs/2410.02811) [find](https://scholar.google.com/scholar?q=Hanzhu+Chen%2C+Xu+Shen%2C+Qitan+Lv%2C+Jie+Wang%2C+Xiaoqi+Ni%2C+and+Jieping+Ye%2E+2024%2E+Sac%2Dkg%3A+Exploiting+large+language+models+as+skilled+automatic+constructors+for+domain+knowledge+graphs%2E+arXiv+preprint+arXiv%3A)
5. Jerry Junyang Cheung, Yuchen Zhuang, Yinghao Li, Pranav Shetty, Wantian Zhao, Sanjeev Grampurohit, Rampi Ramprasad, and Chao Zhang. 2024. Polyie: A dataset of information extraction from polymer material scientific literature. arXiv preprint arXiv:2311.07715. [find](https://scholar.google.com/scholar?q=Jerry+Junyang+Cheung%2C+Yuchen+Zhuang%2C+Yinghao+Li%2C+Pranav+Shetty%2C+Wantian+Zhao%2C+Sanjeev+Grampurohit%2C+Rampi+Ramprasad%2C+and+Chao+Zhang%2E+2024%2E+Polyie%3A+A+dataset+of+information+extraction+from+polymer+mater)
6. Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, and 1 others. 2023. [Palm: Scaling language modeling with pathways](https://md.research.elamur.ai/free/en/papers/chowdhery-2022-palm-scaling-language-modeling-pathways/). Journal of Machine Learning Research, 24(240):1–113.
7. Sangnie Bhardwaj, Samarth Aggarwal, and Mausam Mausam. 2019. Carb: A crowdsourced benchmark for open ie. In Conference on Empirical Methods in Natural Language Processing. [find](https://scholar.google.com/scholar?q=Sangnie+Bhardwaj%2C+Samarth+Aggarwal%2C+and+Mausam+Mausam%2E+2019%2E+Carb%3A+A+crowdsourced+benchmark+for+open+ie%2E+In+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2E)
8. Gaye Colakoglu, Gürkan Solmaz, and Jonathan Fürst. 2025. Problem solved? information extraction design space for layout-rich documents using llms. In Findings of the EMNLP’25. [find](https://scholar.google.com/scholar?q=Gaye+Colakoglu%2C+G%C3%BCrkan+Solmaz%2C+and+Jonathan+F%C3%BCrst%2E+2025%2E+Problem+solved%3F+information+extraction+design+space+for+layout%2Drich+documents+using+llms%2E+In+Findings+of+the+EMNLP%E2%80%9925%2E)
9. Iva Bojic, Jessica Chen, Si Yuan Chang, Qi Chwen Ong, Shafiq Joty, and Josip Car. 2023. Hierarchical evaluation framework: Best practices for human evaluation. arXiv preprint arXiv:2310.01917. [find](https://scholar.google.com/scholar?q=Iva+Bojic%2C+Jessica+Chen%2C+Si+Yuan+Chang%2C+Qi+Chwen+Ong%2C+Shafiq+Joty%2C+and+Josip+Car%2E+2023%2E+Hierarchical+evaluation+framework%3A+Best+practices+for+human+evaluation%2E+arXiv+preprint+arXiv%3A2310%2E01917%2E)
10. John Dagdelen, Alexander Dunn, Sanghoon Lee, Nicholas Walker, Andrew S Rosen, Gerbrand Ceder, Kristin A Persson, and Anubhav Jain. 2024. [Structured information extraction from scientific text with large language models](https://md.research.elamur.ai/free/en/papers/dagdelen-2024-structured-information-extraction-scientific-text/). Nature communications, 15(1):1418.
11. Samuel Broscheit, Kiril Gashteovski, and Martin Achenbach. 2017. Openie for slot filling at tac kbp 2017-system description. In TAC. [find](https://scholar.google.com/scholar?q=Samuel+Broscheit%2C+Kiril+Gashteovski%2C+and+Martin+Achenbach%2E+2017%2E+Openie+for+slot+filling+at+tac+kbp+2017%2Dsystem+description%2E+In+TAC%2E)
12. Samuel Broscheit, Kiril Gashteovski, Yanjie Wang, and Rainer Gemulla. 2020. Can we predict new facts with open knowledge graph embeddings? a benchmark for open link prediction. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Samuel+Broscheit%2C+Kiril+Gashteovski%2C+Yanjie+Wang%2C+and+Rainer+Gemulla%2E+2020%2E+Can+we+predict+new+facts+with+open+knowledge+graph+embeddings%3F+a+benchmark+for+open+link+prediction%2E+Association+for+Computa)
13. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, and 1 others. 2020. [Language models are few-shot learners](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/). Advances in neural information processing systems, 33:1877–1901.
14. Valentina Anita Carriero, Antonia Azzini, Ilaria Baroni, Mario Scrocca, and Irene Celino. 2024. Human evaluation of procedural knowledge graph extraction from text with large language models. ArXiv, abs/2412.03589. — [arXiv:2412.03589](https://arxiv.org/abs/2412.03589) [find](https://scholar.google.com/scholar?q=Valentina+Anita+Carriero%2C+Antonia+Azzini%2C+Ilaria+Baroni%2C+Mario+Scrocca%2C+and+Irene+Celino%2E+2024%2E+Human+evaluation+of+procedural+knowledge+graph+extraction+from+text+with+large+language+models%2E+ArXiv%2C+a)
15. Salvatore Carta, Alessandro Giuliani, Leonardo Piano, Alessandro Sebastian Podda, Livio Pompianu, and Sandro Gabriele Tiddia. 2023. Iterative zero-shot llm prompting for knowledge graph construction. arXiv preprint arXiv:2307.01128. — [arXiv:2307.01128](https://arxiv.org/abs/2307.01128) [find](https://scholar.google.com/scholar?q=Salvatore+Carta%2C+Alessandro+Giuliani%2C+Leonardo+Piano%2C+Alessandro+Sebastian+Podda%2C+Livio+Pompianu%2C+and+Sandro+Gabriele+Tiddia%2E+2023%2E+Iterative+zero%2Dshot+llm+prompting+for+knowledge+graph+construction%2E+)
16. Zeno Cauter and Nikolay Yakovets. 2024. Ontology-guided knowledge graph construction from maintenance short texts. In Proceedings of the 1st Workshop Angela Desantis and Daniel Eriksson. 2013. The new imsma and victim assistance. The Journal of ERW and Mine Action, (8). [find](https://scholar.google.com/scholar?q=Zeno+Cauter+and+Nikolay+Yakovets%2E+2024%2E+Ontology%2Dguided+knowledge+graph+construction+from+maintenance+short+texts%2E+In+Proceedings+of+the+1st+Workshop+Angela+Desantis+and+Daniel+Eriksson%2E+2013%2E+The+new)
17. Daniel Deutsch, Rotem Dror, and Dan Roth. 2022. On the limitations of reference-free evaluations of generated text. arXiv preprint arXiv:2210.12563. [find](https://scholar.google.com/scholar?q=Daniel+Deutsch%2C+Rotem+Dror%2C+and+Dan+Roth%2E+2022%2E+On+the+limitations+of+reference%2Dfree+evaluations+of+generated+text%2E+arXiv+preprint+arXiv%3A2210%2E12563%2E)
18. Jacob Eisenstein. 2019. Introduction to natural language processing. MIT press. [find](https://scholar.google.com/scholar?q=Jacob+Eisenstein%2E+2019%2E+Introduction+to+natural+language+processing%2E+MIT+press%2E)
19. Shahul Es, Jithin James, Luis Espinosa-Anke, and Steven Schockaert. 2023. [Ragas: Automated evaluation of retrieval augmented generation](https://md.research.elamur.ai/free/en/papers/es-2023-ragas-automated-evaluation-retrieval-augmented/). arXiv preprint arXiv:2309.15217.
20. Saeed Farzi, Soumitra Ghosh, Alberto Lavelli, and Bernardo Magnini. 2024. Get the best out of 1b llms: insights from information extraction on clinical documents. In Proceedings of the 23rd Workshop on Biomedical Natural Language Processing, pages 266–276. [find](https://scholar.google.com/scholar?q=Saeed+Farzi%2C+Soumitra+Ghosh%2C+Alberto+Lavelli%2C+and+Bernardo+Magnini%2E+2024%2E+Get+the+best+out+of+1b+llms%3A+insights+from+information+extraction+on+clinical+documents%2E+In+Proceedings+of+the+23rd+Workshop+o)
21. Selim Fekih, Nicolò Tamagnone, Benjamin Minixhofer, Ranjan Shrestha, Ximena Contla, Ewan Oglethorpe, and Navid Rekabsaz. 2022. Humset: Dataset of multilingual information extraction and classification for humanitarian crisis response. arXiv preprint arXiv:2210.04573. — [arXiv:2210.04573](https://arxiv.org/abs/2210.04573) [find](https://scholar.google.com/scholar?q=Selim+Fekih%2C+Nicol%C3%B2+Tamagnone%2C+Benjamin+Minixhofer%2C+Ranjan+Shrestha%2C+Ximena+Contla%2C+Ewan+Oglethorpe%2C+and+Navid+Rekabsaz%2E+2022%2E+Humset%3A+Dataset+of+multilingual+information+extraction+and+classification)
22. Niklas Friedrich, Kiril Gashteovski, Mingying Yu, Bhushan Kotnis, Carolin Lawrence, Mathias Niepert, and Goran Glavaš. 2022. AnnIE: An annotation platform for constructing complete open information extraction benchmark. In Proceedings of the 60th Annual Meeting of the Association for Computational L… [find](https://scholar.google.com/scholar?q=Niklas+Friedrich%2C+Kiril+Gashteovski%2C+Mingying+Yu%2C+Bhushan+Kotnis%2C+Carolin+Lawrence%2C+Mathias+Niepert%2C+and+Goran+Glava%C5%A1%2E+2022%2E+AnnIE%3A+An+annotation+platform+for+constructing+complete+open+information+ex)
23. Robert Friel and Atindriyo Sanyal. 2023. Chainpoll: A high efficacy method for llm hallucination detection. arXiv preprint arXiv:2310.18344. — [arXiv:2310.18344](https://arxiv.org/abs/2310.18344) [find](https://scholar.google.com/scholar?q=Robert+Friel+and+Atindriyo+Sanyal%2E+2023%2E+Chainpoll%3A+A+high+efficacy+method+for+llm+hallucination+detection%2E+arXiv+preprint+arXiv%3A2310%2E18344%2E+%E2%80%94+%5BarXiv%3A2310%2E18344%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2310%2E18344%29)
24. Jinlan Fu, Pengfei Liu, and Graham Neubig. 2020. Interpretable multi-dataset evaluation for named entity recognition. arXiv preprint arXiv:2011.06854. [find](https://scholar.google.com/scholar?q=Jinlan+Fu%2C+Pengfei+Liu%2C+and+Graham+Neubig%2E+2020%2E+Interpretable+multi%2Ddataset+evaluation+for+named+entity+recognition%2E+arXiv+preprint+arXiv%3A2011%2E06854%2E)
25. Kiril Gashteovski, Rainer Gemulla, Bhushan Kotnis, Sven Hertling, and Christian Meilicke. 2020. On aligning openie extractions with knowledge bases: A case study. In EVAL4NLP. [find](https://scholar.google.com/scholar?q=Kiril+Gashteovski%2C+Rainer+Gemulla%2C+Bhushan+Kotnis%2C+Sven+Hertling%2C+and+Christian+Meilicke%2E+2020%2E+On+aligning+openie+extractions+with+knowledge+bases%3A+A+case+study%2E+In+EVAL4NLP%2E)
26. Kiril Gashteovski, Sebastian Wanner, Sven Hertling, Samuel Broscheit, and Rainer Gemulla. 2019. Opiec: an open information extraction corpus. arXiv preprint arXiv:1904.12324. — [arXiv:1904.12324](https://arxiv.org/abs/1904.12324) [find](https://scholar.google.com/scholar?q=Kiril+Gashteovski%2C+Sebastian+Wanner%2C+Sven+Hertling%2C+Samuel+Broscheit%2C+and+Rainer+Gemulla%2E+2019%2E+Opiec%3A+an+open+information+extraction+corpus%2E+arXiv+preprint+arXiv%3A1904%2E12324%2E+%E2%80%94+%5BarXiv%3A1904%2E12324%5D%28http)
27. Kiril Gashteovski, Mingying Yu, Bhushan Kotnis, Carolin Lawrence, Mathias Niepert, and Goran Glavaš. 2022. BenchIE: A framework for multi-faceted fact-based open information extraction evaluation. In Proc. of the ACL’22, pages 4472–4490. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Kiril+Gashteovski%2C+Mingying+Yu%2C+Bhushan+Kotnis%2C+Carolin+Lawrence%2C+Mathias+Niepert%2C+and+Goran+Glava%C5%A1%2E+2022%2E+BenchIE%3A+A+framework+for+multi%2Dfaceted+fact%2Dbased+open+information+extraction+evaluation%2E+In+)
28. Julia Gastinger, Timo Sztyler, Lokesh Sharma, Anett Schuelke, and Heiner Stuckenschmidt. 2023. Comparing apples and oranges? on the evaluation of methods for temporal knowledge graph forecasting. In Joint European conference on machine learning and knowledge discovery in databases, pages 533–549. Sp… [find](https://scholar.google.com/scholar?q=Julia+Gastinger%2C+Timo+Sztyler%2C+Lokesh+Sharma%2C+Anett+Schuelke%2C+and+Heiner+Stuckenschmidt%2E+2023%2E+Comparing+apples+and+oranges%3F+on+the+evaluation+of+methods+for+temporal+knowledge+graph+forecasting%2E+In+J)
29. Manas Gaur, Saeedeh Shekarpour, Amelie Gyrard, and Amit Sheth. 2019. Empathi: An ontology for emergency managing and planning about hazard crisis. In 2019 IEEE 13th International Conference on Semantic Computing (ICSC), pages 396–403. [find](https://scholar.google.com/scholar?q=Manas+Gaur%2C+Saeedeh+Shekarpour%2C+Amelie+Gyrard%2C+and+Amit+Sheth%2E+2019%2E+Empathi%3A+An+ontology+for+emergency+managing+and+planning+about+hazard+crisis%2E+In+2019+IEEE+13th+International+Conference+on+Semanti)
30. Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Alex Vaughan, and 1 others. 2024. [The llama 3 herd of models](https://md.research.elamur.ai/free/en/papers/grattafiori-2024-llama-3-herd-models/). arXiv preprint arXiv:2407.21783.
31. Hassan Hamad, Abhinav Kumar Thakur, Nijil Kolleri, Sujith Pulikodan, and Keith Chugg. 2024. Fire: A dataset for financial relation extraction. In Findings of the Association for Computational Linguistics: NAACL 2024, pages 3628–3642. [find](https://scholar.google.com/scholar?q=Hassan+Hamad%2C+Abhinav+Kumar+Thakur%2C+Nijil+Kolleri%2C+Sujith+Pulikodan%2C+and+Keith+Chugg%2E+2024%2E+Fire%3A+A+dataset+for+financial+relation+extraction%2E+In+Findings+of+the+Association+for+Computational+Linguist)
32. Xiaoqi Han, Ru Li, Hongye Tan, Wang Yuanlong, Qinghua Chai, and Jeff Pan. 2023. Improving sequential model editing with fact retrieval. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 11209–11224. [find](https://scholar.google.com/scholar?q=Xiaoqi+Han%2C+Ru+Li%2C+Hongye+Tan%2C+Wang+Yuanlong%2C+Qinghua+Chai%2C+and+Jeff+Pan%2E+2023%2E+Improving+sequential+model+editing+with+fact+retrieval%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+EM)
33. Shibo Hao, Bowen Tan, Kaiwen Tang, Hengzhe Zhang, Eric P Xing, and Zhiting Hu. 2022. Bertnet: Harvesting knowledge graphs from pretrained language models. arXiv preprint arXiv:2206.14268. — [arXiv:2206.14268](https://arxiv.org/abs/2206.14268) [find](https://scholar.google.com/scholar?q=Shibo+Hao%2C+Bowen+Tan%2C+Kaiwen+Tang%2C+Hengzhe+Zhang%2C+Eric+P+Xing%2C+and+Zhiting+Hu%2E+2022%2E+Bertnet%3A+Harvesting+knowledge+graphs+from+pretrained+language+models%2E+arXiv+preprint+arXiv%3A2206%2E14268%2E+%E2%80%94+%5BarXiv%3A220)
34. Yujia Hu, Tuan-Phong Nguyen, Shrestha Ghosh, and Simon Razniewski. 2025. Enabling LLM knowledge analysis via extensive materialization. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 16189–16202. [find](https://scholar.google.com/scholar?q=Yujia+Hu%2C+Tuan%2DPhong+Nguyen%2C+Shrestha+Ghosh%2C+and+Simon+Razniewski%2E+2025%2E+Enabling+LLM+knowledge+analysis+via+extensive+materialization%2E+In+Proceedings+of+the+63rd+Annual+Meeting+of+the+Association+for)
35. Lei Huang, Weijiang Yu, Weitao Ma, Weihong Zhong, Zhangyin Feng, Haotian Wang, Qianglong Chen, Weihua Peng, Xiaocheng Feng, Bing Qin, and 1 others. 2023. [A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions](https://md.research.elamur.ai/free/en/papers/huang-2023-survey-hallucination-large-language-models/). arXiv preprint arXiv:2311.05232.
36. Liangyi Huang and Xusheng Xiao. 2024. Ctikg: Llm-powered knowledge graph construction from cyber threat intelligence. In First Conference on Language Modeling. [find](https://scholar.google.com/scholar?q=Liangyi+Huang+and+Xusheng+Xiao%2E+2024%2E+Ctikg%3A+Llm%2Dpowered+knowledge+graph+construction+from+cyber+threat+intelligence%2E+In+First+Conference+on+Language+Modeling%2E)
37. Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, and 1 others. 2024. [Gpt-4o system card](https://md.research.elamur.ai/free/en/papers/openai-2024-gpt-4o-system-card/). arXiv preprint arXiv:2410.21276.
38. Humanity & Inclusion. 2023. Landmine monitor 2023: Current conflicts & long-lasting contamination cause high number of mine casualties. Accessed: 29-Jan-2025. [find](https://scholar.google.com/scholar?q=Humanity+%26+Inclusion%2E+2023%2E+Landmine+monitor+2023%3A+Current+conflicts+%26+long%2Dlasting+contamination+cause+high+number+of+mine+casualties%2E+Accessed%3A+29%2DJan%2D2025%2E)
39. Sameer Jain, Vaishakh Keshava, Swarnashree Mysore Sathyendra, Patrick Fernandes, Pengfei Liu, Graham Neubig, and Chunting Zhou. 2023. Multidimensional evaluation of text summarization with in-context learning. arXiv preprint arXiv:2306.01200. — [arXiv:2306.01200](https://arxiv.org/abs/2306.01200) [find](https://scholar.google.com/scholar?q=Sameer+Jain%2C+Vaishakh+Keshava%2C+Swarnashree+Mysore+Sathyendra%2C+Patrick+Fernandes%2C+Pengfei+Liu%2C+Graham+Neubig%2C+and+Chunting+Zhou%2E+2023%2E+Multidimensional+evaluation+of+text+summarization+with+in%2Dcontext+)
40. Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Ye Jin Bang, Andrea Madotto, and Pascale Fung. 2023. [Survey of hallucination in natural language generation](https://md.research.elamur.ai/free/en/papers/ji-2022-survey-hallucination-natural-language-generation/). ACM Computing Surveys, 55(12):1–38.
41. Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix,… [find](https://scholar.google.com/scholar?q=Albert+Q%2E+Jiang%2C+Alexandre+Sablayrolles%2C+Arthur+Mensch%2C+Chris+Bamford%2C+Devendra+Singh+Chaplot%2C+Diego+de+las+Casas%2C+Florian+Bressand%2C+Gianna+Lengyel%2C+Guillaume+Lample%2C+L%C3%A9lio+Renard+Lavaud%2C+Lucile+Sauln)
42. Martin Josifoski, Nicola De Cao, Maxime Peyrard, Fabio Petroni, and Robert West. 2022. GenIE: Generative information extraction. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 4626–4643, Seattle… [find](https://scholar.google.com/scholar?q=Martin+Josifoski%2C+Nicola+De+Cao%2C+Maxime+Peyrard%2C+Fabio+Petroni%2C+and+Robert+West%2E+2022%2E+GenIE%3A+Generative+information+extraction%2E+In+Proceedings+of+the+2022+Conference+of+the+North+American+Chapter+of+)
43. Seungone Kim, Juyoung Suk, Xiang Yue, Vijay Viswanathan, Seongyun Lee, Yizhong Wang, Kiril Gashteovski, Carolin Lawrence, Sean Welleck, and Graham Neubig. 2025. [Evaluating language models as synthetic data generators](https://md.research.elamur.ai/free/en/papers/kim-2025-evaluating-language-models-as-synthetic/). In Association for Computational Linguistics (ACL).
44. Bhushan Kotnis, Kiril Gashteovski, Julia Gastinger, Giuseppe Serra, Francesco Alesiani, Timo Sztyler, Ammar Shaker, Na Gong, Carolin Lawrence, and Zhao Xu. 2022a. Human-centric research for nlp: Towards a definition and guiding questions. arXiv preprint arXiv:2207.04447. — [arXiv:2207.04447](https://arxiv.org/abs/2207.04447) [find](https://scholar.google.com/scholar?q=Bhushan+Kotnis%2C+Kiril+Gashteovski%2C+Julia+Gastinger%2C+Giuseppe+Serra%2C+Francesco+Alesiani%2C+Timo+Sztyler%2C+Ammar+Shaker%2C+Na+Gong%2C+Carolin+Lawrence%2C+and+Zhao+Xu%2E+2022a%2E+Human%2Dcentric+research+for+nlp%3A+Towar)
45. Bhushan Kotnis, Kiril Gashteovski, Daniel Rubio, Ammar Shaker, Vanesa Rodriguez-Tembras, Makoto Takamoto, Mathias Niepert, and Carolin Lawrence. 2022b. MILIE: Modular & iterative multilingual open information extraction. In Proceedings of the 60th Annual Meeting of the Association for Computational… [find](https://scholar.google.com/scholar?q=Bhushan+Kotnis%2C+Kiril+Gashteovski%2C+Daniel+Rubio%2C+Ammar+Shaker%2C+Vanesa+Rodriguez%2DTembras%2C+Makoto+Takamoto%2C+Mathias+Niepert%2C+and+Carolin+Lawrence%2E+2022b%2E+MILIE%3A+Modular+%26+iterative+multilingual+open+inf)
46. Landmine and Cluster Munition Monitor. 2023. Cambodia: Mine action. In Landmine Monitor 2023. International Campaign to Ban Landmines - Cluster Munition Coalition (ICBL-CMC). [find](https://scholar.google.com/scholar?q=Landmine+and+Cluster+Munition+Monitor%2E+2023%2E+Cambodia%3A+Mine+action%2E+In+Landmine+Monitor+2023%2E+International+Campaign+to+Ban+Landmines+%2D+Cluster+Munition+Coalition+%28ICBL%2DCMC%29%2E)
47. Anne Lauscher, Yide Song, and Kiril Gashteovski. 2019. Minscie: citation-centered open information extraction. In 2019 ACM/IEEE Joint Conference on Digital Libraries (JCDL), pages 386–387. IEEE. [find](https://scholar.google.com/scholar?q=Anne+Lauscher%2C+Yide+Song%2C+and+Kiril+Gashteovski%2E+2019%2E+Minscie%3A+citation%2Dcentered+open+information+extraction%2E+In+2019+ACM%2FIEEE+Joint+Conference+on+Digital+Libraries+%28JCDL%29%2C+pages+386%E2%80%93387%2E+IEEE%2E)
48. Xiang Li, Penglei Sun, Wanyun Zhou, Zikai Wei, Yongqi Zhang, and Xiaowen Chu. 2025. Finkario: Event-enhanced automated construction of financial knowledge graph. arXiv preprint arXiv:2508.00961. [find](https://scholar.google.com/scholar?q=Xiang+Li%2C+Penglei+Sun%2C+Wanyun+Zhou%2C+Zikai+Wei%2C+Yongqi+Zhang%2C+and+Xiaowen+Chu%2E+2025%2E+Finkario%3A+Event%2Denhanced+automated+construction+of+financial+knowledge+graph%2E+arXiv+preprint+arXiv%3A2508%2E00961%2E)
49. Zongjie Li, Chaozheng Wang, Pingchuan Ma, Daoyuan Wu, Shuai Wang, Cuiyun Gao, and Yang Liu. 2024. Split and merge: Aligning position biases in llm-based evaluators. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 11084–11108. [find](https://scholar.google.com/scholar?q=Zongjie+Li%2C+Chaozheng+Wang%2C+Pingchuan+Ma%2C+Daoyuan+Wu%2C+Shuai+Wang%2C+Cuiyun+Gao%2C+and+Yang+Liu%2E+2024%2E+Split+and+merge%3A+Aligning+position+biases+in+llm%2Dbased+evaluators%2E+In+Proceedings+of+the+2024+Conferen)
50. Chin-Yew Lin. 2004. [Rouge: A package for automatic evaluation of summaries](https://md.research.elamur.ai/free/en/papers/lin-2004-rouge-package-automatic-evaluation-summaries/). In Text summarization branches out, pages 74–81.
51. Jixiong Liu, Yoan Chabot, Raphaël Troncy, Viet-Phi Huynh, Thomas Labbé, and Pierre Monnin. 2023a. From tabular data to knowledge graphs: A survey of semantic table interpretation tasks and methods. Journal of Web Semantics, 76:100761. [find](https://scholar.google.com/scholar?q=Jixiong+Liu%2C+Yoan+Chabot%2C+Rapha%C3%ABl+Troncy%2C+Viet%2DPhi+Huynh%2C+Thomas+Labb%C3%A9%2C+and+Pierre+Monnin%2E+2023a%2E+From+tabular+data+to+knowledge+graphs%3A+A+survey+of+semantic+table+interpretation+tasks+and+methods%2E+Jo)
52. Nelson F Liu, Kevin Lin, John Hewitt, Ashwin Paranjape, Michele Bevilacqua, Fabio Petroni, and Percy Liang. 2024. [Lost in the middle: How language models use long contexts](https://md.research.elamur.ai/free/en/papers/liu-2023-lost-middle-language-models-use/). Transactions of the Association for Computational Linguistics, 12:157–173.
53. Pengfei Liu, Jinlan Fu, Yang Xiao, Weizhe Yuan, Shuaicheng Chang, Junqi Dai, Yixin Liu, Zihuiwen Ye, Zi-Yi Dou, and Graham Neubig. 2021. Explainaboard: An explainable leaderboard for nlp. arXiv preprint arXiv:2104.06387. [find](https://scholar.google.com/scholar?q=Pengfei+Liu%2C+Jinlan+Fu%2C+Yang+Xiao%2C+Weizhe+Yuan%2C+Shuaicheng+Chang%2C+Junqi+Dai%2C+Yixin+Liu%2C+Zihuiwen+Ye%2C+Zi%2DYi+Dou%2C+and+Graham+Neubig%2E+2021%2E+Explainaboard%3A+An+explainable+leaderboard+for+nlp%2E+arXiv+prepri)
54. Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, and Graham Neubig. 2023b. [Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing](https://md.research.elamur.ai/free/en/papers/liu-2021-pre-train-prompt-predict-systematic/). ACM Computing Surveys, 55(9):1–35.
55. Runxuan Liu, Bei Luo, Jiaqi Li, Baoxin Wang, Ming Liu, Dayong Wu, Shijin Wang, and Bing Qin. 2025. [Ontology-guided reverse thinking makes large language models stronger on knowledge graph question answering](https://md.research.elamur.ai/free/en/papers/liu-2025-ontology-guided-reverse-thinking-makes/). arXiv preprint arXiv:2502.11491.
56. Quanyu Long, Yin Wu, Wenya Wang, and Sinno Jialin Pan. 2024. Does in-context learning really learn? rethinking how large language models respond and solve tasks via in-context learning. In First Conference on Language Modeling. [find](https://scholar.google.com/scholar?q=Quanyu+Long%2C+Yin+Wu%2C+Wenya+Wang%2C+and+Sinno+Jialin+Pan%2E+2024%2E+Does+in%2Dcontext+learning+really+learn%3F+rethinking+how+large+language+models+respond+and+solve+tasks+via+in%2Dcontext+learning%2E+In+First+Confe)
57. Christian Meilicke, Manuel Fink, Yanjie Wang, Daniel Ruffinelli, Rainer Gemulla, and Heiner Stuckenschmidt. 2018. Fine-grained evaluation of rule-and embedding-based systems for knowledge graph completion. In International semantic web conference, pages 3–20. Springer. [find](https://scholar.google.com/scholar?q=Christian+Meilicke%2C+Manuel+Fink%2C+Yanjie+Wang%2C+Daniel+Ruffinelli%2C+Rainer+Gemulla%2C+and+Heiner+Stuckenschmidt%2E+2018%2E+Fine%2Dgrained+evaluation+of+rule%2Dand+embedding%2Dbased+systems+for+knowledge+graph+comple)
58. Nandana Mihindukulasooriya, Sanju Tiwari, Carlos F Enguix, and Kusum Lata. 2023. Text2kgbench: A benchmark for ontology-driven knowledge graph generation from text. In International Semantic Web Conference, pages 247–265. Springer. [find](https://scholar.google.com/scholar?q=Nandana+Mihindukulasooriya%2C+Sanju+Tiwari%2C+Carlos+F+Enguix%2C+and+Kusum+Lata%2E+2023%2E+Text2kgbench%3A+A+benchmark+for+ontology%2Ddriven+knowledge+graph+generation+from+text%2E+In+International+Semantic+Web+Confe)
59. Sewon Min, Xinxi Lyu, Ari Holtzman, Mikel Artetxe, Mike Lewis, Hannaneh Hajishirzi, and Luke Zettlemoyer. 2022. [Rethinking the role of demonstrations: What makes in-context learning work?](https://md.research.elamur.ai/free/en/papers/min-2022-rethinking-role-demonstrations-what-makes/) arXiv preprint arXiv:2202.12837.
60. Jekaterina Novikova, Ondřej Dušek, and Verena Rieser. 2018. [Rankme: Reliable human ratings for natural language generation](https://md.research.elamur.ai/free/en/papers/novikova-2018-rankme-reliable-human-ratings-natural/). arXiv preprint arXiv:1803.05928.
61. Juri Opitz. 2024. A closer look at classification evaluation metrics and a critical reflection of common evaluation practice. transactions of the association for computational linguistics, 12:820–836. [find](https://scholar.google.com/scholar?q=Juri+Opitz%2E+2024%2E+A+closer+look+at+classification+evaluation+metrics+and+a+critical+reflection+of+common+evaluation+practice%2E+transactions+of+the+association+for+computational+linguistics%2C+12%3A820%E2%80%93836%2E)
62. Huitong Pan, Qi Zhang, Mustapha Adamu, Eduard Dragut, and Longin Jan Latecki. 2025. Taxonomy-driven knowledge graph construction for domain-specific scientific applications. In Findings of the Association for Computational Linguistics: ACL 2025, pages 4295–4320. [find](https://scholar.google.com/scholar?q=Huitong+Pan%2C+Qi+Zhang%2C+Mustapha+Adamu%2C+Eduard+Dragut%2C+and+Longin+Jan+Latecki%2E+2025%2E+Taxonomy%2Ddriven+knowledge+graph+construction+for+domain%2Dspecific+scientific+applications%2E+In+Findings+of+the+Associa)
63. Jeff Z Pan, Simon Razniewski, Jan-Christoph Kalo, Sneha Singhania, Jiaoyan Chen, Stefan Dietze, Hajira Jabeen, Janna Omeliyanenko, Wen Zhang, Matteo Lissandrini, and 1 others. 2023. Large language models and knowledge graphs: Opportunities and challenges. arXiv preprint arXiv:2308.06374. — [arXiv:2308.06374](https://arxiv.org/abs/2308.06374) [find](https://scholar.google.com/scholar?q=Jeff+Z+Pan%2C+Simon+Razniewski%2C+Jan%2DChristoph+Kalo%2C+Sneha+Singhania%2C+Jiaoyan+Chen%2C+Stefan+Dietze%2C+Hajira+Jabeen%2C+Janna+Omeliyanenko%2C+Wen+Zhang%2C+Matteo+Lissandrini%2C+and+1+others%2E+2023%2E+Large+language+mod)
64. Chaoxu Pang, Yixuan Cao, Chunhao Yang, and Ping Luo. 2024. Uncovering limitations of large language models in information seeking from tables. arXiv preprint arXiv:2406.04113. [find](https://scholar.google.com/scholar?q=Chaoxu+Pang%2C+Yixuan+Cao%2C+Chunhao+Yang%2C+and+Ping+Luo%2E+2024%2E+Uncovering+limitations+of+large+language+models+in+information+seeking+from+tables%2E+arXiv+preprint+arXiv%3A2406%2E04113%2E)
65. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. [Bleu: a method for automatic evaluation of machine translation](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/). In Proceedings of the 40th annual meeting of the Association for Computational Linguistics, pages 311–318.
66. Oscar Sainz, Iker García-Ferrero, Rodrigo Agerri, Oier López de Lacalle, Germán Rigau, and Eneko Agirre. 2023. [Gollie: Annotation guidelines improve zero-shot information-extraction](https://md.research.elamur.ai/free/en/papers/sainz-2023-gollie-annotation-guidelines-improve-zero/). ArXiv, abs/2310.03668.
67. Kevin Pei, Ishan Jindal, and Kevin Chang. 2023. Abstractive open information extraction. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 6146–6158. [find](https://scholar.google.com/scholar?q=Kevin+Pei%2C+Ishan+Jindal%2C+and+Kevin+Chang%2E+2023%2E+Abstractive+open+information+extraction%2E+In+Proceedings+of+the+2023+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+6146%E2%80%936158%2E)
68. Hendrik Schuff, Lindsey Vanderlyn, Heike Adel, and Ngoc Thang Vu. 2023. How to do human evaluation: A brief introduction to user studies in nlp. Natural Language Engineering, 29(5):1199–1222. [find](https://scholar.google.com/scholar?q=Hendrik+Schuff%2C+Lindsey+Vanderlyn%2C+Heike+Adel%2C+and+Ngoc+Thang+Vu%2E+2023%2E+How+to+do+human+evaluation%3A+A+brief+introduction+to+user+studies+in+nlp%2E+Natural+Language+Engineering%2C+29%285%29%3A1199%E2%80%931222%2E)
69. Maxime Peyrard, Wei Zhao, Steffen Eger, and Robert West. 2021. Better than average: Paired evaluation of nlp systems. arXiv preprint arXiv:2110.10746. [find](https://scholar.google.com/scholar?q=Maxime+Peyrard%2C+Wei+Zhao%2C+Steffen+Eger%2C+and+Robert+West%2E+2021%2E+Better+than+average%3A+Paired+evaluation+of+nlp+systems%2E+arXiv+preprint+arXiv%3A2110%2E10746%2E)
70. Lin Shi, Chiyu Ma, Wenhua Liang, Weicheng Ma, and Soroush Vosoughi. 2024. Judging the judges: A systematic investigation of position bias in pairwise comparative assessments by llms. arXiv preprint arXiv:2406.07791. — [arXiv:2406.07791](https://arxiv.org/abs/2406.07791) [find](https://scholar.google.com/scholar?q=Lin+Shi%2C+Chiyu+Ma%2C+Wenhua+Liang%2C+Weicheng+Ma%2C+and+Soroush+Vosoughi%2E+2024%2E+Judging+the+judges%3A+A+systematic+investigation+of+position+bias+in+pairwise+comparative+assessments+by+llms%2E+arXiv+preprint+ar)
71. Fabio Poletto, Yunbai Zhang, André Panisson, Yelena Mejova, Daniela Paolotti, and Sylvain Ponserre. 2021. Developing annotated resources for internal displacement monitoring. In Companion Proceedings of the Web Conference 2021, pages 136–144. [find](https://scholar.google.com/scholar?q=Fabio+Poletto%2C+Yunbai+Zhang%2C+Andr%C3%A9+Panisson%2C+Yelena+Mejova%2C+Daniela+Paolotti%2C+and+Sylvain+Ponserre%2E+2021%2E+Developing+annotated+resources+for+internal+displacement+monitoring%2E+In+Companion+Proceedings+)
72. Gorjan Radevski, Kiril Gashteovski, Chia-Chien Hung, Carolin Lawrence, and Goran Glavaš. 2023. Linking surface facts to large-scale knowledge graphs. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 7189–7207. [find](https://scholar.google.com/scholar?q=Gorjan+Radevski%2C+Kiril+Gashteovski%2C+Chia%2DChien+Hung%2C+Carolin+Lawrence%2C+and+Goran+Glava%C5%A1%2E+2023%2E+Linking+surface+facts+to+large%2Dscale+knowledge+graphs%2E+In+Proceedings+of+the+2023+Conference+on+Empirical)
73. Gorjan Radevski, Kiril Gashteovski, Shahbaz Syed, Christopher Malon, Sebastien Nicolas, Chia-Chien Hung, Timo Sztyler, Verena Heußer, Wiem Ben Rim, Masafumi Enomoto, and 1 others. 2025. On synthesizing data for context attribution in question answering. arXiv preprint arXiv:2504.05317. [find](https://scholar.google.com/scholar?q=Gorjan+Radevski%2C+Kiril+Gashteovski%2C+Shahbaz+Syed%2C+Christopher+Malon%2C+Sebastien+Nicolas%2C+Chia%2DChien+Hung%2C+Timo+Sztyler%2C+Verena+Heu%C3%9Fer%2C+Wiem+Ben+Rim%2C+Masafumi+Enomoto%2C+and+1+others%2E+2025%2E+On+synthesizin)
74. André Gomes Regino and Julio Cesar Dos Reis. 2025. Can llms be knowledge graph curators for validating triple insertions? In Proceedings of the workshop on generative AI and knowledge graphs (GenAIK), pages 87–99. [find](https://scholar.google.com/scholar?q=Andr%C3%A9+Gomes+Regino+and+Julio+Cesar+Dos+Reis%2E+2025%2E+Can+llms+be+knowledge+graph+curators+for+validating+triple+insertions%3F+In+Proceedings+of+the+workshop+on+generative+AI+and+knowledge+graphs+%28GenAIK%29%2C)
75. Marco Tulio Ribeiro, Tongshuang Wu, Carlos Guestrin, and Sameer Singh. 2020. Beyond accuracy: Behavioral testing of nlp models with checklist. arXiv preprint arXiv:2005.04118. [find](https://scholar.google.com/scholar?q=Marco+Tulio+Ribeiro%2C+Tongshuang+Wu%2C+Carlos+Guestrin%2C+and+Sameer+Singh%2E+2020%2E+Beyond+accuracy%3A+Behavioral+testing+of+nlp+models+with+checklist%2E+arXiv+preprint+arXiv%3A2005%2E04118%2E)
76. Wiem Ben Rim, Carolin Lawrence, Kiril Gashteovski, Mathias Niepert, and Naoaki Okazaki. 2021. Behavioral testing of knowledge graph embedding models for link prediction. In 3rd Conference on Automated Knowledge Base Construction. [find](https://scholar.google.com/scholar?q=Wiem+Ben+Rim%2C+Carolin+Lawrence%2C+Kiril+Gashteovski%2C+Mathias+Niepert%2C+and+Naoaki+Okazaki%2E+2021%2E+Behavioral+testing+of+knowledge+graph+embedding+models+for+link+prediction%2E+In+3rd+Conference+on+Automated)
77. Pablo Romero, Lifeng Han, and Goran Nenadic. 2025. Insightbuddy-ai: Medication extraction and entity linking using pre-trained language models and ensemble learning. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human L… [find](https://scholar.google.com/scholar?q=Pablo+Romero%2C+Lifeng+Han%2C+and+Goran+Nenadic%2E+2025%2E+Insightbuddy%2Dai%3A+Medication+extraction+and+entity+linking+using+pre%2Dtrained+language+models+and+ensemble+learning%2E+In+Proceedings+of+the+2025+Confere)
78. Jon Saad-Falcon, Omar Khattab, Christopher Potts, and Matei Zaharia. 2023. Ares: An automated evaluation framework for retrieval-augmented generation systems. arXiv preprint arXiv:2311.09476. [find](https://scholar.google.com/scholar?q=Jon+Saad%2DFalcon%2C+Omar+Khattab%2C+Christopher+Potts%2C+and+Matei+Zaharia%2E+2023%2E+Ares%3A+An+automated+evaluation+framework+for+retrieval%2Daugmented+generation+systems%2E+arXiv+preprint+arXiv%3A2311%2E09476%2E)
79. Brandon Smock and Rohith Pesala. 2021. Table Transformer. [find](https://scholar.google.com/scholar?q=Brandon+Smock+and+Rohith+Pesala%2E+2021%2E+Table+Transformer%2E)
80. Gemma Team, Morgane Riviere, Shreya Pathak, Pier Giuseppe Sessa, Cassidy Hardin, Surya Bhupatiraju, Léonard Hussenot, Thomas Mesnard, Bobak Shahriari, Alexandre Ramé, and 1 others. 2024. Gemma 2: Improving open language models at a practical size. arXiv preprint arXiv:2408.00118. [find](https://scholar.google.com/scholar?q=Gemma+Team%2C+Morgane+Riviere%2C+Shreya+Pathak%2C+Pier+Giuseppe+Sessa%2C+Cassidy+Hardin%2C+Surya+Bhupatiraju%2C+L%C3%A9onard+Hussenot%2C+Thomas+Mesnard%2C+Bobak+Shahriari%2C+Alexandre+Ram%C3%A9%2C+and+1+others%2E+2024%2E+Gemma+2%3A+Impr)
81. Craig Thomson, Ehud Reiter, and Anya Belz. 2024. Common flaws in running human evaluation experiments in nlp. Computational Linguistics, 50(2):795– 805. [find](https://scholar.google.com/scholar?q=Craig+Thomson%2C+Ehud+Reiter%2C+and+Anya+Belz%2E+2024%2E+Common+flaws+in+running+human+evaluation+experiments+in+nlp%2E+Computational+Linguistics%2C+50%282%29%3A795%E2%80%93+805%2E)
82. Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, and 1 others. 2023. [Llama: Open and efficient foundation language models](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-open-efficient-foundation-language/). arXiv preprint arXiv:2302.13971.
83. United Nations. 2025. International mine awareness day. [find](https://scholar.google.com/scholar?q=United+Nations%2E+2025%2E+International+mine+awareness+day%2E)
84. United Nations Development Programme in Cambodia. 2021. Clearing for results - mine action for human development: Annual report 2020. Technical report, UNDP Cambodia. [find](https://scholar.google.com/scholar?q=United+Nations+Development+Programme+in+Cambodia%2E+2021%2E+Clearing+for+results+%2D+mine+action+for+human+development%3A+Annual+report+2020%2E+Technical+report%2C+UNDP+Cambodia%2E)
85. Chris van der Lee, Albert Gatt, Emiel van Miltenburg, and Emiel J. Krahmer. 2021. Human evaluation of automatically generated text: Current trends and best practice guidelines. Comput. Speech Lang., 67:101151. [find](https://scholar.google.com/scholar?q=Chris+van+der+Lee%2C+Albert+Gatt%2C+Emiel+van+Miltenburg%2C+and+Emiel+J%2E+Krahmer%2E+2021%2E+Human+evaluation+of+automatically+generated+text%3A+Current+trends+and+best+practice+guidelines%2E+Comput%2E+Speech+Lang%2E%2C+6)
86. Peter Vickers, Loïc Barrault, Emilio Monti, and Nikolaos Aletras. 2024. We need to talk about classification evaluation metrics in nlp. arXiv preprint arXiv:2401.03831. [find](https://scholar.google.com/scholar?q=Peter+Vickers%2C+Lo%C3%AFc+Barrault%2C+Emilio+Monti%2C+and+Nikolaos+Aletras%2E+2024%2E+We+need+to+talk+about+classification+evaluation+metrics+in+nlp%2E+arXiv+preprint+arXiv%3A2401%2E03831%2E)
87. Gerhard Weikum, Xin Luna Dong, Simon Razniewski, Fabian Suchanek, and 1 others. 2021. Machine knowledge: Creation and curation of comprehensive knowledge bases. Foundations and Trends® in Databases, 10(2-4):108–490. [find](https://scholar.google.com/scholar?q=Gerhard+Weikum%2C+Xin+Luna+Dong%2C+Simon+Razniewski%2C+Fabian+Suchanek%2C+and+1+others%2E+2021%2E+Machine+knowledge%3A+Creation+and+curation+of+comprehensive+knowledge+bases%2E+Foundations+and+Trends%C2%AE+in+Databases%2C+1)
88. Haris Widjaja, Kiril Gashteovski, Wiem Ben Rim, Pengfei Liu, Christopher Malon, Daniel Ruffinelli, Carolin Lawrence, and Graham Neubig. 2022. Kgxboard: Explainable and interactive leaderboard for evaluation of knowledge graph completion models. arXiv preprint arXiv:2208.11024. [find](https://scholar.google.com/scholar?q=Haris+Widjaja%2C+Kiril+Gashteovski%2C+Wiem+Ben+Rim%2C+Pengfei+Liu%2C+Christopher+Malon%2C+Daniel+Ruffinelli%2C+Carolin+Lawrence%2C+and+Graham+Neubig%2E+2022%2E+Kgxboard%3A+Explainable+and+interactive+leaderboard+for+eval)
89. BigScience Workshop, Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ilić, Daniel Hesslow, Roman Castagné, Alexandra Sasha Luccioni, François Yvon, and 1 others. 2022. Bloom: A 176b-parameter open-access multilingual language model. arXiv preprint arXiv:2211.05100. [find](https://scholar.google.com/scholar?q=BigScience+Workshop%2C+Teven+Le+Scao%2C+Angela+Fan%2C+Christopher+Akiki%2C+Ellie+Pavlick%2C+Suzana+Ilic%CC%81%2C+Daniel+Hesslow%2C+Roman+Castagn%C3%A9%2C+Alexandra+Sasha+Luccioni%2C+Fran%C3%A7ois+Yvon%2C+and+1+others%2E+2022%2E+Bloom%3A+A+17)
90. Guanming Xiong, Junwei Bao, and Wen Zhao. 2024. Interactive-kbqa: Multi-turn interactions for knowledge base question answering with large language models. arXiv preprint arXiv:2402.15131. [find](https://scholar.google.com/scholar?q=Guanming+Xiong%2C+Junwei+Bao%2C+and+Wen+Zhao%2E+2024%2E+Interactive%2Dkbqa%3A+Multi%2Dturn+interactions+for+knowledge+base+question+answering+with+large+language+models%2E+arXiv+preprint+arXiv%3A2402%2E15131%2E)
91. Zhao Xu, Wiem Ben Rim, Kiril Gashteovski, Timo Sztyler, and Carolin Lawrence. 2024a. A human-centric evaluation platform for explainable knowledge graph completion. In Conference of the European Chapter of the Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Zhao+Xu%2C+Wiem+Ben+Rim%2C+Kiril+Gashteovski%2C+Timo+Sztyler%2C+and+Carolin+Lawrence%2E+2024a%2E+A+human%2Dcentric+evaluation+platform+for+explainable+knowledge+graph+completion%2E+In+Conference+of+the+European+Chapt)
92. Ziwei Xu, Sanjay Jain, and Mohan Kankanhalli. 2024b. [Hallucination is inevitable: An innate limitation of large language models](https://md.research.elamur.ai/free/en/papers/xu-2024-hallucination-inevitable-innate-limitation-large/). arXiv preprint arXiv:2401.11817.
93. Bowen Zhang and Harold Soh. 2024. [Extract, define, canonicalize: An llm-based framework for knowledge graph construction](https://md.research.elamur.ai/free/en/papers/zhang-2024-extract-define-canonicalize-llm-based/). arXiv preprint arXiv:2404.03868.
94. Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q Weinberger, and Yoav Artzi. 2019. Bertscore: Evaluating text generation with bert. arXiv preprint arXiv:1904.09675. [find](https://scholar.google.com/scholar?q=Tianyi+Zhang%2C+Varsha+Kishore%2C+Felix+Wu%2C+Kilian+Q+Weinberger%2C+and+Yoav+Artzi%2E+2019%2E+Bertscore%3A+Evaluating+text+generation+with+bert%2E+arXiv+preprint+arXiv%3A1904%2E09675%2E)
95. Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric Xing, and 1 others. 2024. [Judging llm-as-a-judge with mt-bench and chatbot arena](https://md.research.elamur.ai/free/en/papers/zheng-2023-judging-llm-judge-mt-bench/). Advances in Neural Information Processing Systems, 36.
96. Ying Zhou, Xuanang Chen, Ben He, Zheng Ye, and Le Sun. 2022. Re-thinking knowledge graph completion evaluation from an information retrieval perspective. Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. [find](https://scholar.google.com/scholar?q=Ying+Zhou%2C+Xuanang+Chen%2C+Ben+He%2C+Zheng+Ye%2C+and+Le+Sun%2E+2022%2E+Re%2Dthinking+knowledge+graph+completion+evaluation+from+an+information+retrieval+perspective%2E+Proceedings+of+the+45th+International+ACM+SIGI)
97. Yuqi Zhu, Xiaohan Wang, Jing Chen, Shuofei Qiao, Yixin Ou, Yunzhi Yao, Shumin Deng, Huajun Chen, and Ningyu Zhang. 2023. Llms for knowledge graph construction and reasoning: Recent capabilities and future opportunities. arXiv preprint arXiv:2305.13168. [find](https://scholar.google.com/scholar?q=Yuqi+Zhu%2C+Xiaohan+Wang%2C+Jing+Chen%2C+Shuofei+Qiao%2C+Yixin+Ou%2C+Yunzhi+Yao%2C+Shumin+Deng%2C+Huajun+Chen%2C+and+Ningyu+Zhang%2E+2023%2E+Llms+for+knowledge+graph+construction+and+reasoning%3A+Recent+capabilities+and+fu)

*Updated 2 November 2026*