---
title: "SKILL-IR-Discourse — Wolska 2026"
description: "Most computational research on political language looks at debates, speeches and media."
authors: ["Magdalena Wolska", "Matti Wiegmann", "Sassan Gholiagha", "Mitja Sienknecht", "Dora Kiesel", "Irene Lopez Garcia", "Patrick Riehmann", "Bernd Fröhlich", "Katrin Girgensohn", "Jürgen Neyer", "Benno Stein"]
year: 2026
venue: "Proceedings of the Fifteenth Language Resources and Evaluation Conference"
source: "https://aclanthology.org/2026.lrec-1.513/"
doi: "10.63317/4i2ptc5x4ese"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/wolska-2026-skill-ir-discourse-large-annotated/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wolska-2026-skill-ir-discourse-large-annotated/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/9/) / SKILL-IR-Discourse: A Large, Annotated Corpus of Argumentation and Domain Discourse on International Relations

# SKILL-IR-Discourse: A Large, Annotated Corpus of Argumentation and Domain Discourse on International Relations

**Authors:** [Magdalena Wolska](https://md.research.elamur.ai/free/en/authors/magdalena-wolska/), Matti Wiegmann, Sassan Gholiagha, Mitja Sienknecht, Dora Kiesel, Irene Lopez Garcia, Patrick Riehmann, Bernd Fröhlich, Katrin Girgensohn, Jürgen Neyer, [Benno Stein](https://md.research.elamur.ai/free/en/authors/benno-stein/) · **Year:** 2026 · **Venue:** Proceedings of the Fifteenth Language Resources and Evaluation Conference · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.lrec-1.513/) · [PDF](https://aclanthology.org/2026.lrec-1.513.pdf) · [DOI 10.63317/4i2ptc5x4ese](https://doi.org/10.63317/4i2ptc5x4ese) · [OpenAlex](https://openalex.org/W7160179099)

**Citations:** 0 citations (openalex-snapshot · 2026-10-14)

## Summary
Most computational research on political language looks at debates, speeches and media. Scholarly writing in political science, where theories are actually built and argued, has received little attention. An earlier annotation scheme for argumentation and domain content in International Relations (IR) had only been tested on three articles, too few for general conclusions. This paper scales that work up into SKILL-IR-Discourse, a corpus of 190 open-access IR articles from major journals, totalling more than 1.5M tokens.

The authors used a simplified version of the Wolska et al. (2025) scheme. Its discourse layer covers argumentative and rhetorical moves, and its domain layer separates theory-based from data-based statements. Experts first annotated a small gold subset. That subset was then used to train student annotators, who labelled the rest under quality monitoring with purpose-built annotation software.

The analysis shows that IR argumentation is mostly shallow: claims often lack explicit evidence and rebuttals are uncommon. The balance of theoretical and evaluative content shifts with each article's method and the journal's orientation. The resource supports both argument mining and the study of academic writing practice.

## Key points
- **Corpus size and split:** 190 articles (>1,500K tokens) in total.
  - Gold-standard: 5 articles (~62K tokens), annotated by senior domain experts.
  - Silver-standard: 185 articles, annotated by trained political science students (11 annotators over the project).
- **Discourse dimension:** Argumentation (Claim, Support, Attack) and Rhetorical Moves (Elaboration only).
- **Domain dimension:** Theory (Definition, Theoretical Statement), Data (Speculative, Evaluative, Other Data), IR Other, and Other Domain.
- **Findings:** Simple premise-conclusion structures dominate, and under half of the claims are explicitly supported. Attacks are rare, and the claim-to-support ratio differs considerably between articles.
- **Sources and availability:** Articles come from open-access publications by Sage, Cambridge UP, Taylor & Francis and Oxford UP, balanced on five selection criteria. The corpus is freely available on Zenodo (record 17380680).

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/)

Topics: [Discourse analysis](https://md.research.elamur.ai/free/en/topics/discourse-analysis/) · [Treebanks](https://md.research.elamur.ai/free/en/topics/treebanks/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{wolska2026skill,
  title = {{SKILL-IR-Discourse: A Large, Annotated Corpus of Argumentation and Domain Discourse on International Relations}},
  author = {Wolska, Magdalena and Wiegmann, Matti and Gholiagha, Sassan and Sienknecht, Mitja and Kiesel, Dora and Garcia, Irene Lopez and Riehmann, Patrick and Fröhlich, Bernd and Girgensohn, Katrin and Neyer, Jürgen and Stein, Benno},
  booktitle = {Proceedings of the Fifteenth Language Resources and Evaluation Conference},
  year = {2026},
  doi = {10.63317/4i2ptc5x4ese},
  url = {https://doi.org/10.63317/4i2ptc5x4ese}
}
```

- [← previous SiniticMTError: A Machine Translation Dataset with Error Annotations for Sinitic Languages](https://md.research.elamur.ai/free/en/papers/liu-2026-siniticmterror-machine-translation-dataset-error/)
- [next → Slovene Morphological and Word Formation Segmentation: A Novel Dataset and Evaluation](https://md.research.elamur.ai/free/en/papers/pranjic-2026-slovene-morphological-word-formation-segmentation/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/9/)

## References

33 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Gavin Abercrombie and Riza Batista-Navarro. 2018. A sentiment-labelled corpus of hansard parliamentary debate speeches. In Proceedings of ParlaCLARIN. Common Language Resources and Technology Infrastructure (CLARIN). [find](https://scholar.google.com/scholar?q=Gavin+Abercrombie+and+Riza+Batista%2DNavarro%2E+2018%2E+A+sentiment%2Dlabelled+corpus+of+hansard+parliamentary+debate+speeches%2E+In+Proceedings+of+ParlaCLARIN%2E+Common+Language+Resources+and+Technology+Infrastr)
2. Gavin Abercrombie and Riza Theresa Batista-Navarro. 2020. Parlvote: A corpus for sentiment analysis of political debates. In Proceedings of the 12th Language Resources and Evaluation Conference, pages 5073–5078. [find](https://scholar.google.com/scholar?q=Gavin+Abercrombie+and+Riza+Theresa+Batista%2DNavarro%2E+2020%2E+Parlvote%3A+A+corpus+for+sentiment+analysis+of+political+debates%2E+In+Proceedings+of+the+12th+Language+Resources+and+Evaluation+Conference%2C+pages)
3. Marwa Adel Abuelwafa. 2021. Legitimation and manipulation in political speeches: a corpus-based study. Procedia Computer Science, 189:11–18. [find](https://scholar.google.com/scholar?q=Marwa+Adel+Abuelwafa%2E+2021%2E+Legitimation+and+manipulation+in+political+speeches%3A+a+corpus%2Dbased+study%2E+Procedia+Computer+Science%2C+189%3A11%E2%80%9318%2E)
4. Paul Bayley. 2004. Cross-cultural perspectives on parliamentary discourse. Cross-Cultural Perspectives on Parliamentary Discourse, pages 1–390. [find](https://scholar.google.com/scholar?q=Paul+Bayley%2E+2004%2E+Cross%2Dcultural+perspectives+on+parliamentary+discourse%2E+Cross%2DCultural+Perspectives+on+Parliamentary+Discourse%2C+pages+1%E2%80%93390%2E)
5. Kaspar Beelen, Timothy Alberdingk Thijm, Christopher Cochrane, Kees Halvemaan, Graeme Hirst, Michael Kimmins, Sander Lijbrink, Maarten Marx, Nona Naderi, Ludovic Rheault, et al. 2017. Digitization of the canadian parliamentary debates. Canadian Journal of Political Science/Revue canadienne de scienc… [find](https://scholar.google.com/scholar?q=Kaspar+Beelen%2C+Timothy+Alberdingk+Thijm%2C+Christopher+Cochrane%2C+Kees+Halvemaan%2C+Graeme+Hirst%2C+Michael+Kimmins%2C+Sander+Lijbrink%2C+Maarten+Marx%2C+Nona+Naderi%2C+Ludovic+Rheault%2C+et+al%2E+2017%2E+Digitization+of+)
6. Dallas Card, Serina Chang, Chris Becker, Julia Mendelsohn, Rob Voigt, Leah Boustan, Ran Abramitzky, and Dan Jurafsky. 2022. Computational analysis of 140 years of us political speeches reveals more positive but increasingly polarized framing of immigration. Proceedings of the National Academy of Sci… [find](https://scholar.google.com/scholar?q=Dallas+Card%2C+Serina+Chang%2C+Chris+Becker%2C+Julia+Mendelsohn%2C+Rob+Voigt%2C+Leah+Boustan%2C+Ran+Abramitzky%2C+and+Dan+Jurafsky%2E+2022%2E+Computational+analysis+of+140+years+of+us+political+speeches+reveals+more+po)
7. R. Charli Carpenter. 2005. “women, children and other vulnerable groups”: Gender, strategic frames and the protection of civilians as a transnational issue. International Studies Quarterly, 49(2). [find](https://scholar.google.com/scholar?q=R%2E+Charli+Carpenter%2E+2005%2E+%E2%80%9Cwomen%2C+children+and+other+vulnerable+groups%E2%80%9D%3A+Gender%2C+strategic+frames+and+the+protection+of+civilians+as+a+transnational+issue%2E+International+Studies+Quarterly%2C+49%282%29%2E)
8. Paul Chilton. 2004. Analysing political discourse: Theory and practice. Routledge. [find](https://scholar.google.com/scholar?q=Paul+Chilton%2E+2004%2E+Analysing+political+discourse%3A+Theory+and+practice%2E+Routledge%2E)
9. Sara R Davis, Cody J Worsnop, and Emily M Hand. 2022. Gender bias recognition in political news articles. Machine Learning with Applications, 8:100304. [find](https://scholar.google.com/scholar?q=Sara+R+Davis%2C+Cody+J+Worsnop%2C+and+Emily+M+Hand%2E+2022%2E+Gender+bias+recognition+in+political+news+articles%2E+Machine+Learning+with+Applications%2C+8%3A100304%2E)
10. Martha Finnemore and Kathryn Sikkink. 1998. International norm dynamics and political change. International organization, 52(4). [find](https://scholar.google.com/scholar?q=Martha+Finnemore+and+Kathryn+Sikkink%2E+1998%2E+International+norm+dynamics+and+political+change%2E+International+organization%2C+52%284%29%2E)
11. Irena Fischer-Hwang, Dylan Grosz, Xinlan Emily Hu, Anjini Karthik, and Vivian Yang. 2020. Disarming loaded words: Addressing gender bias in political reporting. In Computation + Journalism Conference. [find](https://scholar.google.com/scholar?q=Irena+Fischer%2DHwang%2C+Dylan+Grosz%2C+Xinlan+Emily+Hu%2C+Anjini+Karthik%2C+and+Vivian+Yang%2E+2020%2E+Disarming+loaded+words%3A+Addressing+gender+bias+in+political+reporting%2E+In+Computation+%2B+Journalism+Conference%2E)
12. Pierpaolo Goffredo, Shohreh Haddadan, Vorakit Vorakitphan, Elena Cabrio, and Serena Villata. 2022. Fallacious argument classification in political debates. In Proceedings of the 31st International Joint Conference on Artificial Intelligence, pages 4143–4149. [find](https://scholar.google.com/scholar?q=Pierpaolo+Goffredo%2C+Shohreh+Haddadan%2C+Vorakit+Vorakitphan%2C+Elena+Cabrio%2C+and+Serena+Villata%2E+2022%2E+Fallacious+argument+classification+in+political+debates%2E+In+Proceedings+of+the+31st+International+Joi)
13. Shohreh Haddadan, Elena Cabrio, and Serena Villata. 2019. Yes, we can! mining arguments in 50 years of us presidential campaign debates. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4684–4690. [find](https://scholar.google.com/scholar?q=Shohreh+Haddadan%2C+Elena+Cabrio%2C+and+Serena+Villata%2E+2019%2E+Yes%2C+we+can%21+mining+arguments+in+50+years+of+us+presidential+campaign+debates%2E+In+Proceedings+of+the+57th+Annual+Meeting+of+the+Association+fo)
14. Najeh Hajlaoui, David Kolovratnik, Jaakko Väyrynen, Ralf Steinberger, Daniel Varga, et al. 2014. DCEP – Digital Corpus of the European Parliament. In Proceedings of the 9th Language Resources and Evaluation Conference, pages 3164–3171. [find](https://scholar.google.com/scholar?q=Najeh+Hajlaoui%2C+David+Kolovratnik%2C+Jaakko+V%C3%A4yrynen%2C+Ralf+Steinberger%2C+Daniel+Varga%2C+et+al%2E+2014%2E+DCEP+%E2%80%93+Digital+Corpus+of+the+European+Parliament%2E+In+Proceedings+of+the+9th+Language+Resources+and+Eval)
15. Mirko Heinzel and Andrea Liese. 2021. Expert authority and support for covid-19 measures in germany and the uk: a survey experiment. West European Politics, 44(5-6). [find](https://scholar.google.com/scholar?q=Mirko+Heinzel+and+Andrea+Liese%2E+2021%2E+Expert+authority+and+support+for+covid%2D19+measures+in+germany+and+the+uk%3A+a+survey+experiment%2E+West+European+Politics%2C+44%285%2D6%29%2E)
16. Dániel Z Kádár and Sen Zhang. 2019. (im) politeness and alignment: A case study of public political monologues. Acta Linguistica Academica, 66(2):229–249. [find](https://scholar.google.com/scholar?q=D%C3%A1niel+Z+K%C3%A1d%C3%A1r+and+Sen+Zhang%2E+2019%2E+%28im%29+politeness+and+alignment%3A+A+case+study+of+public+political+monologues%2E+Acta+Linguistica+Academica%2C+66%282%29%3A229%E2%80%93249%2E)
17. Dominique Labbé and Jacques Savoy. 2021. Stylistic analysis of the french presidential speeches: Is macron really different? Digital Scholarship in the Humanities, 36(1):153–163. [find](https://scholar.google.com/scholar?q=Dominique+Labb%C3%A9+and+Jacques+Savoy%2E+2021%2E+Stylistic+analysis+of+the+french+presidential+speeches%3A+Is+macron+really+different%3F+Digital+Scholarship+in+the+Humanities%2C+36%281%29%3A153%E2%80%93163%2E)
18. J Richard Landis and Gary G Koch. 1977. The measurement of observer agreement for categorical data. Biometrics. [find](https://scholar.google.com/scholar?q=J+Richard+Landis+and+Gary+G+Koch%2E+1977%2E+The+measurement+of+observer+agreement+for+categorical+data%2E+Biometrics%2E)
19. Anne Lauscher, Goran Glavaš, and Simone Paolo Ponzetto. 2018. An argument-annotated corpus of scientific publications. In Proceedings of the 5th Workshop on Argument Mining, Brussels, Belgium. ACL. [find](https://scholar.google.com/scholar?q=Anne+Lauscher%2C+Goran+Glava%C5%A1%2C+and+Simone+Paolo+Ponzetto%2E+2018%2E+An+argument%2Dannotated+corpus+of+scientific+publications%2E+In+Proceedings+of+the+5th+Workshop+on+Argument+Mining%2C+Brussels%2C+Belgium%2E+ACL%2E)
20. Eleonora Mancini, Federico Ruggeri, Andrea Galassi, and Paolo Torroni. 2022. Multimodal argument mining: A case study in political debates. In Proceedings of the 9th Workshop on Argument Mining, pages 158–170. [find](https://scholar.google.com/scholar?q=Eleonora+Mancini%2C+Federico+Ruggeri%2C+Andrea+Galassi%2C+and+Paolo+Torroni%2E+2022%2E+Multimodal+argument+mining%3A+A+case+study+in+political+debates%2E+In+Proceedings+of+the+9th+Workshop+on+Argument+Mining%2C+pages)
21. Meisam Moghadam and Niloofar Jafarpour. 2022. Pragmatic annotation of manipulation in political discourse: The case of trump-clinton presidential debate. Linguistic Forum – A Journal of Linguistics, 4(4):32–39. [find](https://scholar.google.com/scholar?q=Meisam+Moghadam+and+Niloofar+Jafarpour%2E+2022%2E+Pragmatic+annotation+of+manipulation+in+political+discourse%3A+The+case+of+trump%2Dclinton+presidential+debate%2E+Linguistic+Forum+%E2%80%93+A+Journal+of+Linguistics%2C+4)
22. Sebastian Padó, André Blessing, Nico Blokker, Erenay Dayanık, Sebastian Haunss, and Jonas Kuhn. 2019. Who sides with whom? towards computational construction of discourse networks for political debates. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages… [find](https://scholar.google.com/scholar?q=Sebastian+Pad%C3%B3%2C+Andr%C3%A9+Blessing%2C+Nico+Blokker%2C+Erenay+Dayan%C4%B1k%2C+Sebastian+Haunss%2C+and+Jonas+Kuhn%2E+2019%2E+Who+sides+with+whom%3F+towards+computational+construction+of+discourse+networks+for+political+debate)
23. Robert D Putnam. 1988. Diplomacy and domestic politics: the logic of two-level games. In International organization, volume 42. CUP. [find](https://scholar.google.com/scholar?q=Robert+D+Putnam%2E+1988%2E+Diplomacy+and+domestic+politics%3A+the+logic+of+two%2Dlevel+games%2E+In+International+organization%2C+volume+42%2E+CUP%2E)
24. François Randour, Julien Perrez, and Min Reuchamps. 2020. Twenty years of research on political discourse: A systematic review and directions for future research. Discourse & Society, 31(4). [find](https://scholar.google.com/scholar?q=Fran%C3%A7ois+Randour%2C+Julien+Perrez%2C+and+Min+Reuchamps%2E+2020%2E+Twenty+years+of+research+on+political+discourse%3A+A+systematic+review+and+directions+for+future+research%2E+Discourse+%26+Society%2C+31%284%29%2E)
25. Maria Sidiropoulou. 2013. Representation through translation: Shared maps of pragmatic meaning and the constructionist paradigm. Journal of pragmatics, 53. [find](https://scholar.google.com/scholar?q=Maria+Sidiropoulou%2E+2013%2E+Representation+through+translation%3A+Shared+maps+of+pragmatic+meaning+and+the+constructionist+paradigm%2E+Journal+of+pragmatics%2C+53%2E)
26. Christian Stab and Iryna Gurevych. 2014. Annotating argument components and relations in persuasive essays. In Proceedings of the 25th International Conference on Computational Linguistics: Technical papers, pages 1501–1510. [find](https://scholar.google.com/scholar?q=Christian+Stab+and+Iryna+Gurevych%2E+2014%2E+Annotating+argument+components+and+relations+in+persuasive+essays%2E+In+Proceedings+of+the+25th+International+Conference+on+Computational+Linguistics%3A+Technical+) [our card](https://md.research.elamur.ai/free/en/papers/stab-2014-annotating-argument-components-relations-persuasive/)
27. Ralf Steinberger, Bruno Pouliquen, Anna Widiger, Camelia Ignat, Tomaz Erjavec, Dan Tufis, and Dániel Varga. 2006. The JRC-Acquis: A multilingual aligned parallel corpus with 20+ languages. In Proceedings of the 5th Language Resources and Evaluation Conference. [find](https://scholar.google.com/scholar?q=Ralf+Steinberger%2C+Bruno+Pouliquen%2C+Anna+Widiger%2C+Camelia+Ignat%2C+Tomaz+Erjavec%2C+Dan+Tufis%2C+and+D%C3%A1niel+Varga%2E+2006%2E+The+JRC%2DAcquis%3A+A+multilingual+aligned+parallel+corpus+with+20%2B+languages%2E+In+Proceedi) [our card](https://md.research.elamur.ai/free/en/papers/steinberger-2006-jrc-acquis-multilingual-aligned-parallel/)
28. Stephen E Toulmin. 2003. The uses of argument. Cambridge University Press. [find](https://scholar.google.com/scholar?q=Stephen+E+Toulmin%2E+2003%2E+The+uses+of+argument%2E+Cambridge+University+Press%2E)
29. Briana M Trifiro, Sejin Paik, Zhixin Fang, and Li Zhang. 2021. Politics and politeness: Analysis of incivility on twitter during the 2020 democratic presidential primary. Social Media + Society, 7(3):20563051211036939. [find](https://scholar.google.com/scholar?q=Briana+M+Trifiro%2C+Sejin+Paik%2C+Zhixin+Fang%2C+and+Li+Zhang%2E+2021%2E+Politics+and+politeness%3A+Analysis+of+incivility+on+twitter+during+the+2020+democratic+presidential+primary%2E+Social+Media+%2B+Society%2C+7%283%29%3A)
30. David Vilares and Yulan He. 2017. Detecting perspectives in political debates. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 1573– 1582. [find](https://scholar.google.com/scholar?q=David+Vilares+and+Yulan+He%2E+2017%2E+Detecting+perspectives+in+political+debates%2E+In+Proceedings+of+the+2017+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+1573%E2%80%93+1582%2E)
31. Kenneth N Waltz. 1993. The emerging structure of international politics. International security, 18(2). [find](https://scholar.google.com/scholar?q=Kenneth+N+Waltz%2E+1993%2E+The+emerging+structure+of+international+politics%2E+International+security%2C+18%282%29%2E)
32. Magdalena Wolska, Bernd Fröhlich, Katrin Girgensohn, Sassan Gholiagha, Dora Kiesel, Jürgen Neyer, Patrick Riehmann, Mitja Sienknecht, and Benno Stein. 2024. Argumentation in Waltz’s ’Emerging Structure of International Politics’. In 10th Conference of the International Society for the Study of Argum… [find](https://scholar.google.com/scholar?q=Magdalena+Wolska%2C+Bernd+Fr%C3%B6hlich%2C+Katrin+Girgensohn%2C+Sassan+Gholiagha%2C+Dora+Kiesel%2C+J%C3%BCrgen+Neyer%2C+Patrick+Riehmann%2C+Mitja+Sienknecht%2C+and+Benno+Stein%2E+2024%2E+Argumentation+in+Waltz%E2%80%99s+%E2%80%99Emerging+Structur)
33. Magdalena Wolska, Sassan Gholiagha, Mitja Sienknecht, Dora Kiesel, Irene Lopez Garcia, Patrick Riehmann, Matti Wiegmann, Bernd Fröhlich, Katrin Girgensohn, Jürgen Neyer, and Benno Stein. 2025. Argumentation and Domain Discourse in Scholarly Articles on the Theory of International Relations. In 31st… [find](https://scholar.google.com/scholar?q=Magdalena+Wolska%2C+Sassan+Gholiagha%2C+Mitja+Sienknecht%2C+Dora+Kiesel%2C+Irene+Lopez+Garcia%2C+Patrick+Riehmann%2C+Matti+Wiegmann%2C+Bernd+Fr%C3%B6hlich%2C+Katrin+Girgensohn%2C+J%C3%BCrgen+Neyer%2C+and+Benno+Stein%2E+2025%2E+Argumen)