--- title: "The Guidelines Specialists at FIGNEWS 2024 Shared Task: An" description: "This paper describes one team's annotation guideline for the FIGNEWS 2024 shared task… 0.003 recall. 7 references, cited by 1 paper here." authors: ["Ghizlane Bourahouat", "Samar Amer"] year: 2024 venue: "Proceedings of the Second Arabic Natural Language Processing Conference" source: "https://aclanthology.org/2024.arabicnlp-1.73/" doi: "10.18653/v1/2024.arabicnlp-1.73" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/bourahouat-2024-guidelines-specialists-fignews-2024-shared/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/bourahouat-2024-guidelines-specialists-fignews-2024-shared/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/12/) / The Guidelines Specialists at FIGNEWS 2024 Shared Task: An annotation guideline to Unravel Bias in News Media Narratives Using a Linguistic Approach # The Guidelines Specialists at FIGNEWS 2024 Shared Task: An annotation guideline to Unravel Bias in News Media Narratives Using a Linguistic Approach **Authors:** Ghizlane Bourahouat and Samar Amer · **Year:** 2024 · **Venue:** [Proceedings of the Second Arabic Natural Language Processing Conference](https://md.research.elamur.ai/free/en/venues/arabicnlp/) ([ArabicNLP 2024](https://md.research.elamur.ai/free/en/venues/arabicnlp/2024/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2024.arabicnlp-1.73/) · [PDF](https://aclanthology.org/2024.arabicnlp-1.73.pdf) · [DOI 10.18653/v1/2024.arabicnlp-1.73](https://doi.org/10.18653/v1/2024.arabicnlp-1.73) · [OpenAlex](https://openalex.org/W4402671019) **Citations:** 1 citations (OpenAlex, 2026-10-14) · [1](https://md.research.elamur.ai/free/en/papers/bourahouat-2024-guidelines-specialists-fignews-2024-shared/cited-by/) in our library, of the 149,439 papers whose bibliographies we read ## Summary This paper describes one team's annotation guideline for the FIGNEWS 2024 shared task, which asked participants to label news posts about the 2023–2024 Gaza-Israel war for bias and propaganda. The task fixed seven labels, and the team's job was to define where each label begins and ends. Their criteria rest on three linguistic signals: - passive verbs of killing or destruction where the agent is never named; - nominalizations such as "bombardment" that remove the doer; - word choice, covering both stigmatizing labels and kinship terms that steer the reader's sympathy. The team checked candidate keywords with the AntConc and LancsBox tools, using frequencies, collocations and especially concordance lines. Two annotators labelled 1509 sentences spread across five languages. They reached a Cohen's Kappa of 0.85, which the authors credit to clear examples and training. The organizers' scores are much weaker and somewhat inconsistent (F1 0.068, overall 0.740). The paper matters mainly as a worked example of turning critical-discourse ideas about hidden agency into concrete, checkable annotation rules. ## Key points - The seven labels were: Unbiased, Biased against Palestine, Biased against Israel, Biased against both, Biased against others, Unclear and Not Applicable. - The structural cues were agentless passives (e.g. "were killed") and doer-hiding nominalizations, both read as bias against the victim. The lexical cues included "brutal", "militant" and "genocide", plus kinship nouns combined with group names. - Lexical criteria were tested in AntConc and LancsBox. The authors found concordance more useful than collocation measures because it shows full context and scales to long texts. - 1509 sentences were annotated across Arabic, English, French, Hindi and Hebrew. "Biased against Palestine" was the most frequent label. - Inter-annotator agreement was Cohen's Kappa 0.85. The organizers' evaluation gave precision 0.003, recall 0.098, F1 0.068 and an overall score of 0.740. ## Interesting ideas - An agentless passive of a harmful verb is treated as a measurable cue that responsibility is being concealed, not just as a style choice. - Nominalized events like "destruction" are read as events whose doer slot is empty, which gives them the same accountability gap as agentless passives. - Candidate cue words are adopted only after their concordance lines have been inspected, rather than trusting collocation statistics alone. - Ambiguity between labels is resolved by fixed policy: one label has priority whenever its keywords appear, and otherwise the most frequently repeated cue decides. - Kinship and relationship nouns are counted as an empathy-steering device that tilts the reader toward one party. ## For Mova How these ideas could serve Mova, our small open language model — its files, stages and tests: - **I1** (frames): when a passive clause with a violent VerbNet class has no `obl:agent`, prag could mark the Agent role as "deliberately unexpressed" and expose this as an explainable framing feature. - **I2** (world): such nouns could be compiled into event entities with an explicitly unfilled agent slot, so questions like "who destroyed it?" get an honest "not stated" answer. - **I3** (learn): proposed self-induced repair rules or lexical triggers could be validated by sampling their in-context hits before they enter the rule set, which acts as a cheap human-readable control. - **I4** (learn): when witness parsers or teacher tiers disagree on silver labels, a documented precedence-plus-frequency tiebreak keeps adjudication deterministic and auditable. - **I5** (frames): prag could tag kinship mentions tied to a group as an affective-appeal cue, which would help implicature and stance detection in narrative texts. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions Also on the byline: [École des Sciences de I'information](https://ror.org/04wx25x02). 📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [📚 Literature and Literary Theory](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/literature-and-literary-theory/) · 519 works ## Cite Cite as: Ghizlane Bourahouat and Samar Amer. 2024. The Guidelines Specialists at FIGNEWS 2024 Shared Task: An annotation guideline to Unravel Bias in News Media Narratives Using a Linguistic Approach. Proceedings of the Second Arabic Natural Language Processing Conference. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{bourahouat2024guidelines, title = {{The Guidelines Specialists at FIGNEWS 2024 Shared Task: An annotation guideline to Unravel Bias in News Media Narratives Using a Linguistic Approach}}, author = {Ghizlane Bourahouat and Samar Amer}, booktitle = {Proceedings of the Second Arabic Natural Language Processing Conference}, year = {2024}, doi = {10.18653/v1/2024.arabicnlp-1.73}, url = {https://doi.org/10.18653/v1/2024.arabicnlp-1.73} } ``` - [← previous The Annotators Agree to Not Agree on the Fine-grained Annotation of Hate-speech against Women in Algerian Dialect Comments](https://md.research.elamur.ai/free/en/papers/guellil-2024-annotators-agree-not-agree-fine/) - [next → The Relative Clauses AMR Parsers Hate Most](https://md.research.elamur.ai/free/en/papers/yang-2024-relative-clauses-amr-parsers-hate/) - [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/12/) ## References 7 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Busa, G.M. (2014). Introducing the language of the news: A student’s guide. Routledge. [find](https://scholar.google.com/scholar?q=Busa%2C+G%2EM%2E+%282014%29%2E+Introducing+the+language+of+the+news%3A+A+student%E2%80%99s+guide%2E+Routledge%2E) 2. Fowler, R., Hodge, B., Kress, G. and Trew, T. (1979). Language and social control. London: Routledge. [find](https://scholar.google.com/scholar?q=Fowler%2C+R%2E%2C+Hodge%2C+B%2E%2C+Kress%2C+G%2E+and+Trew%2C+T%2E+%281979%29%2E+Language+and+social+control%2E+London%3A+Routledge%2E) 3. Jennifer D’Souza & Sören Auer. (2021). Sentence, phrase, and triple annotations to build a knowledge graph of natural language processing contributions—A trial dataset. Journal of Data and Information Science, 6(3). Md. Adnanul Islam, Md. Saddam Hossain Mukta, Patrick Olivier, & Md. [↗](https://doi.org/10.2478/jdis-2021-0023) 4. Mahbubur Rahman. (2022). Comprehensive guidelines for emotion annotation. Proceedings of the 22nd ACM International Conference on Intelligent Virtual Agents, 1–8. [find](https://scholar.google.com/scholar?q=Mahbubur+Rahman%2E+%282022%29%2E+Comprehensive+guidelines+for+emotion+annotation%2E+Proceedings+of+the+22nd+ACM+International+Conference+on+Intelligent+Virtual+Agents%2C+1%E2%80%938%2E) 5. Nabil Hossain, John Krumm, Michael Gamon, & Henry Kautz. (2020). SemEval-2020 Task 7: Assessing Humor in Edited News Headlines. In the Proceedings of the Fourteenth Workshop on Semantic Evaluation. [↗](https://doi.org/10.48550/arxiv.2008.00304) 6. Söğüt, S. (2018). Ideology in the news through active, passive sentences and nominalization: A study on the terrorist attack in Ankara reported in British and American Newspapers. Journal of Language and Linguistic Studies, 14(1), 162-177. [find](https://scholar.google.com/scholar?q=S%C3%B6%C4%9F%C3%BCt%2C+S%2E+%282018%29%2E+Ideology+in+the+news+through+active%2C+passive+sentences+and+nominalization%3A+A+study+on+the+terrorist+attack+in+Ankara+reported+in+British+and+American+Newspapers%2E+Journal+of+Language+) 7. Wajdi Zaghouani, Mustafa Jarrar, Nizar Habash, Houda Bouamor, Imed Zitouni, Mona Diab, Samhaa R. El-Beltagy and Muhammed AbuOdeh . 2024. [The FIGNEWS Shared Task on News Media Narratives](https://md.research.elamur.ai/free/en/papers/zaghouani-2024-fignews-shared-task-news-media/), In Proceedings of the Second Arabic Natural Language Processing Conference (ArabicNLP 2024). Association for Computational Linguistics, Bangkok, Thailand. [↗](https://doi.org/10.48550/arxiv.2407.18147) *Updated 1 November 2026*