---
title: "ConGA: Guidelines for Contextual Gender — Rescigno 2026"
description: "Translating from English, which rarely marks gender, into Italian, which requires gender agreement on nouns, articles, adjectives and participles, forces…"
authors: ["Argentina Anna Rescigno", "Eva Vanmassenhove", "Johanna Monti"]
year: 2026
venue: "Proceedings of the Fifteenth Language Resources and Evaluation Conference"
source: "https://aclanthology.org/2026.lrec-1.320/"
doi: "10.63317/5nai3xa6oon7"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/rescigno-2026-conga-guidelines-contextual-gender-annotation/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/rescigno-2026-conga-guidelines-contextual-gender-annotation/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/3/) / ConGA: Guidelines for Contextual Gender Annotation. a Framework for Annotating Gender in Machine Translation

# ConGA: Guidelines for Contextual Gender Annotation. a Framework for Annotating Gender in Machine Translation

**Authors:** [Argentina Anna Rescigno](https://md.research.elamur.ai/free/en/authors/argentina-anna-rescigno/), [Eva Vanmassenhove](https://md.research.elamur.ai/free/en/authors/eva-vanmassenhove/), [Johanna Monti](https://md.research.elamur.ai/free/en/authors/johanna-monti/) · **Year:** 2026 · **Venue:** Proceedings of the Fifteenth Language Resources and Evaluation Conference · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.lrec-1.320/) · [PDF](https://aclanthology.org/2026.lrec-1.320.pdf) · [DOI 10.63317/5nai3xa6oon7](https://doi.org/10.63317/5nai3xa6oon7) · [OpenAlex](https://openalex.org/W7160108582)

**Citations:** 0 citations (openalex-snapshot · 2026-10-14)

## Summary
Translating from English, which rarely marks gender, into Italian, which requires gender agreement on nouns, articles, adjectives and participles, forces MT systems and LLMs to choose a gender that the source text often leaves open. These systems tend to fall back on masculine forms. The authors argue that bias research does not yet have a shared, linguistically grounded way to annotate and measure this. They propose ConGA (Contextual Gender Annotation), a set of word-level guidelines. On the English side, ConGA labels semantic gender as Masculine, Feminine or Ambiguous. On the Italian side, it records how grammatical gender is actually realised. Entity identifiers link mentions of the same referent across sentences. The scheme only covers animate (human) referents, because the gender of inanimate nouns is purely morphological and says nothing about social bias. The authors applied ConGA to the gENder-IT corpus and evaluated Italian translations from two models. The analysis shows systematic overuse of masculine forms and unreliable feminine output. The resulting gold standard and method support reproducible, cross-lingual evaluation of gender bias.

## Key points
- Tagset: English source tokens get M, F or A (ambiguous, where context does not justify assuming a gender). Italian target tokens get M or F. Entity-level IDs track each referent across sentences.
- Data: the English side of gENder-IT (Vanmassenhove and Monti, 2021), an English–Italian challenge set built from MuST-SHE v1.04. Its earlier tags were removed and the data re-annotated to match the new guidelines.
- Translations were generated with mBART and TowerInstruct-7B ("TowerLLM", thinkverse/towerinstruct), run locally through Ollama.
- Main finding: both systems over-produce masculine forms and realise feminine gender inconsistently. The exact figures were not included in the excerpt we had.
- The paper positions ConGA against WinoGender, WinoMT, MuST-SHE and English-only bias taxonomies (Hitti et al., 2019; Havens et al., 2022). ConGA moves from counting outputs toward describing where and how gender is encoded across languages.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/)

Topics: [Machine translation](https://md.research.elamur.ai/free/en/topics/machine-translation/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{rescigno2026conga,
  title = {{ConGA: Guidelines for Contextual Gender Annotation. a Framework for Annotating Gender in Machine Translation}},
  author = {Rescigno, Argentina Anna and Vanmassenhove, Eva and Monti, Johanna},
  booktitle = {Proceedings of the Fifteenth Language Resources and Evaluation Conference},
  year = {2026},
  doi = {10.63317/5nai3xa6oon7},
  url = {https://doi.org/10.63317/5nai3xa6oon7}
}
```

- [← previous Conceptualising love in Amharic](https://md.research.elamur.ai/free/en/papers/kacprzak-2026-conceptualising-love-amharic/)
- [next → Consistency of LLMs to Comparative Statements in Mathematical Reasoning Tasks](https://md.research.elamur.ai/free/en/papers/san-2026-consistency-llms-comparative-statements-mathematical/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/3/)

## References

29 references, 8 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Luisa Bentivogli, Beatrice Savoldi, Matteo Negri, Mattia A. Di Gangi, Roldano Cattoni, and Marco Turchi. 2020. Gender in Danger? Evaluating Speech Translation Technology on the MuST-SHE Corpus. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 6923–693… [find](https://scholar.google.com/scholar?q=Luisa+Bentivogli%2C+Beatrice+Savoldi%2C+Matteo+Negri%2C+Mattia+A%2E+Di+Gangi%2C+Roldano+Cattoni%2C+and+Marco+Turchi%2E+2020%2E+Gender+in+Danger%3F+Evaluating+Speech+Translation+Technology+on+the+MuST%2DSHE+Corpus%2E+In+Pro) [our card](https://md.research.elamur.ai/free/en/papers/bentivogli-2020-gender-danger-evaluating-speech-translation/)
2. Geert Booij. 1996. Inherent versus contextual inflection and the split morphology hypothesis. In Geert Booij, Jaap Van Marle, Stephen Anderson, Mark Aronoff, Laurie Bauer, Mark Baker, Rudie Botha, Joan Bybee, Andrew Carstairs-McCarthy, Wolfgang Dressler, Jack Hoeksema, Rochelle Lieber, Peter Matthew… [find](https://scholar.google.com/scholar?q=Geert+Booij%2E+1996%2E+Inherent+versus+contextual+inflection+and+the+split+morphology+hypothesis%2E+In+Geert+Booij%2C+Jaap+Van+Marle%2C+Stephen+Anderson%2C+Mark+Aronoff%2C+Laurie+Bauer%2C+Mark+Baker%2C+Rudie+Botha%2C+Joa)
3. Won Ik Cho, Ji Won Kim, Seok Min Kim, and Nam Soo Kim. 2019. On Measuring Gender Bias in Translation of Gender-neutral Pronouns. In Proceedings of the First Workshop on Gender Bias in Natural Language Processing, pages 173–181, Florence, Italy. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Won+Ik+Cho%2C+Ji+Won+Kim%2C+Seok+Min+Kim%2C+and+Nam+Soo+Kim%2E+2019%2E+On+Measuring+Gender+Bias+in+Translation+of+Gender%2Dneutral+Pronouns%2E+In+Proceedings+of+the+First+Workshop+on+Gender+Bias+in+Natural+Language)
4. Greville G. Corbett. 1991. Gender, 1 edition. Cambridge University Press. [find](https://scholar.google.com/scholar?q=Greville+G%2E+Corbett%2E+1991%2E+Gender%2C+1+edition%2E+Cambridge+University+Press%2E)
5. Mostafa Elaraby, Ahmed Y. Tawfik, Mahmoud Khaled, Hany Hassan, and Aly Osama. 2018. Gender Aware Spoken Language Translation Applied to English-Arabic. ArXiv:1802.09287 [cs]. — [arXiv:1802.09287](https://arxiv.org/abs/1802.09287) [find](https://scholar.google.com/scholar?q=Mostafa+Elaraby%2C+Ahmed+Y%2E+Tawfik%2C+Mahmoud+Khaled%2C+Hany+Hassan%2C+and+Aly+Osama%2E+2018%2E+Gender+Aware+Spoken+Language+Translation+Applied+to+English%2DArabic%2E+ArXiv%3A1802%2E09287+%5Bcs%5D%2E+%E2%80%94+%5BarXiv%3A1802%2E09287%5D%28http)
6. Joel Escudé Font and Marta R. Costa-jussà. 2019. Equalizing Gender Bias in Neural Machine Translation with Word Embeddings Techniques. In Proceedings of the First Workshop on Gender Bias in Natural Language Processing, pages 147–154, Florence, Italy. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Joel+Escud%C3%A9+Font+and+Marta+R%2E+Costa%2Djuss%C3%A0%2E+2019%2E+Equalizing+Gender+Bias+in+Neural+Machine+Translation+with+Word+Embeddings+Techniques%2E+In+Proceedings+of+the+First+Workshop+on+Gender+Bias+in+Natural+La)
7. European Parliament. 2018. Gender-neutral language in the european parliament. Technical report, European Parliament, Luxembourg. Publications Office of the European Union. [find](https://scholar.google.com/scholar?q=European+Parliament%2E+2018%2E+Gender%2Dneutral+language+in+the+european+parliament%2E+Technical+report%2C+European+Parliament%2C+Luxembourg%2E+Publications+Office+of+the+European+Union%2E)
8. Nikhil Garg, Londa Schiebinger, Dan Jurafsky, and James Zou. 2018. Word Embeddings Quantify 100 Years of Gender and Ethnic Stereotypes. Proceedings of the National Academy of Sciences, 115(16). ArXiv:1711.08412 [cs]. — [arXiv:1711.08412](https://arxiv.org/abs/1711.08412) [find](https://scholar.google.com/scholar?q=Nikhil+Garg%2C+Londa+Schiebinger%2C+Dan+Jurafsky%2C+and+James+Zou%2E+2018%2E+Word+Embeddings+Quantify+100+Years+of+Gender+and+Ethnic+Stereotypes%2E+Proceedings+of+the+National+Academy+of+Sciences%2C+115%2816%29%2E+ArXiv%3A)
9. Lucy Havens, Melissa Terras, Benjamin Bach, and Beatrice Alex. 2022. Uncertainty and Inclusivity in Gender Bias Annotation: An Annotation Taxonomy and Annotated Datasets of British English Text. In Proceedings of the 4th Workshop on Gender Bias in Natural Language Processing (GeBNLP), pages 30–57, S… [find](https://scholar.google.com/scholar?q=Lucy+Havens%2C+Melissa+Terras%2C+Benjamin+Bach%2C+and+Beatrice+Alex%2E+2022%2E+Uncertainty+and+Inclusivity+in+Gender+Bias+Annotation%3A+An+Annotation+Taxonomy+and+Annotated+Datasets+of+British+English+Text%2E+In+Pr)
10. Yasmeen Hitti, Eunbee Jang, Ines Moreno, and Carolyne Pelletier. 2019. Proposed Taxonomy for Gender Bias in Text; A Filtering Methodology for the Gender Generalization Subtype. In Proceedings of the First Workshop on Gender Bias in Natural Language Processing, pages 8–17, Florence, Italy. Associatio… [find](https://scholar.google.com/scholar?q=Yasmeen+Hitti%2C+Eunbee+Jang%2C+Ines+Moreno%2C+and+Carolyne+Pelletier%2E+2019%2E+Proposed+Taxonomy+for+Gender+Bias+in+Text%3B+A+Filtering+Methodology+for+the+Gender+Generalization+Subtype%2E+In+Proceedings+of+the+F)
11. Daniel Kahneman. 2011. Thinking, Fast and Slow. Farrar, Straus and Giroux, New York. [find](https://scholar.google.com/scholar?q=Daniel+Kahneman%2E+2011%2E+Thinking%2C+Fast+and+Slow%2E+Farrar%2C+Straus+and+Giroux%2C+New+York%2E)
12. Jan-Christoph Klie, Michael Bugert, Beto Boullosa, Richard Eckart de Castilho, and Iryna Gurevych. 2018. The INCEpTION Platform: Machine-Assisted and Knowledge-Oriented Interactive Annotation. In Proceedings of the 27th International Conference on Computational Linguistics: System Demonstrations, pa… [find](https://scholar.google.com/scholar?q=Jan%2DChristoph+Klie%2C+Michael+Bugert%2C+Beto+Boullosa%2C+Richard+Eckart+de+Castilho%2C+and+Iryna+Gurevych%2E+2018%2E+The+INCEpTION+Platform%3A+Machine%2DAssisted+and+Knowledge%2DOriented+Interactive+Annotation%2E+In+Proc) [our card](https://md.research.elamur.ai/free/en/papers/klie-2018-inception-platform-machine-assisted-knowledge/)
13. Sally McConnell-Ginet. 2013. ‘ Gender and its relation to sex: The myth of ‘natural’ gender. In Greville G. Corbett, editor, The Expression of Gender, pages 3–38. DE GRUYTER. [find](https://scholar.google.com/scholar?q=Sally+McConnell%2DGinet%2E+2013%2E+%E2%80%98+Gender+and+its+relation+to+sex%3A+The+myth+of+%E2%80%98natural%E2%80%99+gender%2E+In+Greville+G%2E+Corbett%2C+editor%2C+The+Expression+of+Gender%2C+pages+3%E2%80%9338%2E+DE+GRUYTER%2E)
14. Johanna Monti. 2017. Questioni di genere in traduzione automatica. In Al femminile: scritti linguistici in onore di Cristina Vallini, number 139 in Quaderni della rassegna. Franco Cesati Editore, Firenze. [find](https://scholar.google.com/scholar?q=Johanna+Monti%2E+2017%2E+Questioni+di+genere+in+traduzione+automatica%2E+In+Al+femminile%3A+scritti+linguistici+in+onore+di+Cristina+Vallini%2C+number+139+in+Quaderni+della+rassegna%2E+Franco+Cesati+Editore%2C+Fire)
15. Terttu Nevalainen and Helena Raumolin-Brunberg. 1993. Its strength and the beauty of it: The standardization of the third person neuter possessive in Early Modern English. In Dieter Stein and Ingrid Tieken-Boon van Ostade, editors, 1600 - 1800, pages 171–216. De Gruyter Mouton, Berlin, Boston. [find](https://scholar.google.com/scholar?q=Terttu+Nevalainen+and+Helena+Raumolin%2DBrunberg%2E+1993%2E+Its+strength+and+the+beauty+of+it%3A+The+standardization+of+the+third+person+neuter+possessive+in+Early+Modern+English%2E+In+Dieter+Stein+and+Ingrid+T)
16. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pages 311–318, Philadelphia, Pennsylvania, USA. Association for Computational… [find](https://scholar.google.com/scholar?q=Kishore+Papineni%2C+Salim+Roukos%2C+Todd+Ward%2C+and+Wei%2DJing+Zhu%2E+2002%2E+Bleu%3A+a+method+for+automatic+evaluation+of+machine+translation%2E+In+Proceedings+of+the+40th+Annual+Meeting+of+the+Association+for+Comp) [our card](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/)
17. Marcelo O. R. Prates, Pedro H. Avelar, and Luís C. Lamb. 2020. Assessing Gender Bias in Machine Translation: a Case Study with Google Translate. Neural Computing and Applications, 32(10):6363–6381. [find](https://scholar.google.com/scholar?q=Marcelo+O%2E+R%2E+Prates%2C+Pedro+H%2E+Avelar%2C+and+Lu%C3%ADs+C%2E+Lamb%2E+2020%2E+Assessing+Gender+Bias+in+Machine+Translation%3A+a+Case+Study+with+Google+Translate%2E+Neural+Computing+and+Applications%2C+32%2810%29%3A6363%E2%80%936381%2E)
18. A. A. Rescigno, E. Vanmassenhove, J. Monti, and A. Way. 2020. A case study of natural gender phenomena in translation A comparison of google translate, bing microsoft translator and deepl for english to Italian, French and Spanish. In CEUR Workshop Proceedings, volume 2769. ISSN: 16130073. [find](https://scholar.google.com/scholar?q=A%2E+A%2E+Rescigno%2C+E%2E+Vanmassenhove%2C+J%2E+Monti%2C+and+A%2E+Way%2E+2020%2E+A+case+study+of+natural+gender+phenomena+in+translation+A+comparison+of+google+translate%2C+bing+microsoft+translator+and+deepl+for+english+)
19. Argentina Anna Rescigno and Johanna Monti. 2023. Gender Bias in Machine Translation: a statistical evaluation of Google Translate and DeepL for English, Italian and German. In Proceedings of the International Conference on Human-informed Translation and Interpreting Technology 2023, pages 1–11. INCO… [find](https://scholar.google.com/scholar?q=Argentina+Anna+Rescigno+and+Johanna+Monti%2E+2023%2E+Gender+Bias+in+Machine+Translation%3A+a+statistical+evaluation+of+Google+Translate+and+DeepL+for+English%2C+Italian+and+German%2E+In+Proceedings+of+the+Inter)
20. Rachel Rudinger, Jason Naradowsky, Brian Leonard, and Benjamin Van Durme. 2018. Gender Bias in Coreference Resolution. ArXiv:1804.09301 [cs]. [find](https://scholar.google.com/scholar?q=Rachel+Rudinger%2C+Jason+Naradowsky%2C+Brian+Leonard%2C+and+Benjamin+Van+Durme%2E+2018%2E+Gender+Bias+in+Coreference+Resolution%2E+ArXiv%3A1804%2E09301+%5Bcs%5D%2E) [our card](https://md.research.elamur.ai/free/en/papers/rudinger-2018-gender-bias-coreference-resolution/)
21. Beatrice Savoldi, Jasmijn Bastings, Luisa Bentivogli, and Eva Vanmassenhove. 2025. A decade of gender bias in machine translation. Patterns, 6(6):101257. [find](https://scholar.google.com/scholar?q=Beatrice+Savoldi%2C+Jasmijn+Bastings%2C+Luisa+Bentivogli%2C+and+Eva+Vanmassenhove%2E+2025%2E+A+decade+of+gender+bias+in+machine+translation%2E+Patterns%2C+6%286%29%3A101257%2E)
22. Beatrice Savoldi, Marco Gaido, Luisa Bentivogli, Matteo Negri, and Marco Turchi. 2021. Gender Bias in Machine Translation. Transactions of the Association for Computational Linguistics, 9:845–874. Place: Cambridge, MA Publisher: MIT Press. [find](https://scholar.google.com/scholar?q=Beatrice+Savoldi%2C+Marco+Gaido%2C+Luisa+Bentivogli%2C+Matteo+Negri%2C+and+Marco+Turchi%2E+2021%2E+Gender+Bias+in+Machine+Translation%2E+Transactions+of+the+Association+for+Computational+Linguistics%2C+9%3A845%E2%80%93874%2E+Pla) [our card](https://md.research.elamur.ai/free/en/papers/savoldi-2021-gender-bias-machine-translation/)
23. Gabriel Stanovsky, Noah A. Smith, and Luke Zettlemoyer. 2019. Evaluating Gender Bias in Machine Translation. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 1679–1684, Florence, Italy. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Gabriel+Stanovsky%2C+Noah+A%2E+Smith%2C+and+Luke+Zettlemoyer%2E+2019%2E+Evaluating+Gender+Bias+in+Machine+Translation%2E+In+Proceedings+of+the+57th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C) [our card](https://md.research.elamur.ai/free/en/papers/stanovsky-2019-evaluating-gender-bias-machine-translation/)
24. Eva Vanmassenhove. 2024. Gender Bias in Machine Translation and The Era of Large Language Models. ArXiv:2401.10016 [cs]. — [arXiv:2401.10016](https://arxiv.org/abs/2401.10016) [find](https://scholar.google.com/scholar?q=Eva+Vanmassenhove%2E+2024%2E+Gender+Bias+in+Machine+Translation+and+The+Era+of+Large+Language+Models%2E+ArXiv%3A2401%2E10016+%5Bcs%5D%2E+%E2%80%94+%5BarXiv%3A2401%2E10016%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2401%2E10016%29)
25. Eva Vanmassenhove, Christian Hardmeier, and Andy Way. 2018. Getting Gender Right in Neural Machine Translation. In Proceedings of the 2018 [find](https://scholar.google.com/scholar?q=Eva+Vanmassenhove%2C+Christian+Hardmeier%2C+and+Andy+Way%2E+2018%2E+Getting+Gender+Right+in+Neural+Machine+Translation%2E+In+Proceedings+of+the+2018) [our card](https://md.research.elamur.ai/free/en/papers/vanmassenhove-2018-getting-gender-right-neural-machine/)
26. Conference on Empirical Methods in Natural Language Processing, pages 3003–3008, Brussels, Belgium. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+3003%E2%80%933008%2C+Brussels%2C+Belgium%2E+Association+for+Computational+Linguistics%2E)
27. Eva Vanmassenhove and Johanna Monti. 2021. gENder-IT: An Annotated English-Italian Parallel Challenge Set for Cross-Linguistic Natural Gender Phenomena. In Proceedings of the 3rd Workshop on Gender Bias in Natural Language Processing, pages 1–7, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Eva+Vanmassenhove+and+Johanna+Monti%2E+2021%2E+gENder%2DIT%3A+An+Annotated+English%2DItalian+Parallel+Challenge+Set+for+Cross%2DLinguistic+Natural+Gender+Phenomena%2E+In+Proceedings+of+the+3rd+Workshop+on+Gender+Bi)
28. Eva Vanmassenhove, Dimitar Shterionov, and Andy Way. 2019. Lost in Translation: Loss and Decay of Linguistic Richness in Machine Translation. In Proceedings of Machine Translation Summit XVII: Research Track, pages 222–232, Dublin, Ireland. European Association for Machine Translation. [find](https://scholar.google.com/scholar?q=Eva+Vanmassenhove%2C+Dimitar+Shterionov%2C+and+Andy+Way%2E+2019%2E+Lost+in+Translation%3A+Loss+and+Decay+of+Linguistic+Richness+in+Machine+Translation%2E+In+Proceedings+of+Machine+Translation+Summit+XVII%3A+Researc) [our card](https://md.research.elamur.ai/free/en/papers/vanmassenhove-2019-lost-translation-loss-decay-linguistic/)
29. Tao Zhang, Ziqian Zeng, Yuxiang Xiao, Huiping Zhuang, Cen Chen, James Foulds, and Shimei Pan. 2024. GenderAlign: An Alignment Dataset for Mitigating Gender Bias in Large Language Models. ArXiv:2406.13925 [cs]. [find](https://scholar.google.com/scholar?q=Tao+Zhang%2C+Ziqian+Zeng%2C+Yuxiang+Xiao%2C+Huiping+Zhuang%2C+Cen+Chen%2C+James+Foulds%2C+and+Shimei+Pan%2E+2024%2E+GenderAlign%3A+An+Alignment+Dataset+for+Mitigating+Gender+Bias+in+Large+Language+Models%2E+ArXiv%3A2406%2E13)