---
title: "I2C At MultiPRIDE — paper by Vázquez-Ramos et al. (2026)"
description: "This paper describes the I2C team's systems for MultiPRIDE 2026 Task 1 at EVALITA 2026. 15 references."
authors: ["Laura Vázquez-Ramos", "Jacinto Mata-Vázquez", "Victoria Pachón-Álvarez"]
year: 2026
venue: "Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2026)"
source: "https://aclanthology.org/2026.evalita-1.26/"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/ramos-2026-i2c-multipride-transformers-generative-llms/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/ramos-2026-i2c-multipride-transformers-generative-llms/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/32/) / I2C At MultiPRIDE: Transformers And Generative LLMs For Multilingual Reclamation Classification

# I2C At MultiPRIDE: Transformers And Generative LLMs For Multilingual Reclamation Classification

**Authors:** [Laura Vázquez-Ramos](https://md.research.elamur.ai/free/en/authors/laura-vazquez-ramos/), Jacinto Mata-Vázquez and [Victoria Pachón-Álvarez](https://md.research.elamur.ai/free/en/authors/victoria-pachon-alvarez/) · **Year:** 2026 · **Venue:** [Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2026)](https://md.research.elamur.ai/free/en/venues/evalita/) ([Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop 2026](https://md.research.elamur.ai/free/en/venues/evalita/2026/)) · **Publisher:** [CEUR Workshop Proceedings](https://md.research.elamur.ai/free/en/publishers/ceur-workshop-proceedings/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.evalita-1.26/) · [PDF](https://aclanthology.org/2026.evalita-1.26.pdf)

## Summary
This paper describes the I2C team's systems for MultiPRIDE 2026 Task 1 at EVALITA 2026. The task asks whether an LGBTQ+-related term in a social media post is used with reclamatory (in-group, positive) intent or not. The authors worked in the text-only setting for Italian, Spanish and English. The organisers' datasets are small and skewed toward the non-reclamatory class, so the team balanced each training split with contextual word embedding augmentation (bert-base-uncased). They also built a merged multilingual pool.

Two paradigms were compared, one per allowed run:
- **Run 1:** a generative LLM tuned with QLoRA instructions.
- **Run 2:** a discriminative Transformer classifier based on XLM-RoBERTa-base.

The Transformer gave the best results in every language. The best macro-F1 scores were highest for Italian and lowest for English. An error analysis traced most failures to quotation, mention-versus-use confusion, irony and politically charged posts. This shows how hard intent-sensitive moderation remains without conversational context.

## Key points
- **Best official test macro-F1:** 0.843 (IT), 0.711 (ES), 0.571 (EN). XLM-RoBERTa-base outperformed the LLM run across all subtasks.
- **Data and class imbalance:**
  - IT: 1,086 instances, 19.06% reclamatory.
  - ES: 876 instances, 15.18% reclamatory.
  - EN: 1,026 instances, 8.58% reclamatory.
  - Merged pool: 2,988 instances, treated as an unconstrained setup.
- **Balancing:** CWE-based augmentation was applied only to training data. It reached 1,500 examples per class (3,000 total) after trimming the majority class. Untouched 20% held-out test splits were kept.
- **LLM run:** QLoRA fine-tuning of Qwen2.5-0.5B, with teknium/OpenHermes-2.5-Mistral-7B used for Spanish. The best hyperparameters included a learning rate of 1e-4 and a linear scheduler.
- **Proposed future work:**
  - Targeted augmentation for irony, activism and quoted mentions.
  - Explicit stance and mention-detection steps.
  - Use of thread or user context where allowed.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (2): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works

🧭 Topics (2): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works · [🌍 Multilingual & cross-lingual NLP](https://md.research.elamur.ai/free/en/topics/multilingual-nlp/) · 828 works

## Cite

Cite as: Laura Vázquez-Ramos, Jacinto Mata-Vázquez and Victoria Pachón-Álvarez. 2026. I2C At MultiPRIDE: Transformers And Generative LLMs For Multilingual Reclamation Classification. Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2026).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{vazquezramos2026i2c,
  title = {{I2C At MultiPRIDE: Transformers And Generative LLMs For Multilingual Reclamation Classification}},
  author = {Laura Vázquez-Ramos, Jacinto Mata-Vázquez and Victoria Pachón-Álvarez},
  booktitle = {Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2026)},
  year = {2026},
  url = {https://aclanthology.org/2026.evalita-1.26/}
}
```

- [← previous I Understand How You Feel: Enhancing Deeper Emotional Support Through Multilingual Emotional Validation in Dialogue System](https://md.research.elamur.ai/free/en/papers/pang-2026-i-understand-how-you-feel/)
- [next → ID10M-JAM: Stress-Testing Idiom Identification Under Challenging Context](https://md.research.elamur.ai/free/en/papers/hashiloni-2026-id10m-jam-stress-testing-idiom/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/32/)

## References

15 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. M.-C. Schreuder, Safe spaces, agency, and resistance: A metasynthesis of lgbtq language use, Journal of LGBT Youth 18 (2021) 256–272. [find](https://scholar.google.com/scholar?q=M%2E%2DC%2E+Schreuder%2C+Safe+spaces%2C+agency%2C+and+resistance%3A+A+metasynthesis+of+lgbtq+language+use%2C+Journal+of+LGBT+Youth+18+%282021%29+256%E2%80%93272%2E)
2. C. Ferrando, L. Draetta, M. Madeddu, M. Sosto, V. Patti, P. Rosso, C. Bosco, J. Mata, E. Gualda, Multipride at evalita 2026: Overview of the multilingual automatic detection of slur reclamation in the lgbtq+ context task, in: Proceedings of the Ninth Evaluation Campaign of Natural Language Processin… [find](https://scholar.google.com/scholar?q=C%2E+Ferrando%2C+L%2E+Draetta%2C+M%2E+Madeddu%2C+M%2E+Sosto%2C+V%2E+Patti%2C+P%2E+Rosso%2C+C%2E+Bosco%2C+J%2E+Mata%2C+E%2E+Gualda%2C+Multipride+at+evalita+2026%3A+Overview+of+the+multilingual+automatic+detection+of+slur+reclamation+in+the)
3. E. Sezerer, S. Tekir, A survey on neural word embeddings, 2021. URL: https://arxiv.org/abs/2110. 01804. doi: 10.48550/arXiv.2110.01804 . arXiv:2110.01804 . — [doi:10.48550/arxiv.2110.01804](https://doi.org/10.48550/arxiv.2110.01804) [↗](https://arxiv.org/abs/2110)
4. J. Devlin, M.-W. Chang, K. Lee, K. Toutanova, [Bert: Pre-training of deep bidirectional transformers for language understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/), in: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT 2019), Associa…
5. A. Zubiaga, Natural language processing in the era of large language models, 2024. [find](https://scholar.google.com/scholar?q=A%2E+Zubiaga%2C+Natural+language+processing+in+the+era+of+large+language+models%2C+2024%2E)
6. S. Islam, H. Elmekki, A. Elsebai, J. Bentahar, N. Drawel, G. Rjoub, W. Pedrycz, A comprehensive survey on applications of transformers for deep learning tasks, Expert Systems with Applications 241 (2024) 122666. [find](https://scholar.google.com/scholar?q=S%2E+Islam%2C+H%2E+Elmekki%2C+A%2E+Elsebai%2C+J%2E+Bentahar%2C+N%2E+Drawel%2C+G%2E+Rjoub%2C+W%2E+Pedrycz%2C+A+comprehensive+survey+on+applications+of+transformers+for+deep+learning+tasks%2C+Expert+Systems+with+Applications+241+%2820)
7. T. Dettmers, A. Pagnoni, A. Holtzman, L. Zettlemoyer, [Qlora: Efficient finetuning of quantized llms](https://md.research.elamur.ai/free/en/papers/dettmers-2023-qlora-efficient-finetuning-quantized-llms/), Advances in neural information processing systems 36 (2023) 10088–10115.
8. Q. Team, et al., Qwen2 technical report, arXiv preprint arXiv:2407.10671 2 (2024). [find](https://scholar.google.com/scholar?q=Q%2E+Team%2C+et+al%2E%2C+Qwen2+technical+report%2C+arXiv+preprint+arXiv%3A2407%2E10671+2+%282024%29%2E)
9. M. Vangeli, Large language models as advanced data preprocessors: Transforming unstructured text into fine-tuning datasets, 2024. [find](https://scholar.google.com/scholar?q=M%2E+Vangeli%2C+Large+language+models+as+advanced+data+preprocessors%3A+Transforming+unstructured+text+into+fine%2Dtuning+datasets%2C+2024%2E)
10. X. Ou, H. Li, Ynu@ dravidian-codemix-fire2020: Xlm-roberta for multi-language sentiment analysis., in: FIRE (Working Notes), 2020, pp. 560–565. [find](https://scholar.google.com/scholar?q=X%2E+Ou%2C+H%2E+Li%2C+Ynu%40+dravidian%2Dcodemix%2Dfire2020%3A+Xlm%2Droberta+for+multi%2Dlanguage+sentiment+analysis%2E%2C+in%3A+FIRE+%28Working+Notes%29%2C+2020%2C+pp%2E+560%E2%80%93565%2E)
11. Y. Liu, M. Ott, N. Goyal, J. Du, M. Joshi, D. Chen, O. Levy, M. Lewis, L. Zettlemoyer, V. Stoyanov, [Roberta: A robustly optimized bert pretraining approach](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/), arXiv preprint arXiv:1907.11692 (2019).
12. M. Grandini, E. Bagli, G. Visani, Metrics for multi-class classification: an overview, arXiv preprint arXiv:2008.05756 (2020). doi: 10.48550/arXiv.2008.05756 . — [doi:10.48550/arxiv.2008.05756](https://doi.org/10.48550/arxiv.2008.05756) [find](https://scholar.google.com/scholar?q=M%2E+Grandini%2C+E%2E+Bagli%2C+G%2E+Visani%2C+Metrics+for+multi%2Dclass+classification%3A+an+overview%2C+arXiv+preprint+arXiv%3A2008%2E05756+%282020%29%2E+doi%3A+10%2E48550%2FarXiv%2E2008%2E05756+%2E+%E2%80%94+%5Bdoi%3A10%2E48550%2Farxiv%2E2008%2E05756%5D%28https%3A)
13. J. V. Carter, J. Pan, S. N. Rai, S. Galandiuk, Roc-ing along: Evaluation and interpretation of receiver operating characteristic curves, Surgery 159 (2016) 1638–1645. doi: 10.1016/j.surg.2015.12. 029 . — [doi:10.1016/j.surg.2015.12](https://doi.org/10.1016/j.surg.2015.12) [find](https://scholar.google.com/scholar?q=J%2E+V%2E+Carter%2C+J%2E+Pan%2C+S%2E+N%2E+Rai%2C+S%2E+Galandiuk%2C+Roc%2Ding+along%3A+Evaluation+and+interpretation+of+receiver+operating+characteristic+curves%2C+Surgery+159+%282016%29+1638%E2%80%931645%2E+doi%3A+10%2E1016%2Fj%2Esurg%2E2015%2E12%2E+029+)
14. D. Chicco, G. Jurman, The advantages of the matthews correlation coefficient (mcc) over f1 score and accuracy in binary classification evaluation, BMC genomics 21 (2020) 6. doi: 10.1186/ s12864-019-6413-7 . [find](https://scholar.google.com/scholar?q=D%2E+Chicco%2C+G%2E+Jurman%2C+The+advantages+of+the+matthews+correlation+coefficient+%28mcc%29+over+f1+score+and+accuracy+in+binary+classification+evaluation%2C+BMC+genomics+21+%282020%29+6%2E+doi%3A+10%2E1186%2F+s12864%2D019%2D64)
15. A. P. Bradley, The use of the area under the roc curve in the evaluation of machine learning algorithms, Pattern recognition 30 (1997) 1145–1159. doi: 10.1016/S0031-3203(96)00142-2 . — [doi:10.1016/s0031-3203(96)00142-2](https://doi.org/10.1016/s0031-3203%2896%2900142-2) [find](https://scholar.google.com/scholar?q=A%2E+P%2E+Bradley%2C+The+use+of+the+area+under+the+roc+curve+in+the+evaluation+of+machine+learning+algorithms%2C+Pattern+recognition+30+%281997%29+1145%E2%80%931159%2E+doi%3A+10%2E1016%2FS0031%2D3203%2896%2900142%2D2+%2E+%E2%80%94+%5Bdoi%3A10%2E1016%2Fs0)

*Updated 1 November 2026*