---
title: "Aatman at SemEval-2026 Task 9 — paper by Vaidya (2026)"
description: "This system paper addresses Subtask 1 of SemEval-2026 Task 9 (POLAR), which asks whether an… 18 references, cited by 1 paper here."
authors: ["Aatman Vaidya"]
year: 2026
venue: "Proceedings of the 20th International Workshop on Semantic Evaluation (2026)"
source: "https://aclanthology.org/2026.semeval-1.370/"
doi: "10.18653/v1/2026.semeval-1.370"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/vaidya-2026-aatman-semeval-2026-task-9/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/vaidya-2026-aatman-semeval-2026-task-9/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/9/) / Aatman at SemEval-2026 Task 9: Transfer Learning for Multilingual Polarization Detection

# Aatman at SemEval-2026 Task 9: Transfer Learning for Multilingual Polarization Detection

**Authors:** Aatman Vaidya · **Year:** 2026 · **Venue:** [Proceedings of the 20th International Workshop on Semantic Evaluation (2026)](https://md.research.elamur.ai/free/en/venues/semeval/) ([SemEval 2026](https://md.research.elamur.ai/free/en/venues/semeval/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.semeval-1.370/) · [PDF](https://aclanthology.org/2026.semeval-1.370.pdf) · [DOI 10.18653/v1/2026.semeval-1.370](https://doi.org/10.18653/v1/2026.semeval-1.370) · [OpenAlex](https://openalex.org/W7166799024)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · [1](https://md.research.elamur.ai/free/en/papers/vaidya-2026-aatman-semeval-2026-task-9/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
This system paper addresses Subtask 1 of SemEval-2026 Task 9 (POLAR), which asks whether an online post contains polarized content. It is a binary classification problem covering 22 languages. The POLAR data aggregates posts from news sites, Reddit, Bluesky, blogs and regional forums on topics such as elections, conflicts, migration and gender rights, with about 3,000–5,000 labeled items per language.

The author compares three strategies:
- fine-tuning seven multilingual encoder models;
- zero- and few-shot prompting of open-weight LLMs, including the safety classifier LlamaGuard;
- sequential transfer learning, in which mDeBERTa is first trained on pooled English and Hindi harmful-language datasets and then on the POLAR training split.

Fine-tuned encoders clearly outperform prompted LLMs, and mDeBERTa is the strongest baseline. The extra transfer stage raises it to the best Macro-F1 of 0.781. The findings suggest that compact supervised encoders, enriched with related hate and abuse data, remain a cheap and strong choice for multilingual moderation. General-purpose and safety-tuned LLMs transfer poorly to implicit, context-dependent polarization.

## Key points
- **Data split:** Subtask 1 has 73,681 training, 3,687 development and 33,288 test instances. The 22 languages include Russian, Polish and German but not Ukrainian.
- **Encoder baselines (Macro-F1):** mDeBERTa 0.759, mmBERT 0.708, XLM-RoBERTa 0.693, Glot500 0.670, GTE-multilingual-MLM 0.664, mBERT 0.660, HateBERT 0.639.
- **LLM prompting:** The best zero-shot score was 0.600. The results table attributes it to Qwen-2.5-14B, while the text mentions 8B models only. Few-shot prompting used 15 polarized and 15 non-polarized examples and scored 0.694 for Qwen2.5-8B, 0.579 for Llama-3.1-8B and 0.557 for LlamaGuard-3-8B.
- **Transfer learning:** The auxiliary corpora were HateCheckHIn, HateXplain, Implicit Hate, MACD, OLID, ToxiGen and Uli. They are limited to English and Hindi, the languages the author speaks. Sequential fine-tuning of mDeBERTa reached 0.781 Macro-F1, a gain of +0.022 over the baseline.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Tübingen](https://md.research.elamur.ai/free/en/universities/university-of-tubingen/) — University, Tübingen, Germany · 78 works · 41,280 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works

🧭 Topics (1): [🌍 Multilingual & cross-lingual NLP](https://md.research.elamur.ai/free/en/topics/multilingual-nlp/) · 882 works

## Cite

Cite as: Aatman Vaidya. 2026. Aatman at SemEval-2026 Task 9: Transfer Learning for Multilingual Polarization Detection. Proceedings of the 20th International Workshop on Semantic Evaluation (2026).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{vaidya2026aatman,
  title = {{Aatman at SemEval-2026 Task 9: Transfer Learning for Multilingual Polarization Detection}},
  author = {Aatman Vaidya},
  booktitle = {Proceedings of the 20th International Workshop on Semantic Evaluation (2026)},
  year = {2026},
  doi = {10.18653/v1/2026.semeval-1.370},
  url = {https://doi.org/10.18653/v1/2026.semeval-1.370}
}
```

- [← previous A Survey on LLM-based Conversational User Simulation](https://md.research.elamur.ai/free/en/papers/ni-2026-survey-llm-based-conversational-user/)
- [next → AC/DG at Cruciverb-IT: Retrieval-Based Approaches for Italian Crossword Clue Answering](https://md.research.elamur.ai/free/en/papers/yassine-2026-ac-dg-cruciverb-it-retrieval/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/9/)

## References

18 references, 6 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Pengcheng He, Jianfeng Gao, and Weizhu Chen. 2021. [Debertav3: Improving deberta using electra-style pre-training with gradient-disentangled embedding sharing](https://md.research.elamur.ai/free/en/papers/he-2021-debertav3-improving-deberta-using-electra/). arXiv preprint arXiv:2111.09543.
2. Ayyoob Imani, Peiqin Lin, Amir Hossein Kargaran, Silvia Severini, Masoud Jalili Sabet, Nora Kassner, Chunlan Ma, Helmut Schmid, André FT Martins, François Yvon, and 1 others. 2023. Glot500: Scaling multilingual corpora and language models to 500 languages. arXiv preprint arXiv:2305.12182. [find](https://scholar.google.com/scholar?q=Ayyoob+Imani%2C+Peiqin+Lin%2C+Amir+Hossein+Kargaran%2C+Silvia+Severini%2C+Masoud+Jalili+Sabet%2C+Nora+Kassner%2C+Chunlan+Ma%2C+Helmut+Schmid%2C+Andr%C3%A9+FT+Martins%2C+Fran%C3%A7ois+Yvon%2C+and+1+others%2E+2023%2E+Glot500%3A+Scaling+mu)
3. Deepak Kumar, Yousef Anees AbuHashem, and Zakir Durumeric. 2024. Watch your language: Investigating content moderation with large language models. In Proceedings of the International AAAI Conference on Web and Social Media, volume 18, pages 865– 878. [find](https://scholar.google.com/scholar?q=Deepak+Kumar%2C+Yousef+Anees+AbuHashem%2C+and+Zakir+Durumeric%2E+2024%2E+Watch+your+language%3A+Investigating+content+moderation+with+large+language+models%2E+In+Proceedings+of+the+International+AAAI+Conference+o)
4. Marc Marone, Orion Weller, William Fleshman, Eugene Yang, Dawn Lawrie, and Benjamin Van Durme. 2025. [mmbert: A modern multilingual encoder with annealed language learning](https://md.research.elamur.ai/free/en/papers/marone-2025-mmbert-modern-multilingual-encoder-annealed/). arXiv preprint arXiv:2509.06888.
5. Binny Mathew, Punyajoy Saha, Seid Muhie Yimam, Chris Biemann, Pawan Goyal, and Animesh Mukherjee. 2021. Hatexplain: A benchmark dataset for explainable hate speech detection. In Proceedings of the AAAI conference on artificial intelligence, volume 35, pages 14867–14875. [find](https://scholar.google.com/scholar?q=Binny+Mathew%2C+Punyajoy+Saha%2C+Seid+Muhie+Yimam%2C+Chris+Biemann%2C+Pawan+Goyal%2C+and+Animesh+Mukherjee%2E+2021%2E+Hatexplain%3A+A+benchmark+dataset+for+explainable+hate+speech+detection%2E+In+Proceedings+of+the+AAA)
6. Matteo Melis, Gabriella Lapesa, and Dennis Assenmacher. 2025. A modular taxonomy for hate speech definitions and its impact on zero-shot llm classification performance. arXiv preprint arXiv:2506.18576. [find](https://scholar.google.com/scholar?q=Matteo+Melis%2C+Gabriella+Lapesa%2C+and+Dennis+Assenmacher%2E+2025%2E+A+modular+taxonomy+for+hate+speech+definitions+and+its+impact+on+zero%2Dshot+llm+classification+performance%2E+arXiv+preprint+arXiv%3A2506%2E18576)
7. Marzieh Mozafari, Reza Farahbakhsh, and Noel Crespi. 2019. A bert-based transfer learning approach for hate speech detection in online social media. In International conference on complex networks and their applications, pages 928–940. Springer. [find](https://scholar.google.com/scholar?q=Marzieh+Mozafari%2C+Reza+Farahbakhsh%2C+and+Noel+Crespi%2E+2019%2E+A+bert%2Dbased+transfer+learning+approach+for+hate+speech+detection+in+online+social+media%2E+In+International+conference+on+complex+networks+and)
8. Usman Naseem, Robert Geislinger, Juan Ren, Sarah Kohail, Rudy Garrido Veliz, P Sam Sahil, Yiran Zhang, Marco Antonio Stranisci, Idris Abdulmumin, "Ozge Alacam, Cengiz Acar"urk, Aisha Jabr, Saba Anwar, Abinew Ali Ayele, Elena Tutubalina, Aung Kyaw Htet, Xintong Wang, Surendrabikram Thapa, Tanmoy Chak… — [SemEval-2026 Task 9: Detecting Multilingual, Multicultural and Multievent Online Polarization](https://md.research.elamur.ai/free/en/papers/naseem-2026-semeval-2026-task-9-detecting/)
9. Gabriel Nicholas and Aliya Bhatia. 2023. [Lost in translation: Large language models in non-english content analysis](https://md.research.elamur.ai/free/en/papers/nicholas-2023-lost-translation-large-language-models/). arXiv preprint arXiv:2306.07377.
10. Flor Miriam Plaza-del Arco, Debora Nozza, and Dirk Hovy. 2023. Respectful or toxic? using zero-shot learning with language models to detect hate speech. In The 7th workshop on online abuse and harms (woah), pages 60–68. [find](https://scholar.google.com/scholar?q=Flor+Miriam+Plaza%2Ddel+Arco%2C+Debora+Nozza%2C+and+Dirk+Hovy%2E+2023%2E+Respectful+or+toxic%3F+using+zero%2Dshot+learning+with+language+models+to+detect+hate+speech%2E+In+The+7th+workshop+on+online+abuse+and+harms+%28)
11. Mohamed Ibrahim Ragab, Ensaf Hussein Mohamed, and Walaa Medhat. 2025. Multilingual propaganda detection: Exploring transformer-based models mbert, xlm-roberta, and mt5. In Proceedings of the first International Workshop on Nakba Narratives as Language Resources, pages 75–82. [find](https://scholar.google.com/scholar?q=Mohamed+Ibrahim+Ragab%2C+Ensaf+Hussein+Mohamed%2C+and+Walaa+Medhat%2E+2025%2E+Multilingual+propaganda+detection%3A+Exploring+transformer%2Dbased+models+mbert%2C+xlm%2Droberta%2C+and+mt5%2E+In+Proceedings+of+the+first+Int)
12. Rishabh Ranjan, Likhith Ayinala, Mayank Vatsa, and Richa Singh. 2025. Multimodal zero-shot framework for deepfake hate speech detection in low-resource languages. arXiv preprint arXiv:2506.08372. — [arXiv:2506.08372](https://arxiv.org/abs/2506.08372) [find](https://scholar.google.com/scholar?q=Rishabh+Ranjan%2C+Likhith+Ayinala%2C+Mayank+Vatsa%2C+and+Richa+Singh%2E+2025%2E+Multimodal+zero%2Dshot+framework+for+deepfake+hate+speech+detection+in+low%2Dresource+languages%2E+arXiv+preprint+arXiv%3A2506%2E08372%2E+%E2%80%94+%5Ba)
13. Punyajoy Saha, Divyanshu Sheth, Kushal Kedia, Binny Mathew, and Animesh Mukherjee. 2022. Rationale-guided few-shot classification to detect abusive language. arXiv preprint arXiv:2211.17046. — [arXiv:2211.17046](https://arxiv.org/abs/2211.17046) [find](https://scholar.google.com/scholar?q=Punyajoy+Saha%2C+Divyanshu+Sheth%2C+Kushal+Kedia%2C+Binny+Mathew%2C+and+Animesh+Mukherjee%2E+2022%2E+Rationale%2Dguided+few%2Dshot+classification+to+detect+abusive+language%2E+arXiv+preprint+arXiv%3A2211%2E17046%2E+%E2%80%94+%5BarXiv%3A)
14. Orion Weller, Kathryn Ricci, Marc Marone, Antoine Chaffin, Dawn Lawrie, and Benjamin Van Durme. 2025. Seq vs seq: An open suite of paired encoders and decoders. arXiv preprint arXiv:2507.11412. — [arXiv:2507.11412](https://arxiv.org/abs/2507.11412) [find](https://scholar.google.com/scholar?q=Orion+Weller%2C+Kathryn+Ricci%2C+Marc+Marone%2C+Antoine+Chaffin%2C+Dawn+Lawrie%2C+and+Benjamin+Van+Durme%2E+2025%2E+Seq+vs+seq%3A+An+open+suite+of+paired+encoders+and+decoders%2E+arXiv+preprint+arXiv%3A2507%2E11412%2E+%E2%80%94+%5BarX)
15. Zecharias Zelalem and Peter Guest. 2021. Why facebook keeps failing in ethiopia. Rest of World. [find](https://scholar.google.com/scholar?q=Zecharias+Zelalem+and+Peter+Guest%2E+2021%2E+Why+facebook+keeps+failing+in+ethiopia%2E+Rest+of+World%2E)
16. Xin Zhang, Yanzhao Zhang, Dingkun Long, Wen Xie, Ziqi Dai, Jialong Tang, Huan Lin, Baosong Yang, Pengjun Xie, Fei Huang, and 1 others. 2024. [mgte: Generalized long-context text representation and reranking models for multilingual text retrieval](https://md.research.elamur.ai/free/en/papers/zhang-2024-mgte-generalized-long-context-text/). arXiv preprint arXiv:2407.19669.
17. A Usman Naseem, Robert Geislinger, Juan Ren, Sarah Kohail, Rudy Garrido Veliz, P Sam Sahil, Yiran Zhang, Marco Antonio Stranisci, Idris Abdulmumin, Özge Alacam, Cengiz Acartürk, Aisha Jabr, Saba Anwar, Abinew Ali Ayele, Simona Frenda, Alessandra Teresa Cignarella, Elena Tutubalina, Oleg Rogov, Aung… — [POLAR: A Benchmark for Multilingual, Multicultural, and Multi-Event Online Polarization](https://md.research.elamur.ai/free/en/papers/naseem-2026-polar-benchmark-multilingual-multicultural-multi/)
18. Language Specific Performance Zero Shot Encoder-only Language Few shot Safety xlm-roberta-base mbert-base mdeberta-base mgte-multi lingual-mlm-base glot-500 -base mmbert -base hatebert qwen2.5 -14B llama3.1 -8B qwen2.5 -8B llama guard3 -8B Amharic 0.5356 0.4196 0.6927 0.4448 0.482 0.6082 0.4613 0.48… [find](https://scholar.google.com/scholar?q=Language+Specific+Performance+Zero+Shot+Encoder%2Donly+Language+Few+shot+Safety+xlm%2Droberta%2Dbase+mbert%2Dbase+mdeberta%2Dbase+mgte%2Dmulti+lingual%2Dmlm%2Dbase+glot%2D500+%2Dbase+mmbert+%2Dbase+hatebert+qwen2%2E5+%2D14B+ll)

*Updated 31 October 2026*