---
title: "syuhhh@EEUCA 2026 — paper by Shi et al. (2026)"
description: "The paper describes the winning entry in the GameTox shared task at the 9th EEUCA workshop. 18 references."
authors: ["Yuhao Shi", "Yu Wang", "Shengjie Zhao"]
year: 2026
venue: "Proceedings of the 9th Workshop on Event Extraction and Understanding: Challenges and Applications (EEUCA 2026)"
source: "https://aclanthology.org/2026.eeuca-1.17/"
doi: "10.18653/v1/2026.eeuca-1.17"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/shi-2026-syuhhh-eeuca-2026-three-stage/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/shi-2026-syuhhh-eeuca-2026-three-stage/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/44/) / syuhhh@EEUCA 2026: A Three-Stage Progressive Training Framework for Fine-Grained Toxicity Detection in Online Gaming Communities

# syuhhh@EEUCA 2026: A Three-Stage Progressive Training Framework for Fine-Grained Toxicity Detection in Online Gaming Communities

**Authors:** Yuhao Shi, [Yu Wang](https://md.research.elamur.ai/free/en/authors/yu-wang/) and Shengjie Zhao · **Year:** 2026 · **Venue:** [Proceedings of the 9th Workshop on Event Extraction and Understanding: Challenges and Applications (EEUCA 2026)](https://md.research.elamur.ai/free/en/venues/eeuca/) ([Workshop on Event Extraction and Understanding: Challenges and Applications 2026](https://md.research.elamur.ai/free/en/venues/eeuca/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.eeuca-1.17/) · [PDF](https://aclanthology.org/2026.eeuca-1.17.pdf) · [DOI 10.18653/v1/2026.eeuca-1.17](https://doi.org/10.18653/v1/2026.eeuca-1.17) · [OpenAlex](https://openalex.org/W7166814619)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
The paper describes the winning entry in the GameTox shared task at the 9th EEUCA workshop. The task asks systems to assign one of six toxic-intent labels to in-game chat messages from World of Tanks. These messages are very short and full of slang, and the toxic classes are heavily outnumbered by non-toxic ones.

The authors build on XLM-RoBERTa-large and train it in three steps:
1. masked-language-model adaptation on gaming chat corpora;
2. transfer fine-tuning on multilingual Jigsaw toxicity data;
3. task fine-tuning with a dual head that pairs class-weighted cross-entropy with supervised contrastive learning (SCL).

Around this core they add several extras. An LLM rewrites short messages with game context and generates synthetic examples for rare classes. Per-class decision thresholds are tuned with Nelder-Mead. For rare classes only, predictions are combined with ToxicBERT and LLM outputs.

The system reaches Macro F1 0.7041 and places first of 35 teams. This shows that domain adaptation and targeted handling of class imbalance matter more than the choice of backbone for moderating game chat.

## Key points
- **Data:** The GameTox dataset has 53,000 annotated World of Tanks utterances averaging about 12 tokens. Over 70% are Non-toxic, and the three rarest classes (Hate and Harassment, Threats, Extremism) together make up under 5%.
- **Results:** The final Macro F1 of 0.7041 beats the best competing team (0.6725) by 3.16 pp and the vanilla XLM-RoBERTa-large baseline (0.6149) by 8.92 pp.
- **Ablation:**
  - Domain MLM pre-training plus Jigsaw transfer gave the largest gain (+10.37 pp, as reported by the authors).
  - LLM short-text augmentation added +4.71 pp.
  - Long-tail synthesis added +1.90 pp.
  - SCL and the ensemble together added +2.31 pp.
- **Transfer data:** The Stage 2 set draws on Jigsaw data in 5 languages (English, Russian, Turkish, Spanish, French) and keeps 238,465 samples after downsampling.
- **Remaining errors and code:** Most errors come from confusing Insults with Hate and Harassment, and Non-toxic with Extremism. Code is released at github.com/oosyh/syuhhh-EEUCA2026.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Tongji University](https://md.research.elamur.ai/free/en/universities/tongji-university/) — University, Shanghai, China · 19 works · 2,162 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

🧭 Topics (1): [🛡️ Bias, fairness & safety](https://md.research.elamur.ai/free/en/topics/bias-fairness-safety/) · 517 works

## Cite

Cite as: Yuhao Shi, Yu Wang and Shengjie Zhao. 2026. syuhhh@EEUCA 2026: A Three-Stage Progressive Training Framework for Fine-Grained Toxicity Detection in Online Gaming Communities. Proceedings of the 9th Workshop on Event Extraction and Understanding: Challenges and Applications (EEUCA 2026).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{shi2026syuhhh,
  title = {{syuhhh@EEUCA 2026: A Three-Stage Progressive Training Framework for Fine-Grained Toxicity Detection in Online Gaming Communities}},
  author = {Yuhao Shi, Yu Wang and Shengjie Zhao},
  booktitle = {Proceedings of the 9th Workshop on Event Extraction and Understanding: Challenges and Applications (EEUCA 2026)},
  year = {2026},
  doi = {10.18653/v1/2026.eeuca-1.17},
  url = {https://doi.org/10.18653/v1/2026.eeuca-1.17}
}
```

- [← previous Systematicity between Forms and Meanings across Languages Supports Efficient Communication](https://md.research.elamur.ai/free/en/papers/osmelak-2026-systematicity-between-forms-meanings-across/)
- [next → T'OMIM: A Morphologically Annotated Dataset of Parallel Passages in the Hebrew Bible](https://md.research.elamur.ai/free/en/papers/smiley-2026-tomim-morphologically-annotated-dataset-parallel/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/44/)

## References

18 references, 5 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Aashish Bhandari, Siddhant B Shah, Surendrabikram Thapa, Usman Naseem, and Mehwish Nasim. 2023. CrisisHateMM: Multimodal analysis of directed and undirected hate speech in text-embedded images from Russia-Ukraine conflict. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Reco… [find](https://scholar.google.com/scholar?q=Aashish+Bhandari%2C+Siddhant+B+Shah%2C+Surendrabikram+Thapa%2C+Usman+Naseem%2C+and+Mehwish+Nasim%2E+2023%2E+CrisisHateMM%3A+Multimodal+analysis+of+directed+and+undirected+hate+speech+in+text%2Dembedded+images+from+Ru)
2. Tommaso Caselli, Valerio Basile, Jelena Mitrović, and Michael Granitzer. 2020. [HateBERT: Retraining BERT for abusive language detection in English](https://md.research.elamur.ai/free/en/papers/caselli-2021-hatebert-retraining-bert-abusive-language/). In Proceedings of the 5th Workshop on Online Abuse and Harms, pages 21–32.
3. Thomas Davidson, Dana Warmsley, Michael Macy, and Ingmar Weber. 2017. [Automated hate speech detection and the problem of offensive language](https://md.research.elamur.ai/free/en/papers/davidson-2017-automated-hate-speech-detection-problem/). In Proceedings of the 11th International AAAI Conference on Web and Social Media.
4. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. [BERT: Pre-training of deep bidirectional transformers for language understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/). In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,…
5. Ali Hürriyetoğlu, Surendrabikram Thapa, Hristo Tanev, Laxmi Thapa, and Surabhi Adhikari. 2026. Overview of the workshop on event extraction and understanding: Challenges and applications. In Proceedings of the 9th Workshop on Event Extraction and Understanding: Challenges and Applications (EEUCA). [find](https://scholar.google.com/scholar?q=Ali+H%C3%BCrriyetog%CC%86lu%2C+Surendrabikram+Thapa%2C+Hristo+Tanev%2C+Laxmi+Thapa%2C+and+Surabhi+Adhikari%2E+2026%2E+Overview+of+the+workshop+on+event+extraction+and+understanding%3A+Challenges+and+applications%2E+In+Proceedi)
6. Jigsaw/Conversation AI. 2018. Jigsaw toxic comment classification challenge. Kaggle Competition. [find](https://scholar.google.com/scholar?q=Jigsaw%2FConversation+AI%2E+2018%2E+Jigsaw+toxic+comment+classification+challenge%2E+Kaggle+Competition%2E)
7. Jigsaw/Conversation AI. 2020. Jigsaw multilingual toxic comment classification. Kaggle Competition. [find](https://scholar.google.com/scholar?q=Jigsaw%2FConversation+AI%2E+2020%2E+Jigsaw+multilingual+toxic+comment+classification%2E+Kaggle+Competition%2E)
8. Hongli Liu, Yu Wang, and Shengjie Zhao. 2026. STAR: Semantic-temporal adaptive representation learning for few-shot action recognition. IEEE Transactions on Circuits and Systems for Video Technology. [find](https://scholar.google.com/scholar?q=Hongli+Liu%2C+Yu+Wang%2C+and+Shengjie+Zhao%2E+2026%2E+STAR%3A+Semantic%2Dtemporal+adaptive+representation+learning+for+few%2Dshot+action+recognition%2E+IEEE+Transactions+on+Circuits+and+Systems+for+Video+Technology%2E)
9. Yu Wang, Shengjie Zhao, and Shiwei Chen. 2024. Action-semantic consistent knowledge for weakly-supervised action localization. IEEE Transactions on Multimedia, 26:10279–10289. [find](https://scholar.google.com/scholar?q=Yu+Wang%2C+Shengjie+Zhao%2C+and+Shiwei+Chen%2E+2024%2E+Action%2Dsemantic+consistent+knowledge+for+weakly%2Dsupervised+action+localization%2E+IEEE+Transactions+on+Multimedia%2C+26%3A10279%E2%80%9310289%2E)
10. Usman Naseem, Shuvam Shiwakoti, Siddhant Bikram Shah, Surendrabikram Thapa, and Qi Zhang. 2025. GameTox: A comprehensive dataset and analysis for enhanced toxicity detection in online gaming communities. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association… [find](https://scholar.google.com/scholar?q=Usman+Naseem%2C+Shuvam+Shiwakoti%2C+Siddhant+Bikram+Shah%2C+Surendrabikram+Thapa%2C+and+Qi+Zhang%2E+2025%2E+GameTox%3A+A+comprehensive+dataset+and+analysis+for+enhanced+toxicity+detection+in+online+gaming+communiti)
11. Yu Wang, Shengjie Zhao, and Shiwei Chen. 2025. SQL-Net: Semantic query learning for point-supervised temporal action localization. IEEE Transactions on Multimedia, 27:84–94. [find](https://scholar.google.com/scholar?q=Yu+Wang%2C+Shengjie+Zhao%2C+and+Shiwei+Chen%2E+2025%2E+SQL%2DNet%3A+Semantic+query+learning+for+point%2Dsupervised+temporal+action+localization%2E+IEEE+Transactions+on+Multimedia%2C+27%3A84%E2%80%9394%2E)
12. Anil Singh Parihar, Surendrabikram Thapa, and Sushruti Mishra. 2021. Hate speech detection using natural language processing: Applications and challenges. In 2021 5th International Conference on Trends in Electronics and Informatics (ICOEI), pages 1302– 1308. IEEE. [find](https://scholar.google.com/scholar?q=Anil+Singh+Parihar%2C+Surendrabikram+Thapa%2C+and+Sushruti+Mishra%2E+2021%2E+Hate+speech+detection+using+natural+language+processing%3A+Applications+and+challenges%2E+In+2021+5th+International+Conference+on+Trend)
13. Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, and 1 others. 2019. [PyTorch: An imperative style, high-performance deep learning library](https://md.research.elamur.ai/free/en/papers/paszke-2019-pytorch-imperative-style-high-performance/). In Advances in Neural Information Processing Systems, volume 32.
14. Shailesh Raman, Birju Patel, Sriram Srinivasan, Pnina Shachaf, and David Jurgens. 2021. Chat as currency: Linguistic features of toxicity in online gaming. In Proceedings of the 2021 ACM SIGCHI Conference on Human Factors in Computing Systems, pages 1– 14. [find](https://scholar.google.com/scholar?q=Shailesh+Raman%2C+Birju+Patel%2C+Sriram+Srinivasan%2C+Pnina+Shachaf%2C+and+David+Jurgens%2E+2021%2E+Chat+as+currency%3A+Linguistic+features+of+toxicity+in+online+gaming%2E+In+Proceedings+of+the+2021+ACM+SIGCHI+Confer)
15. Surendrabikram Thapa, Shuvam Shiwakoti, Siddhant Bikram Shah, Surabhi Adhikari, Hariram Veeramani, Mehwish Nasim, and Usman Naseem. 2025. Large language models (LLM) in computational social science: Prospects, current state, and challenges. Social Network Analysis and Mining, 15(1):1–30. [find](https://scholar.google.com/scholar?q=Surendrabikram+Thapa%2C+Shuvam+Shiwakoti%2C+Siddhant+Bikram+Shah%2C+Surabhi+Adhikari%2C+Hariram+Veeramani%2C+Mehwish+Nasim%2C+and+Usman+Naseem%2E+2025%2E+Large+language+models+%28LLM%29+in+computational+social+science%3A+P)
16. Yu Wang, Shengjie Zhao, Jianyu Wang, and Xutao Chu. 2026. Learning local semantic signals and inter-class discrepancy for weakly supervised video anomaly detection. IEEE Transactions on Multimedia. [find](https://scholar.google.com/scholar?q=Yu+Wang%2C+Shengjie+Zhao%2C+Jianyu+Wang%2C+and+Xutao+Chu%2E+2026%2E+Learning+local+semantic+signals+and+inter%2Dclass+discrepancy+for+weakly+supervised+video+anomaly+detection%2E+IEEE+Transactions+on+Multimedia%2E)
17. Yu Wang, Shengjie Zhao, Rongqing Zhang, Xiang Cheng, and Liuqing Yang. 2022. Multi-vehicle collaborative learning for trajectory prediction with spatio-temporal tensor fusion. IEEE Transactions on Intelligent Transportation Systems, 23(1):236–248. [find](https://scholar.google.com/scholar?q=Yu+Wang%2C+Shengjie+Zhao%2C+Rongqing+Zhang%2C+Xiang+Cheng%2C+and+Liuqing+Yang%2E+2022%2E+Multi%2Dvehicle+collaborative+learning+for+trajectory+prediction+with+spatio%2Dtemporal+tensor+fusion%2E+IEEE+Transactions+on+Int)
18. Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clément Delangue, Anthony Moi, Pier-ric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, and 1 others. 2020. [Transformers: State-of-the-art natural language processing](https://md.research.elamur.ai/free/en/papers/wolf-2020-transformers-state-art-natural-language/). In Proceedings of the 2020 Conference on Empirical Methods in Natural Lan…

*Updated 1 November 2026*