---
title: "StanceCrafters at StanceEval2024 — Hasanaath 2024"
description: "The paper describes a system for the StanceEval2024 shared task."
authors: ["Ahmed Hasanaath", "Aisha Alansari"]
year: 2024
venue: "Proceedings of the Second Arabic Natural Language Processing Conference"
source: "https://aclanthology.org/2024.arabicnlp-1.94/"
doi: "10.18653/v1/2024.arabicnlp-1.94"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/hasanaath-2024-stancecrafters-stanceeval2024-multi-task-stance/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/hasanaath-2024-stancecrafters-stanceeval2024-multi-task-stance/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/5/) / StanceCrafters at StanceEval2024: Multi-task Stance Detection using BERT Ensemble with Attention Based Aggregation

# StanceCrafters at StanceEval2024: Multi-task Stance Detection using BERT Ensemble with Attention Based Aggregation

**Authors:** Ahmed Hasanaath, [Aisha Alansari](https://md.research.elamur.ai/free/en/authors/aisha-alansari/) · **Year:** 2024 · **Venue:** Proceedings of the Second Arabic Natural Language Processing Conference · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2024.arabicnlp-1.94/) · [PDF](https://aclanthology.org/2024.arabicnlp-1.94.pdf) · [DOI 10.18653/v1/2024.arabicnlp-1.94](https://doi.org/10.18653/v1/2024.arabicnlp-1.94) · [OpenAlex](https://openalex.org/W4402671336)

**Citations:** 3 citations (openalex-snapshot · 2026-10-14) · [2](#cited-by) in our library, of the 140884 papers whose bibliographies we read

## Summary
The paper describes a system for the StanceEval2024 shared task. The task is to label the attitude of Arabic tweets toward three targets: COVID-19 vaccination, digital transformation and women's empowerment. Labeled Arabic stance data is scarce. The authors therefore train stance jointly with two related labels from the MAWQIF corpus, sentiment and sarcasm, using hard parameter sharing. The shared encoder is not one model but a pair of fine-tuned BERT variants, AraBERT-twitter (trained on tweets) and CAMeLBERT (trained on MSA, dialectal and classical Arabic). Their outputs are merged by either a simple mean or a learned attention module. Each task then gets its own output head. They also compare equal, static and learnable ("relative") loss weighting. The best configuration uses attention fusion with static weights. It reaches 91.37 validation F1 and 81.68 macro F1 on the blind test set. The work shows that combining encoders trained on different kinds of text beats any single encoder, even when one member is individually weak.

## Key points
- Data: MAWQIF, 4,121 Arabic tweets annotated for stance, sentiment and sarcasm, split 85% train and 15% test. Only Favour/Against stance labels were used in training. Preprocessing used ArabertPreprocessor plus removal of hashtags, URLs, mentions, punctuation and repeated characters.
- Single encoders on validation: AraBERT-twitter scored best (89.89 F1) and CAMeLBERT scored worst (84.92). Averaging exactly these two gave 90.23, the top two-model pair.
- With attention fusion on that pair, the loss-weighting schemes scored as follows: equal 90.85, static 91.37 and relative 90.71. The static weights were 0.6 for stance, 0.3 for sentiment and 0.1 for sarcasm.
- Blind test macro F1: Women Empowerment 85.06, Digital Transformation 80.14, COVID Vaccine 79.84, overall 81.68.
- Training setup: 20 epochs, learning rate 2e-5, weight decay 1e-5, dropout 0.1, batch size 4, max length 128. Code is open on GitHub (StanceDetection-MultiTaskLearning).

## Interesting ideas
- The strongest ensemble paired the best single model with the weakest one, so diversity of training domain mattered more than individual strength. — For Mova (learn): when choosing witness parsers for silver data, favour witnesses trained on different genres or treebanks over several near-identical strong ones.
- Instead of fixed averaging, a small attention module decides per input how much each encoder contributes, which slightly beat the mean. — For Mova (tree): a per-sentence learned weighting between the perceptron parser and gparse could replace fixed voting, and logging the weights would keep each choice explainable.
- Auxiliary tasks were trained alongside the main one with fixed, main-task-heavy loss weights, and these outperformed learnable weights; the authors attribute this to noisy, low-confidence labels. — For Mova (tree): gparse could add tagging or morphology heads as auxiliaries with hand-set small weights, avoiding unstable dynamic weighting when silver labels are noisy.
- Stance, sentiment and sarcasm were learned together on the assumption that they inform one another. — For Mova (frames): the irony detector in prag could draw on evaluative polarity cues from the same frame, since a mismatch between surface sentiment and stance is a natural irony signal.
- The authors linked the weakest target to a training/evaluation label mismatch: None was dropped in training, and the COVID subset contains the most None tweets. — For Mova (answer): evaluation sets should be broken down by how often "no answer / cannot tell" occurs, so that a reader never trained to abstain is not misjudged on abstention-heavy subsets.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/)

## Cited by

Cited by

2 papers of our library cite it (of the 140884 whose bibliographies we read); each has a page here.

- [StanceEval 2024: The First Arabic Stance Detection Shared Task](https://md.research.elamur.ai/free/en/papers/alturayeif-2024-stanceeval-2024-first-arabic-stance/)
- [TTLab at StanceEval-2026: A Cloze-Style Prompting Approach for Arabic-Language Stance Detection (CLASP-Ar)](https://md.research.elamur.ai/free/en/papers/verma-2026-ttlab-stanceeval-2026-cloze-style/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{hasanaath2024stancecrafters,
  title = {{StanceCrafters at StanceEval2024: Multi-task Stance Detection using BERT Ensemble with Attention Based Aggregation}},
  author = {Hasanaath, Ahmed and Alansari, Aisha},
  booktitle = {Proceedings of the Second Arabic Natural Language Processing Conference},
  year = {2024},
  doi = {10.18653/v1/2024.arabicnlp-1.94},
  url = {https://doi.org/10.18653/v1/2024.arabicnlp-1.94}
}
```

- [← previous Some Notes on Lexicographic Criticism and Biblical Hebrew Studies. Revisiting David J. A. Clines's Method](https://md.research.elamur.ai/free/en/papers/hbo-2024-ortiz-some-notes-lexicographic-criticism-biblical/)
- [next → StanceEval 2024: The First Arabic Stance Detection Shared Task](https://md.research.elamur.ai/free/en/papers/alturayeif-2024-stanceeval-2024-first-arabic-stance/)
- [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/5/)

## References

17 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Shams Forruque Ahmed, Md Sakib Bin Alam, Maruf Hassan, Mahtabin Rodela Rozbu, Taoseef Ishtiak, Nazifa Rafa, M Mofijur, ABM Shawkat Ali, and Amir H Gandomi. 2023. Deep learning modelling techniques: current progress, applications, advantages, and challenges. Artificial Intelligence Review, 56(11):13521–13617. [find](https://scholar.google.com/scholar?q=Shams+Forruque+Ahmed%2C+Md+Sakib+Bin+Alam%2C+Maruf+Hassan%2C+Mahtabin+Rodela+Rozbu%2C+Taoseef+Ishtiak%2C+Nazifa+Rafa%2C+M+Mofijur%2C+ABM+Shawkat+Ali%2C+and+Amir+H+Gandomi%2E+2023%2E+Deep+learning+modelling+techniques%3A+cu)
2. Abeer AlDayel and Walid Magdy. 2021. Stance detection on social media: State of the art and trends. Information Processing & Management, 58(4):102597. [find](https://scholar.google.com/scholar?q=Abeer+AlDayel+and+Walid+Magdy%2E+2021%2E+Stance+detection+on+social+media%3A+State+of+the+art+and+trends%2E+Information+Processing+%26+Management%2C+58%284%29%3A102597%2E)
3. Nora Alturayeif, Hamzah Luqman, and Moataz Ahmed. 2023. Enhancing stance detection through sequential weighted multi-task learning. Social Network Analysis and Mining, 14(1):7. [find](https://scholar.google.com/scholar?q=Nora+Alturayeif%2C+Hamzah+Luqman%2C+and+Moataz+Ahmed%2E+2023%2E+Enhancing+stance+detection+through+sequential+weighted+multi%2Dtask+learning%2E+Social+Network+Analysis+and+Mining%2C+14%281%29%3A7%2E)
4. Nora Alturayeif, Hamzah Luqman, Zaid Alyafeai, and Asma Yamani. 2024. Stanceeval 2024: The first arabic stance detection shared task. In Proceedings of The Second Arabic Natural Language Processing Conference (ArabicNLP 2024). [find](https://scholar.google.com/scholar?q=Nora+Alturayeif%2C+Hamzah+Luqman%2C+Zaid+Alyafeai%2C+and+Asma+Yamani%2E+2024%2E+Stanceeval+2024%3A+The+first+arabic+stance+detection+shared+task%2E+In+Proceedings+of+The+Second+Arabic+Natural+Language+Processing+Co) [our card](https://md.research.elamur.ai/free/en/papers/alturayeif-2024-stanceeval-2024-first-arabic-stance/)
5. Ting Gong, Tyler Lee, Cory Stephenson, Venkata Renduchintala, Suchismita Padhy, Anthony Ndirango, Gokce Keskin, and Oguz H Elibol. 2019. A comparison of loss weighting strategies for multi task learning in deep neural networks. IEEE Access, 7:141627– 141632. [find](https://scholar.google.com/scholar?q=Ting+Gong%2C+Tyler+Lee%2C+Cory+Stephenson%2C+Venkata+Renduchintala%2C+Suchismita+Padhy%2C+Anthony+Ndirango%2C+Gokce+Keskin%2C+and+Oguz+H+Elibol%2E+2019%2E+A+comparison+of+loss+weighting+strategies+for+multi+task+learni)
6. Dilek Küçük and Fazli Can. 2021. Stance detection: Concepts, approaches, resources, and outstanding issues. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. [find](https://scholar.google.com/scholar?q=Dilek+K%C3%BC%C3%A7%C3%BCk+and+Fazli+Can%2E+2021%2E+Stance+detection%3A+Concepts%2C+approaches%2C+resources%2C+and+outstanding+issues%2E+In+Proceedings+of+the+44th+International+ACM+SIGIR+Conference+on+Research+and+Development+in)
7. Xiao Liu, Zhunchen Luo, and Heyan Huang. 2018. Jointly multiple events extraction via attention-based graph information aggregation. arXiv preprint arXiv:1809.09078. [↗](https://arxiv.org/abs/1809.09078) [our card](https://md.research.elamur.ai/free/en/papers/liu-2018-jointly-multiple-events-extraction-attention/)
8. Khouloud Mnassri, Praboda Rajapaksha, Reza Farah-bakhsh, and Noel Crespi. 2022. Bert-based ensemble approaches for hate speech detection. In GLOBE-COM 2022-2022 IEEE Global Communications Conference, pages 4649–4654. IEEE. [find](https://scholar.google.com/scholar?q=Khouloud+Mnassri%2C+Praboda+Rajapaksha%2C+Reza+Farah%2Dbakhsh%2C+and+Noel+Crespi%2E+2022%2E+Bert%2Dbased+ensemble+approaches+for+hate+speech+detection%2E+In+GLOBE%2DCOM+2022%2D2022+IEEE+Global+Communications+Conference%2C+)
9. Jonathan Pilault, Amine Elhattami, and Christopher Pal. 2020. Conditionally adaptive multi-task learning: Improving transfer learning in nlp using fewer parameters & less data. arXiv preprint arXiv:2009.09139. [↗](https://arxiv.org/abs/2009.09139)
10. Kim-Han Thung and Chong-Yaw Wee. 2018. A brief review on multi-task learning. Multimedia Tools and Applications, 77(22):29705–29725. [find](https://scholar.google.com/scholar?q=Kim%2DHan+Thung+and+Chong%2DYaw+Wee%2E+2018%2E+A+brief+review+on+multi%2Dtask+learning%2E+Multimedia+Tools+and+Applications%2C+77%2822%29%3A29705%E2%80%9329725%2E)
11. Yu Zhang and Qiang Yang. 2021. A survey on multi-task learning. IEEE Transactions on Knowledge and Data Engineering, 34(12):5586–5609. [find](https://scholar.google.com/scholar?q=Yu+Zhang+and+Qiang+Yang%2E+2021%2E+A+survey+on+multi%2Dtask+learning%2E+IEEE+Transactions+on+Knowledge+and+Data+Engineering%2C+34%2812%29%3A5586%E2%80%935609%2E)
12. Nora Saleh Alturayeif, Hamzah Abdullah Luqman, and Moataz Aly Kamaleldin Ahmed. 2022. Mawqif: A multi-label arabic dataset for target-specific stance detection. In Proceedings of the The Seventh Arabic Natural Language Processing Workshop (WANLP), pages 174–184. [find](https://scholar.google.com/scholar?q=Nora+Saleh+Alturayeif%2C+Hamzah+Abdullah+Luqman%2C+and+Moataz+Aly+Kamaleldin+Ahmed%2E+2022%2E+Mawqif%3A+A+multi%2Dlabel+arabic+dataset+for+target%2Dspecific+stance+detection%2E+In+Proceedings+of+the+The+Seventh+Arabi)
13. J Briskilal and CN Subalalitha. 2022. An ensemble model for classifying idioms and literal texts using bert and roberta. Information Processing & Management, 59(1):102756. [find](https://scholar.google.com/scholar?q=J+Briskilal+and+CN+Subalalitha%2E+2022%2E+An+ensemble+model+for+classifying+idioms+and+literal+texts+using+bert+and+roberta%2E+Information+Processing+%26+Management%2C+59%281%29%3A102756%2E)
14. Huong Dang, Kahyun Lee, Sam Henry, and Ozlem Uzuner. 2020. Ensemble bert for classifying medication-mentioning tweets. In Proceedings of the Fifth Social Media Mining for Health Applications Workshop & Shared Task, pages 37–41. [find](https://scholar.google.com/scholar?q=Huong+Dang%2C+Kahyun+Lee%2C+Sam+Henry%2C+and+Ozlem+Uzuner%2E+2020%2E+Ensemble+bert+for+classifying+medication%2Dmentioning+tweets%2E+In+Proceedings+of+the+Fifth+Social+Media+Mining+for+Health+Applications+Workshop+)
15. Hang-Yuan Du and Wen-Jian Wang. 2022. A clustering ensemble framework with integration of data characteristics and structure information: a graph neural networks approach. Mathematics, 10(11):1834. [find](https://scholar.google.com/scholar?q=Hang%2DYuan+Du+and+Wen%2DJian+Wang%2E+2022%2E+A+clustering+ensemble+framework+with+integration+of+data+characteristics+and+structure+information%3A+a+graph+neural+networks+approach%2E+Mathematics%2C+10%2811%29%3A1834%2E)
16. Ronen Feldman. 2013. Techniques and applications for sentiment analysis. Communications of the ACM, 56(4):82–89. [find](https://scholar.google.com/scholar?q=Ronen+Feldman%2E+2013%2E+Techniques+and+applications+for+sentiment+analysis%2E+Communications+of+the+ACM%2C+56%284%29%3A82%E2%80%9389%2E)
17. Mudasir A Ganaie, Minghui Hu, Ashwani Kumar Malik, Muhammad Tanveer, and Ponnuthurai N Sug-anthan. 2022. Ensemble deep learning: A review. Engineering Applications of Artificial Intelligence, 115:105151. [find](https://scholar.google.com/scholar?q=Mudasir+A+Ganaie%2C+Minghui+Hu%2C+Ashwani+Kumar+Malik%2C+Muhammad+Tanveer%2C+and+Ponnuthurai+N+Sug%2Danthan%2E+2022%2E+Ensemble+deep+learning%3A+A+review%2E+Engineering+Applications+of+Artificial+Intelligence%2C+115%3A1051)