---
title: "Mawdoo3 AI at MADAR Shared Task: Arabic Tweet Dialect"
description: "The paper addresses user-level Arabic dialect identification for MADAR shared… 54.26% accuracy. 19 references, cited by 6 papers here."
authors: ["Bashar Talafha", "Wael Farhan", "Ahmed Altakrouri", "Hussein Al-Natsheh"]
year: 2019
venue: "Proceedings of the Fourth Arabic Natural Language Processing Workshop"
source: "https://aclanthology.org/W19-4629/"
doi: "10.18653/v1/w19-4629"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/talafha-2019-mawdoo3-ai-madar-shared-task/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/talafha-2019-mawdoo3-ai-madar-shared-task/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2019](https://md.research.elamur.ai/free/en/papers/2019/page/6/) / Mawdoo3 AI at MADAR Shared Task: Arabic Tweet Dialect Identification

# Mawdoo3 AI at MADAR Shared Task: Arabic Tweet Dialect Identification

**Authors:** [Bashar Talafha](https://md.research.elamur.ai/free/en/authors/bashar-talafha/), [Wael Farhan](https://md.research.elamur.ai/free/en/authors/wael-farhan/), Ahmed Altakrouri and [Hussein Al-Natsheh](https://md.research.elamur.ai/free/en/authors/hussein-al-natsheh/) · **Year:** 2019 · **Venue:** [Proceedings of the Fourth Arabic Natural Language Processing Workshop](https://md.research.elamur.ai/free/en/venues/wanlp/) ([WANLP 2019](https://md.research.elamur.ai/free/en/venues/wanlp/2019/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/W19-4629/) · [PDF](https://aclanthology.org/W19-4629.pdf) · [DOI 10.18653/v1/w19-4629](https://doi.org/10.18653/v1/w19-4629) · [OpenAlex](https://openalex.org/W2970072401)

**Citations:** 13 citations (OpenAlex, 2026-10-14) · [6](https://md.research.elamur.ai/free/en/papers/talafha-2019-mawdoo3-ai-madar-shared-task/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
The paper addresses user-level Arabic dialect identification for MADAR shared subtask-2. Given up to 100 tweets per Twitter user, the system must assign one of 21 country dialects. The data is difficult in several ways. Classes are heavily skewed toward Saudi Arabia. Most tweets are retweets, so the text often comes from an author with a different dialect than the user. About a tenth of the tweets could no longer be retrieved.

The authors built features from three sources:
- word and character n-gram Tf-idf,
- character Tf-idf over usernames and other Twitter-specific fields,
- city/MSA language-model probabilities supplied by the organizers.

They also tried AraVec and fastText embeddings. Several deep architectures (SepCNN, LSTMs, char-CNNs and hybrids) were compared against a LinearSVC. The linear model beat every neural model. The largest gain came from aggregating tweet-level predictions per user, using either frequency-aware weighted voting or majority voting with a stricter threshold for the dominant class. The best system reached roughly 71–72% Macro-F1 on dev and 69.86% on test, placing second. The result shows that curated features plus careful aggregation can beat deeper models on noisy social-media data.

## Key points
- **Dataset:** The MADAR Twitter data covers 21 countries.
  - Users never appear in more than one split.
  - About 61% of tweets are retweets and about 10% are unavailable.
  - Saudi Arabia accounts for about 35% of tweets; Djibouti for 0.08%.
- **Features:**
  - word unigram+bigram Tf-idf and character 1–5-gram Tf-idf;
  - character-unigram Tf-idf over usernames and mentions;
  - probabilities for 25 cities + MSA from the Salameh et al. (2018) model;
  - 300-d Twitter skip-gram AraVec;
  - a 300-d fastText model trained on AutoTweet, ArapTweet, DART, PADIC and MADAR data.
- **Tweet-level results (dev):** LinearSVC reached 54.26% accuracy / 38.95 F1. The best neural model, a word LSTM with fastText, reached 50.59 / 34.65.
- **User-level results:**
  - Concatenating each user's tweets into one document gave 77.33% accuracy / 70.43 F1 on dev.
  - Weighted user voting gave 81.67% / 71.60 F1 on dev and 69.86 F1 on test.
  - A Saudi-threshold vote (Saudi chosen only if at least 75% of a user's tweets are predicted Saudi) is reported at 71.84 F1 in the text but 70.72 in the table.
- **Dialect weights:** Each dialect gets an integer weight from 1 to 6. Counts are binned on a cube-root scale between the largest and smallest class, and rarer dialects receive larger weights. The retweet weight is given as 6 in the text and 8 in the table.

## Interesting ideas
- Instead of classifying a whole collection at once, the authors classify each item and then vote, with rarer classes weighted more heavily via cube-root bins; this was the biggest single improvement and suits any setting where many weak per-item guesses must become one label.
- The dominant class is only accepted when it wins a supermajority (75%), which curbs a classifier's drift toward the majority label and helps macro-averaged metrics.
- Retweets carry the retweeter's label but another author's language, a reminder that the person who reproduces content is not necessarily its source.
- A linear SVM over hand-chosen word and character n-grams beat every neural architecture tried, showing that a cheap, transparent baseline can be very hard to beat on noisy, short, skewed text.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (learn): When several witness parsers vote on a silver label, votes for rare relations or tags could be up-weighted with similar binned weights, so silver data is not swamped by the most frequent labels.
- **I2** (tokens): The tagger or lemmatizer could require extra confidence before falling back to its most frequent default analysis, sending close calls to a richer disambiguation step instead.
- **I3** (frames): Quoted or reported speech should be attributed to its original speaker rather than the narrator, so speech acts and stances are not assigned to the wrong agent.
- **I4** (learn): Every new learned component should be compared against a simple linear n-gram baseline as a control, keeping the complex model only if it clearly wins.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

🧭 Topics (1): [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 2,908 works

## Cite

Cite as: Bashar Talafha, Wael Farhan, Ahmed Altakrouri and Hussein Al-Natsheh. 2019. Mawdoo3 AI at MADAR Shared Task: Arabic Tweet Dialect Identification. Proceedings of the Fourth Arabic Natural Language Processing Workshop.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{talafha2019mawdoo3,
  title = {{Mawdoo3 AI at MADAR Shared Task: Arabic Tweet Dialect Identification}},
  author = {Bashar Talafha, Wael Farhan, Ahmed Altakrouri and Hussein Al-Natsheh},
  booktitle = {Proceedings of the Fourth Arabic Natural Language Processing Workshop},
  year = {2019},
  doi = {10.18653/v1/w19-4629},
  url = {https://doi.org/10.18653/v1/w19-4629}
}
```

- [← previous DisSim: A Discourse-Aware Syntactic Text Simplification Framework for English and German](https://md.research.elamur.ai/free/en/papers/niklaus-2019-dissim-discourse-aware-syntactic-text/)
- [next → Towards Universal Dialogue Act Tagging for Task-Oriented Dialogues](https://md.research.elamur.ai/free/en/papers/paul-2019-towards-universal-dialogue-act-tagging/)
- [↑ back to papers of 2019](https://md.research.elamur.ai/free/en/papers/2019/page/6/)

## References

19 references, 9 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. [Distributed representations of words and phrases and their compositionality](https://md.research.elamur.ai/free/en/papers/mikolov-2013-distributed-representations-words-phrases-their/). In Advances in neural information processing systems, pages 3111–3119. [↗](https://doi.org/10.48550/arxiv.1310.4546)
2. Hind Almerekhi and Tamer Elsayed. 2015. Detecting automatically-generated arabic tweets. In AIRS, pages 123–134. Springer. [find](https://scholar.google.com/scholar?q=Hind+Almerekhi+and+Tamer+Elsayed%2E+2015%2E+Detecting+automatically%2Dgenerated+arabic+tweets%2E+In+AIRS%2C+pages+123%E2%80%93134%2E+Springer%2E)
3. Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al. 2011. Scikit-learn: Machine learning in python. Journal of machine learning research, 12(Oct):2825–2830. [↗](https://doi.org/10.48550/arxiv.1201.0490)
4. Israa Alsarsour, Esraa Mohamed, Reem Suwaileh, and Tamer Elsayed. 2018. [Dart: A large dataset of dialectal arabic tweets](https://md.research.elamur.ai/free/en/papers/alsarsour-2018-dart-large-dataset-dialectal-arabic/). In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC-2018).
5. Piotr Bojanowski, Edouard Grave, Armand Joulin, and Tomas Mikolov. 2017. [Enriching word vectors with subword information](https://md.research.elamur.ai/free/en/papers/bojanowski-2017-enriching-word-vectors-subword-information/). Transactions of the Association for Computational Linguistics, 5:135–146. [↗](https://doi.org/10.1162/tacl_a_00051)
6. Mohammad Salameh, Houda Bouamor, and Nizar Habash. 2018. [Fine-grained Arabic dialect identification](https://md.research.elamur.ai/free/en/papers/salameh-2018-fine-grained-arabic-dialect-identification/). In Proceedings of the International Conference on Computational Linguistics (COLING), pages 1332–1344, Santa Fe, New Mexico, USA.
7. Houda Bouamor, Nizar Habash, Mohammad Salameh, Wajdi Zaghouani, Owen Rambow, Dana Abdulrahim, Ossama Obeid, Salam Khalifa, Fadhl Eryani, Alexander Erdmann, and Kemal Oflazer. 2018. The MADAR Arabic Dialect Corpus and Lexicon. In Proceedings of the Language Resources and Evaluation Conference (LREC), Miyazaki, Japan. [find](https://scholar.google.com/scholar?q=Houda+Bouamor%2C+Nizar+Habash%2C+Mohammad+Salameh%2C+Wajdi+Zaghouani%2C+Owen+Rambow%2C+Dana+Abdulrahim%2C+Ossama+Obeid%2C+Salam+Khalifa%2C+Fadhl+Eryani%2C+Alexander+Erdmann%2C+and+Kemal+Oflazer%2E+2018%2E+The+MADAR+Arabic+Di)
8. Abu Bakr Soliman, Kareem Eissa, and Samhaa R El-Beltagy. 2017. Aravec: A set of arabic word embedding models for use in arabic nlp. Procedia Computer Science, 117:256–265. Twitter. Api reference index twitter developers. [find](https://scholar.google.com/scholar?q=Abu+Bakr+Soliman%2C+Kareem+Eissa%2C+and+Samhaa+R+El%2DBeltagy%2E+2017%2E+Aravec%3A+A+set+of+arabic+word+embedding+models+for+use+in+arabic+nlp%2E+Procedia+Computer+Science%2C+117%3A256%E2%80%93265%2E+Twitter%2E+Api+reference+index)
9. Wajdi Zaghouani and Anis Charfi. 2018. Arap-tweet: A large multi-dialect twitter corpus for gender, age and language variety identification. arXiv preprint arXiv:1808.07674. [↗](https://arxiv.org/abs/1808.07674)
10. Houda Bouamor, Sabit Hassan, and Nizar Habash. 2019. [The MADAR Shared Task on Arabic Fine-Grained Dialect Identification](https://md.research.elamur.ai/free/en/papers/bouamor-2019-madar-shared-task-arabic-fine/). In Proceedings of the Fourth Arabic Natural Language Processing Workshop (WANLP19), Florence, Italy.
11. Omar F Zaidan and Chris Callison-Burch. 2014. [Arabic dialect identification](https://md.research.elamur.ai/free/en/papers/zaidan-2014-arabic-dialect-identification/). Computational Linguistics, 40(1):171–202. [↗](https://doi.org/10.1162/coli_a_00169)
12. Timo I. Denk. 2017. Text classification with separable convolutional neural networks. [find](https://scholar.google.com/scholar?q=Timo+I%2E+Denk%2E+2017%2E+Text+classification+with+separable+convolutional+neural+networks%2E)
13. Shiwei Zhang, Xiuzhen Zhang, and Jeffrey Chan. 2017. A word-character convolutional neural network for language-agnostic twitter sentiment analysis. In Proceedings of the 22nd Australasian Document Computing Symposium, page 12. ACM. [find](https://scholar.google.com/scholar?q=Shiwei+Zhang%2C+Xiuzhen+Zhang%2C+and+Jeffrey+Chan%2E+2017%2E+A+word%2Dcharacter+convolutional+neural+network+for+language%2Dagnostic+twitter+sentiment+analysis%2E+In+Proceedings+of+the+22nd+Australasian+Document+Co)
14. Mohamed Elaraby and Muhammad Abdul-Mageed. 2018. [Deep models for arabic dialect identification on benchmarked data](https://md.research.elamur.ai/free/en/papers/elaraby-2018-deep-models-arabic-dialect-identification/). In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial 2018), pages 263–274.
15. Xiang Zhang, Junbo Zhao, and Yann LeCun. 2015. [Character-level convolutional networks for text classification](https://md.research.elamur.ai/free/en/papers/zhang-2015-character-level-convolutional-networks-text/). In Advances in neural information processing systems, pages 649–657. [↗](https://doi.org/10.48550/arxiv.1509.01626)
16. Salima Harrat, Karima Meftouh, Mourad Abbas, and Kamel Smaili. 2014. Building resources for algerian arabic dialects. In 15th Annual Conference of the International Communication Association Interspeech. [find](https://scholar.google.com/scholar?q=Salima+Harrat%2C+Karima+Meftouh%2C+Mourad+Abbas%2C+and+Kamel+Smaili%2E+2014%2E+Building+resources+for+algerian+arabic+dialects%2E+In+15th+Annual+Conference+of+the+International+Communication+Association+Interspee)
17. Fei Huang. 2015. [Improved arabic dialect classification with social media data](https://md.research.elamur.ai/free/en/papers/huang-2015-improved-arabic-dialect-classification-social/). In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 2118–2126.
18. Armand Joulin, Edouard Grave, Piotr Bojanowski, and Tomas Mikolov. 2017. Bag of tricks for efficient text classification. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers, pages 427–431. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Armand+Joulin%2C+Edouard+Grave%2C+Piotr+Bojanowski%2C+and+Tomas+Mikolov%2E+2017%2E+Bag+of+tricks+for+efficient+text+classification%2E+In+Proceedings+of+the+15th+Conference+of+the+European+Chapter+of+the+Associati)
19. Pengfei Liu, Xipeng Qiu, and Xuanjing Huang. 2016. Recurrent neural network for text classification with multi-task learning. arXiv preprint arXiv:1605.05101. [↗](https://arxiv.org/abs/1605.05101)

*Updated 1 November 2026*