--- title: "Habibi - a multi Dialect multi National Arabic — El-Haj 2020" description: "Arabic dialect identification has mostly relied on tweets and forum comments." authors: ["Mahmoud El-Haj"] year: 2020 venue: "Proceedings of the Twelfth Language Resources and Evaluation Conference" source: "https://aclanthology.org/2020.lrec-1.165/" licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)" licence_url: "https://creativecommons.org/licenses/by-nc/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/haj-2020-habibi-multi-dialect-multi-national/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/haj-2020-habibi-multi-dialect-multi-national/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2020](https://md.research.elamur.ai/free/en/papers/2020/page/3/) / Habibi - a multi Dialect multi National Arabic Song Lyrics Corpus # Habibi - a multi Dialect multi National Arabic Song Lyrics Corpus **Authors:** Mahmoud El-Haj · **Year:** 2020 · **Venue:** Proceedings of the Twelfth Language Resources and Evaluation Conference · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2020.lrec-1.165/) · [PDF](https://aclanthology.org/2020.lrec-1.165.pdf) **Citations:** [38](#cited-by) in our library, of the 140884 papers whose bibliographies we read ## Summary Arabic dialect identification has mostly relied on tweets and forum comments. These are short and noisy, and they are usually labelled by crowd workers, which is costly and of uneven quality. El-Haj presents Habibi, which he says is the earliest corpus of Arabic lyrics to be released openly at no cost. It contains over 30,000 songs by singers from 18 countries, split into verses. Song metadata came from the web, and Google and Wikipedia supplied each singer's country of origin. Countries were then grouped into six dialect labels: Egyptian, Gulf, Levantine, Iraqi, Sudanese and Maghrebi. To show the corpus is usable, the author ran binary and multi-class experiments on two tasks, dialect identification and country identification. Classical classifiers were compared with several neural architectures, using either pretrained Arabic Wiki FastText vectors or CBOW embeddings trained on the lyrics themselves. The best binary dialect result was 93% test accuracy, from a word-level CNN with Habibi's own embeddings. Every model beat a majority-class baseline. The corpus and its embeddings provide a longer-context resource for dialect work and future authorship studies. ## Key points - Corpus statistics: - 30,072 songs, 527,870 verse-sentences and over 3.5 million words. - 1,765 singers, 3,789 songwriters and 2,463 composers. - 18 countries and 6 dialects. - Labels come from the singer's country of origin, not from the lyrics' actual dialect. This introduces noise when, for example, a Lebanese singer such as Nancy Ajram performs in Egyptian. - The corpus is released as annotated txt, csv, json and xml. Missing writers or composers are marked "unknown". The 300-dimension CBOW embeddings are released as well. - Models tested: - Classical: Naïve Bayes, SVM and LR. - Neural: CNN, LSTM, BiGRU, BiLSTM and CLSTM. - Country experiments used nested subsets: top_2, top_3, top_4, top_5 and all_18 countries. - Findings: - The CNN was the strongest neural model throughout. - Naïve Bayes beat all neural models in every multi-class setting. - In-domain embeddings helped dialect identification, while FastText helped country identification. ## Interesting ideas - Instead of paying crowd annotators, the labels are inherited from external metadata (singer origin found via Wikipedia), and the paper openly names the resulting noise source. — For Mova (learn): Document-level metadata such as source collection or genre could act as cheap silver labels for register or style classifiers, provided the known mismatch cases are logged as a noise caveat. - The country task is run over a ladder of nested label sets (2, 3, 4, 5, then all 18 classes), showing how accuracy decays as classes multiply and per-class data thins. — For Mova (learn): Evaluations could be reported over growing label inventories (e.g., coarse vs. fine semantic roles) to reveal where a component stops scaling, rather than giving a single number. - A simple multinomial Naïve Bayes outperformed every neural model once there were many classes, and a most-frequent-class baseline anchored all results. — For Mova (learn): Every new learned component should be scored against a trivial majority baseline and a shallow classical model as negative controls, to show the added machinery earns its cost. - Embeddings trained on the target domain helped one task, while general pretrained vectors helped a related one, so the embedding source was treated as a per-task choice. — For Mova (tokens): For tagging and lemmatising fables and school texts, Mova could compare domain-derived lexical features against general ones per subtask instead of fixing one resource globally. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/) ## Cited by Cited by 38 papers of our library cite it (of the 140884 whose bibliographies we read); 10 of them have a page here, 28 not yet. - [Out-of-Domain Dependency Parsing for Dialects of Arabic: A Case Study](https://md.research.elamur.ai/free/en/papers/aclbulk-2024-mokh-out-domain-dependency-parsing-dialects/) - [ArzEn-MultiGenre: An aligned parallel dataset of Egyptian Arabic song lyrics, novels, and subtitles, with English translations](https://md.research.elamur.ai/free/en/papers/al-2025-sabbagh-arzen-multigenre-aligned-parallel-dataset/) - [A Large and Diverse Arabic Corpus for Language Modeling](https://md.research.elamur.ai/free/en/papers/ali-2022-large-diverse-arabic-corpus-language/) - [Hierarchical Aggregation of Dialectal Data for Arabic Dialect Identification](https://md.research.elamur.ai/free/en/papers/baimukan-2022-hierarchical-aggregation-dialectal-data-arabic/) - [Can Dialects Be Steered Like Languages? Sparse Neurons and Distributed Directions in Arabic LLMs](https://md.research.elamur.ai/free/en/papers/elozeiri-2026-dialects-steered-like-languages-sparse/) - [On the importance of Data Scale in Pretraining Arabic Language Models](https://md.research.elamur.ai/free/en/papers/ghaddar-2024-importance-data-scale-pretraining-arabic/) - [TArC: Tunisian Arabish Corpus, First complete release](https://md.research.elamur.ai/free/en/papers/gugliotta-2022-tarc-tunisian-arabish-corpus-first/) - [The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models](https://md.research.elamur.ai/free/en/papers/inoue-2021-interplay-variant-size-task-type/) - [The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset](https://md.research.elamur.ai/free/en/papers/lauren-2023-ccon-bigscience-roots-corpus-1-6tb/) - [Ramsa: A Large Sociolinguistically Rich Emirati Arabic Speech Corpus for ASR and TTS](https://md.research.elamur.ai/free/en/papers/sabbagh-2026-ramsa-large-sociolinguistically-rich-emirati/) ## Cite The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{elhaj2020habibi, title = {{Habibi - a multi Dialect multi National Arabic Song Lyrics Corpus}}, author = {El-Haj, Mahmoud}, booktitle = {Proceedings of the Twelfth Language Resources and Evaluation Conference}, year = {2020}, url = {https://aclanthology.org/2020.lrec-1.165/} } ``` - [← previous Graph-to-Graph Transformer for Transition-based Dependency Parsing](https://md.research.elamur.ai/free/en/papers/ud-2020-mohammadshahi-graph-graph-transformer-transition-based/) - [next → Harnessing the linguistic signal to predict scalar inferences](https://md.research.elamur.ai/free/en/papers/schuster-2020-harnessing-linguistic-signal-predict-scalar/) - [↑ back to papers of 2020](https://md.research.elamur.ai/free/en/papers/2020/page/3/) ## References 20 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Alsarsour, I., Mohamed, E., Suwaileh, R., and Elsayed, T. (2018). DART: A Large Dataset of Dialectal Arabic Tweets. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan, May 7-12, 2018. European Language Resources Association (ELRA). [find](https://scholar.google.com/scholar?q=Alsarsour%2C+I%2E%2C+Mohamed%2C+E%2E%2C+Suwaileh%2C+R%2E%2C+and+Elsayed%2C+T%2E+%282018%29%2E+DART%3A+A+Large+Dataset+of+Dialectal+Arabic+Tweets%2E+In+Proceedings+of+the+Eleventh+International+Conference+on+Language+Resources+and+Ev) 2. Aquil, R. (2012). Revisiting songs in language pedagogy. Journal of the National Council of Less Commonly Taught Languages, 11:75–95. [find](https://scholar.google.com/scholar?q=Aquil%2C+R%2E+%282012%29%2E+Revisiting+songs+in+language+pedagogy%2E+Journal+of+the+National+Council+of+Less+Commonly+Taught+Languages%2C+11%3A75%E2%80%9395%2E) 3. Bouamor, H., Hassan, S., and Habash, N. (2019). The MADAR shared task on Arabic fine-grained dialect identification. In Proceedings of the Fourth Arabic Natural Language Processing Workshop, pages 199–207, Florence, Italy, August. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Bouamor%2C+H%2E%2C+Hassan%2C+S%2E%2C+and+Habash%2C+N%2E+%282019%29%2E+The+MADAR+shared+task+on+Arabic+fine%2Dgrained+dialect+identification%2E+In+Proceedings+of+the+Fourth+Arabic+Natural+Language+Processing+Workshop%2C+pages+199) [our card](https://md.research.elamur.ai/free/en/papers/bouamor-2019-madar-shared-task-arabic-fine/) 4. Chung, J., Gulcehre, C., Cho, K., and Bengio, Y. (2014). Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555. [↗](https://arxiv.org/abs/1412.3555) 5. El-Haj, M., Rayson, P. E., Young, S. E., Walker, M., Moore, A., Athanasakou, V., and Schleicher, T. (2016). Learning tone and attribution for financial text mining. [find](https://scholar.google.com/scholar?q=El%2DHaj%2C+M%2E%2C+Rayson%2C+P%2E+E%2E%2C+Young%2C+S%2E+E%2E%2C+Walker%2C+M%2E%2C+Moore%2C+A%2E%2C+Athanasakou%2C+V%2E%2C+and+Schleicher%2C+T%2E+%282016%29%2E+Learning+tone+and+attribution+for+financial+text+mining%2E) 6. El-Haj, M., Rayson, P., and Aboelezz, M. (2018). Arabic dialect identification in the context of bivalency and code-switching. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan, May. European Language Resources Association (ELRA). [find](https://scholar.google.com/scholar?q=El%2DHaj%2C+M%2E%2C+Rayson%2C+P%2E%2C+and+Aboelezz%2C+M%2E+%282018%29%2E+Arabic+dialect+identification+in+the+context+of+bivalency+and+code%2Dswitching%2E+In+Proceedings+of+the+Eleventh+International+Conference+on+Language+Resou) 7. Elaraby, M. and Abdul-Mageed, M. (2018). Deep models for Arabic dialect identification on benchmarked data. In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial 2018), pages 263–274, Santa Fe, New Mexico, USA, August. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Elaraby%2C+M%2E+and+Abdul%2DMageed%2C+M%2E+%282018%29%2E+Deep+models+for+Arabic+dialect+identification+on+benchmarked+data%2E+In+Proceedings+of+the+Fifth+Workshop+on+NLP+for+Similar+Languages%2C+Varieties+and+Dialects+%28V) 8. Hochreiter, S. and Schmidhuber, J. (1997). Long short-term memory. Neural Comput., 9(8):1735–1780, November. [find](https://scholar.google.com/scholar?q=Hochreiter%2C+S%2E+and+Schmidhuber%2C+J%2E+%281997%29%2E+Long+short%2Dterm+memory%2E+Neural+Comput%2E%2C+9%288%29%3A1735%E2%80%931780%2C+November%2E) 9. Kilgarriff, A. and Grefenstette, G. (2001). Web as corpus. In Proceedings of Corpus Linguistics 2001, pages 342– 344. Corpus Linguistics. [find](https://scholar.google.com/scholar?q=Kilgarriff%2C+A%2E+and+Grefenstette%2C+G%2E+%282001%29%2E+Web+as+corpus%2E+In+Proceedings+of+Corpus+Linguistics+2001%2C+pages+342%E2%80%93+344%2E+Corpus+Linguistics%2E) 10. Kim, Y. (2014). Convolutional neural networks for sentence classification. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1746–1751, Doha, Qatar, October. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Kim%2C+Y%2E+%282014%29%2E+Convolutional+neural+networks+for+sentence+classification%2E+In+Proceedings+of+the+2014+Conference+on+Empirical+Methods+in+Natural+Language+Processing+%28EMNLP%29%2C+pages+1746%E2%80%931751%2C+Doha%2C+Qat) [our card](https://md.research.elamur.ai/free/en/papers/kim-2014-convolutional-neural-networks-sentence-classification/) 11. McCallum, A., Nigam, K., et al. (1998). A comparison of event models for naive bayes text classification. In AAAI-98 workshop on learning for text categorization, volume 752, pages 41–48. Citeseer. [find](https://scholar.google.com/scholar?q=McCallum%2C+A%2E%2C+Nigam%2C+K%2E%2C+et+al%2E+%281998%29%2E+A+comparison+of+event+models+for+naive+bayes+text+classification%2E+In+AAAI%2D98+workshop+on+learning+for+text+categorization%2C+volume+752%2C+pages+41%E2%80%9348%2E+Citeseer%2E) 12. Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781. [↗](https://arxiv.org/abs/1301.3781) 13. Qing Chen, Shipper, T., and Khan, L. (2010). Tweets mining using wikipedia and impurity cluster measurement. In 2010 IEEE International Conference on Intelligence and Security Informatics, pages 141–143, May. [find](https://scholar.google.com/scholar?q=Qing+Chen%2C+Shipper%2C+T%2E%2C+and+Khan%2C+L%2E+%282010%29%2E+Tweets+mining+using+wikipedia+and+impurity+cluster+measurement%2E+In+2010+IEEE+International+Conference+on+Intelligence+and+Security+Informatics%2C+pages+141%E2%80%931) 14. Ritter, A., Clark, S., Etzioni, O., et al. (2011). Named entity recognition in tweets: an experimental study. In Proceedings of the conference on empirical methods in natural language processing, pages 1524–1534. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ritter%2C+A%2E%2C+Clark%2C+S%2E%2C+Etzioni%2C+O%2E%2C+et+al%2E+%282011%29%2E+Named+entity+recognition+in+tweets%3A+an+experimental+study%2E+In+Proceedings+of+the+conference+on+empirical+methods+in+natural+language+processing%2C+page) [our card](https://md.research.elamur.ai/free/en/papers/ritter-2011-named-entity-recognition-tweets-experimental/) 15. Sainath, T. N., Vinyals, O., Senior, A., and Sak, H. (2015). Convolutional, long short-term memory, fully connected deep neural networks. In 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 4580–4584. IEEE. [find](https://scholar.google.com/scholar?q=Sainath%2C+T%2E+N%2E%2C+Vinyals%2C+O%2E%2C+Senior%2C+A%2E%2C+and+Sak%2C+H%2E+%282015%29%2E+Convolutional%2C+long+short%2Dterm+memory%2C+fully+connected+deep+neural+networks%2E+In+2015+IEEE+International+Conference+on+Acoustics%2C+Speech+and) 16. Soboh, L., Elkabani, I., and Osman, Z. (2017). Arabic cultural style based music classification. In 2017 International Conference on New Trends in Computing Sciences (ICTCS), pages 6–11, Oct. [find](https://scholar.google.com/scholar?q=Soboh%2C+L%2E%2C+Elkabani%2C+I%2E%2C+and+Osman%2C+Z%2E+%282017%29%2E+Arabic+cultural+style+based+music+classification%2E+In+2017+International+Conference+on+New+Trends+in+Computing+Sciences+%28ICTCS%29%2C+pages+6%E2%80%9311%2C+Oct%2E) 17. Terkourafi, M. (2010). The Languages of Global Hip Hop. Continuum International Publishing Group, New York, USA. [find](https://scholar.google.com/scholar?q=Terkourafi%2C+M%2E+%282010%29%2E+The+Languages+of+Global+Hip+Hop%2E+Continuum+International+Publishing+Group%2C+New+York%2C+USA%2E) 18. Touma, H. H. and Touma, H. (2003). The music of the Arabs. Hal Leonard Corporation. [find](https://scholar.google.com/scholar?q=Touma%2C+H%2E+H%2E+and+Touma%2C+H%2E+%282003%29%2E+The+music+of+the+Arabs%2E+Hal+Leonard+Corporation%2E) 19. Zaidan, O. F. and Callison-Burch, C. (2014). Arabic dialect identification. Comput. Linguist., 40(1):171–202, March. [find](https://scholar.google.com/scholar?q=Zaidan%2C+O%2E+F%2E+and+Callison%2DBurch%2C+C%2E+%282014%29%2E+Arabic+dialect+identification%2E+Comput%2E+Linguist%2E%2C+40%281%29%3A171%E2%80%93202%2C+March%2E) [our card](https://md.research.elamur.ai/free/en/papers/zaidan-2014-arabic-dialect-identification/) 20. Zhou, C., Sun, C., Liu, Z., and Lau, F. C. M. (2015). A C-LSTM neural network for text classification. CoRR, abs/1511.08630. [↗](https://arxiv.org/abs/1511.08630)