---
title: "Empirical evaluation of shallow and deep learning classifiers for Arabic sentiment — Nassif 2021"
description: "The authors argue that the earlier result came from training sets that were too small. 63 references, cited by 2 papers here."
authors: ["Ali Bou Nassif", "Abdollah Masoud Darya", "Ashraf Elnagar"]
year: 2021
venue: "arXiv:2112.00534 · ACM Trans. Asian Low-Resour. Lang. Inf. Process. 21, 1, Article 14 (November 2021), 25 pages (2021)"
source: "https://arxiv.org/abs/2112.00534"
doi: "10.1145/3466171"
arxiv: "2112.00534"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/nassif-2021-empirical-evaluation-shallow-deep-learning/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/nassif-2021-empirical-evaluation-shallow-deep-learning/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2021](https://md.research.elamur.ai/free/en/papers/2021/page/4/) / Empirical evaluation of shallow and deep learning classifiers for Arabic sentiment analysis

# Empirical evaluation of shallow and deep learning classifiers for Arabic sentiment analysis

**Authors:** [Ali Bou Nassif](https://md.research.elamur.ai/free/en/authors/ali-bou-nassif/), Abdollah Masoud Darya and [Ashraf Elnagar](https://md.research.elamur.ai/free/en/authors/ashraf-elnagar/) · **Year:** 2021 · **Venue:** arXiv:2112.00534 · ACM Trans. Asian Low-Resour. Lang. Inf. Process. 21, 1, Article 14 (November 2021), 25 pages (2021) · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://doi.org/10.1145/3466171) · [PDF](https://arxiv.org/pdf/2112.00534) · [DOI 10.1145/3466171](https://doi.org/10.1145/3466171) · [arXiv 2112.00534](https://arxiv.org/abs/2112.00534) · [OpenAlex](https://openalex.org/W3216452752)

**Citations:** 32 citations (OpenAlex, 2026-10-14) · [2](https://md.research.elamur.ai/free/en/papers/nassif-2021-empirical-evaluation-shallow-deep-learning/cited-by/) in our library, of the 140,884 papers whose bibliographies we read

## Summary
The paper asks whether deep learning really loses to classical "shallow" classifiers on Arabic sentiment analysis, as some earlier work reported. The authors argue that the earlier result came from training sets that were too small. To test this, they ran a broad benchmark on two large multi-dialect review corpora, HARD (hotels) and BRAD (books), which mix MSA and Dialectal Arabic. They compared eight common shallow classifiers with CNN, LSTM, GRU and every hybrid of the three, plus a transformer model with several embedding options, including araBERT. They evaluated binary and 5-label rating prediction using accuracy and F1. They also plotted learning curves over dataset size and examined misclassified reviews. Deep models won in almost every setting, and the margin depended on how much training data was available. The transformer combined with araBERT was the strongest model except on very small data. The work gives practical guidance on when neural models pay off for a morphologically rich, dialect-heavy, lower-resource language.

## Key points
- Corpora: HARD has 373,750 reviews from booking.com (unbalanced variant, about 90K unique tokens). BRAD has 508,538 book reviews (about 220K unique tokens).
- Shallow side: Random Forest was the top classifier, with Decision Tree in second place and AdaBoost after it. Random Forest also beat the deep models on 5-label classification.
- The deep architectures (CNN, LSTM, GRU and hybrids) scored roughly the same with a default embedding layer. The transformer gained much more from richer embeddings, with araBERT giving the largest gain.
- Rough rule from the learning curves:
  - Shallow methods are preferable below about 10,000 sentences.
  - Deep methods are the better choice at tens of thousands of sentences.
  - Transformer+araBERT leads everywhere except below about 3,000 sentences.
- Both families scored higher on HARD than on BRAD, even though BRAD is 33% larger. The authors attribute this to BRAD's vocabulary being more than twice the size.

## Interesting ideas
- The authors use a learning curve over training-set size to find where a complex model starts beating a simple one, instead of reporting a single comparison at one data size.
- They explain a contradiction in the literature by naming a specific confound, dataset size, and then testing it directly rather than simply asserting that their own result is right.
- They treat vocabulary spread as a hidden difficulty factor: the bigger corpus was harder because its unique-token space was much larger.
- Their error analysis shows that failures cluster in reviews with mixed praise and complaints, while reviews with explicit cue words were classified correctly.
- They run an ablation that keeps the architecture fixed and swaps only the embedding source (dataset-derived, custom web-derived, pre-trained).

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (learn): Train the perceptron parser and gparse on growing slices of a treebank and plot both. This shows the data size at which the GPU parser actually earns its cost for each UD dialect or domain.
- **I2** (learn): When a new result clashes with an earlier evaluation, write down the suspected confound (size, domain, annotation dialect) and design a targeted check, similar to a negative control.
- **I3** (tokens): Report type/token ratio and out-of-vocabulary rates per corpus next to tagger scores. Use lemma and morphology normalization to shrink the effective vocabulary and measure how much that helps.
- **I4** (frames): Assign stance per clause or per aspect frame (who praised what, who complained about what) instead of per document. This makes mixed reviews explainable rather than forcing a single label.
- **I5** (tree): Hold the gparse architecture constant and vary only the encoder or embeddings. This isolates how much parsing accuracy comes from representation versus parser design.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/)

Topics: [😊 Sentiment & emotion](https://md.research.elamur.ai/free/en/topics/sentiment-emotion/) · [📏 Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · [🐪 Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/)

## Institutions

- [University of Sharjah](https://md.research.elamur.ai/free/en/universities/university-of-sharjah/) — University, Sharjah, United Arab Emirates · 5 works · 152 citations

## Cite

Cite as: Ali Bou Nassif, Abdollah Masoud Darya and Ashraf Elnagar. 2021. Empirical evaluation of shallow and deep learning classifiers for Arabic sentiment analysis. arXiv:2112.00534 · ACM Trans. Asian Low-Resour. Lang. Inf. Process. 21, 1, Article 14 (November 2021), 25 pages (2021).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{nassif2021empirical,
  title = {{Empirical evaluation of shallow and deep learning classifiers for Arabic sentiment analysis}},
  author = {Ali Bou Nassif, Abdollah Masoud Darya and Ashraf Elnagar},
  year = {2021},
  doi = {10.1145/3466171},
  eprint = {2112.00534},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.1145/3466171}
}
```

- [← previous Sarcasm and Sentiment Detection In Arabic Tweets Using BERT-based Models and Data Augmentation](https://md.research.elamur.ai/free/en/papers/abuzayed-2021-sarcasm-sentiment-detection-arabic-tweets/)
- [next → Focus on what matters: Applying Discourse Coherence Theory to Cross Document Coreference](https://md.research.elamur.ai/free/en/papers/held-2021-focus-what-matters-applying-discourse/)
- [↑ back to papers of 2021](https://md.research.elamur.ai/free/en/papers/2021/page/4/)

## References

63 references, 9 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Mahmoud Al-Ayyoub, Abed Allah Khamaiseh, Yaser Jararweh, and Mohammed N Al-Kabi. 2019. A comprehensive survey of arabic sentiment analysis. Information Processing & Management 56, 2 (2019), 320–342. [find](https://scholar.google.com/scholar?q=Mahmoud+Al%2DAyyoub%2C+Abed+Allah+Khamaiseh%2C+Yaser+Jararweh%2C+and+Mohammed+N+Al%2DKabi%2E+2019%2E+A+comprehensive+survey+of+arabic+sentiment+analysis%2E+Information+Processing+%26+Management+56%2C+2+%282019%29%2C+320%E2%80%93342%2E)
2. Mahmoud Al-Ayyoub, Aya Nuseir, Kholoud Alsmearat, Yaser Jararweh, and Brij Gupta. 2018. Deep learning for Arabic NLP: A survey. Journal of computational science 26 (2018), 522–531. [find](https://scholar.google.com/scholar?q=Mahmoud+Al%2DAyyoub%2C+Aya+Nuseir%2C+Kholoud+Alsmearat%2C+Yaser+Jararweh%2C+and+Brij+Gupta%2E+2018%2E+Deep+learning+for+Arabic+NLP%3A+A+survey%2E+Journal+of+computational+science+26+%282018%29%2C+522%E2%80%93531%2E)
3. Sadam Al-Azani and El-Sayed El-Alfy. 2018. Emojis-based sentiment classification of Arabic microblogs using deep recurrent neural networks. In 2018 International Conference on Computing Sciences and Engineering (ICCSE). IEEE, 1–6. [find](https://scholar.google.com/scholar?q=Sadam+Al%2DAzani+and+El%2DSayed+El%2DAlfy%2E+2018%2E+Emojis%2Dbased+sentiment+classification+of+Arabic+microblogs+using+deep+recurrent+neural+networks%2E+In+2018+International+Conference+on+Computing+Sciences+and+E)
4. Sadam Al-Azani and El-Sayed M El-Alfy. 2017. Hybrid deep learning for sentiment polarity determination of arabic microblogs. In International Conference on Neural Information Processing. Springer, 491–500. [find](https://scholar.google.com/scholar?q=Sadam+Al%2DAzani+and+El%2DSayed+M+El%2DAlfy%2E+2017%2E+Hybrid+deep+learning+for+sentiment+polarity+determination+of+arabic+microblogs%2E+In+International+Conference+on+Neural+Information+Processing%2E+Springer%2C+491)
5. Ahmad Al-Sallab, Ramy Baly, Hazem Hajj, Khaled Bashir Shaban, Wassim El-Hajj, and Gilbert Badaro. 2017. Aroma: A recursive deep learning model for opinion mining in arabic as a low resource language. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 16, 4 (2017), 1–20. [find](https://scholar.google.com/scholar?q=Ahmad+Al%2DSallab%2C+Ramy+Baly%2C+Hazem+Hajj%2C+Khaled+Bashir+Shaban%2C+Wassim+El%2DHajj%2C+and+Gilbert+Badaro%2E+2017%2E+Aroma%3A+A+recursive+deep+learning+model+for+opinion+mining+in+arabic+as+a+low+resource+language%2E+)
6. Ahmad Al Sallab, Hazem Hajj, Gilbert Badaro, Ramy Baly, Wassim El Hajj, and Khaled Bashir Shaban. 2015. Deep learning models for sentiment analysis in Arabic. In Proceedings of the second workshop on Arabic natural language processing. 9–17. [find](https://scholar.google.com/scholar?q=Ahmad+Al+Sallab%2C+Hazem+Hajj%2C+Gilbert+Badaro%2C+Ramy+Baly%2C+Wassim+El+Hajj%2C+and+Khaled+Bashir+Shaban%2E+2015%2E+Deep+learning+models+for+sentiment+analysis+in+Arabic%2E+In+Proceedings+of+the+second+workshop+on+)
7. Mohammad Al-Smadi, Omar Qawasmeh, Mahmoud Al-Ayyoub, Yaser Jararweh, and Brij Gupta. 2018. Deep Recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels’ reviews. Journal of computational science 27 (2018), 386–393. [find](https://scholar.google.com/scholar?q=Mohammad+Al%2DSmadi%2C+Omar+Qawasmeh%2C+Mahmoud+Al%2DAyyoub%2C+Yaser+Jararweh%2C+and+Brij+Gupta%2E+2018%2E+Deep+Recurrent+neural+network+vs%2E+support+vector+machine+for+aspect%2Dbased+sentiment+analysis+of+Arabic+hotels)
8. Abdulaziz M Alayba, Vasile Palade, Matthew England, and Rahat Iqbal. 2018. A combined CNN and LSTM model for arabic sentiment analysis. In International Cross-Domain Conference for Machine Learning and Knowledge Extraction. Springer, 179–191. [find](https://scholar.google.com/scholar?q=Abdulaziz+M+Alayba%2C+Vasile+Palade%2C+Matthew+England%2C+and+Rahat+Iqbal%2E+2018%2E+A+combined+CNN+and+LSTM+model+for+arabic+sentiment+analysis%2E+In+International+Cross%2DDomain+Conference+for+Machine+Learning+an)
9. Huda Abdulrahman Almuzaini and Aqil M Azmi. 2020. Impact of stemming and word embedding on deep learning-based arabic text categorization. IEEE Access 8 (2020), 127913–127928. Manuscript submitted to ACM [find](https://scholar.google.com/scholar?q=Huda+Abdulrahman+Almuzaini+and+Aqil+M+Azmi%2E+2020%2E+Impact+of+stemming+and+word+embedding+on+deep+learning%2Dbased+arabic+text+categorization%2E+IEEE+Access+8+%282020%29%2C+127913%E2%80%93127928%2E+Manuscript+submitted+to+)
10. Anwar Alnawas and Nursal Arici. 2019. Sentiment Analysis of Iraqi Arabic Dialect on Facebook Based on Distributed Representations of Documents. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 18, 3 (2019), 20. [find](https://scholar.google.com/scholar?q=Anwar+Alnawas+and+Nursal+Arici%2E+2019%2E+Sentiment+Analysis+of+Iraqi+Arabic+Dialect+on+Facebook+Based+on+Distributed+Representations+of+Documents%2E+ACM+Transactions+on+Asian+and+Low%2DResource+Language+Info)
11. Naomi S Altman. 1992. An introduction to kernel and nearest-neighbor nonparametric regression. The American Statistician 46, 3 (1992), 175–185. [find](https://scholar.google.com/scholar?q=Naomi+S+Altman%2E+1992%2E+An+introduction+to+kernel+and+nearest%2Dneighbor+nonparametric+regression%2E+The+American+Statistician+46%2C+3+%281992%29%2C+175%E2%80%93185%2E)
12. A Aziz Altowayan and Ashraf Elnagar. 2017. Improving Arabic sentiment analysis with sentiment-specific embeddings. In 2017 IEEE International Conference on Big Data (Big Data). IEEE, 4314–4320. [find](https://scholar.google.com/scholar?q=A+Aziz+Altowayan+and+Ashraf+Elnagar%2E+2017%2E+Improving+Arabic+sentiment+analysis+with+sentiment%2Dspecific+embeddings%2E+In+2017+IEEE+International+Conference+on+Big+Data+%28Big+Data%29%2E+IEEE%2C+4314%E2%80%934320%2E)
13. Gilbert Badaro, Ramy Baly, Rana Akel, Linda Fayad, Jeffrey Khairallah, Hazem Hajj, Khaled Shaban, and Wassim El-Hajj. 2015. A light lexicon-based mobile application for sentiment mining of arabic tweets. In Proceedings of the second workshop on arabic natural language processing. 18–25. [find](https://scholar.google.com/scholar?q=Gilbert+Badaro%2C+Ramy+Baly%2C+Rana+Akel%2C+Linda+Fayad%2C+Jeffrey+Khairallah%2C+Hazem+Hajj%2C+Khaled+Shaban%2C+and+Wassim+El%2DHajj%2E+2015%2E+A+light+lexicon%2Dbased+mobile+application+for+sentiment+mining+of+arabic+twee)
14. Gilbert Badaro, Ramy Baly, Hazem Hajj, Wassim El-Hajj, Khaled Bashir Shaban, Nizar Habash, Ahmad Al-Sallab, and Ali Hamdi. 2019. A survey of opinion mining in Arabic: A comprehensive system perspective covering challenges and advances in tools, resources, models, applications, and visualizations. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 18, 3 (2019), 27. [find](https://scholar.google.com/scholar?q=Gilbert+Badaro%2C+Ramy+Baly%2C+Hazem+Hajj%2C+Wassim+El%2DHajj%2C+Khaled+Bashir+Shaban%2C+Nizar+Habash%2C+Ahmad+Al%2DSallab%2C+and+Ali+Hamdi%2E+2019%2E+A+survey+of+opinion+mining+in+Arabic%3A+A+comprehensive+system+perspectiv)
15. Gilbert Badaro, Ramy Baly, Hazem Hajj, Nizar Habash, and Wassim El-Hajj. 2014. A large scale Arabic sentiment lexicon for Arabic opinion mining. In Proceedings of the EMNLP 2014 workshop on arabic natural language processing (ANLP). 165–173. [find](https://scholar.google.com/scholar?q=Gilbert+Badaro%2C+Ramy+Baly%2C+Hazem+Hajj%2C+Nizar+Habash%2C+and+Wassim+El%2DHajj%2E+2014%2E+A+large+scale+Arabic+sentiment+lexicon+for+Arabic+opinion+mining%2E+In+Proceedings+of+the+EMNLP+2014+workshop+on+arabic+nat)
16. Gilbert Badaro, Obeida El Jundi, Alaa Khaddaj, Alaa Maarouf, Raslan Kain, Hazem Hajj, and Wassim El-Hajj. 2018. Ema at semeval-2018 task 1: Emotion mining for arabic. In Proceedings of The 12th International Workshop on Semantic Evaluation. 236–244. [find](https://scholar.google.com/scholar?q=Gilbert+Badaro%2C+Obeida+El+Jundi%2C+Alaa+Khaddaj%2C+Alaa+Maarouf%2C+Raslan+Kain%2C+Hazem+Hajj%2C+and+Wassim+El%2DHajj%2E+2018%2E+Ema+at+semeval%2D2018+task+1%3A+Emotion+mining+for+arabic%2E+In+Proceedings+of+The+12th+Intern)
17. Gilbert Badaro, Hazem Hajj, and Nizar Habash. 2020. A Link Prediction Approach for Accurately Mapping a Large-scale Arabic Lexical Resource to English WordNet. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 19, 6 (2020), 1–38. [find](https://scholar.google.com/scholar?q=Gilbert+Badaro%2C+Hazem+Hajj%2C+and+Nizar+Habash%2E+2020%2E+A+Link+Prediction+Approach+for+Accurately+Mapping+a+Large%2Dscale+Arabic+Lexical+Resource+to+English+WordNet%2E+ACM+Transactions+on+Asian+and+Low%2DResour)
18. Fady Baly, Hazem Hajj, et al. 2020. AraBERT: Transformer-based Model for Arabic Language Understanding. In Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection. 9–15. [our card](https://md.research.elamur.ai/free/en/papers/antoun-2020-arabert-transformer-based-model-arabic/)
19. Ramy Baly, Gilbert Badaro, Georges El-Khoury, Rawan Moukalled, Rita Aoun, Hazem Hajj, Wassim El-Hajj, Nizar Habash, and Khaled Shaban. 2017. A characterization study of arabic twitter data with a benchmarking for state-of-the-art opinion mining models. In Proceedings of the third Arabic natural language processing workshop. 110–118. [find](https://scholar.google.com/scholar?q=Ramy+Baly%2C+Gilbert+Badaro%2C+Georges+El%2DKhoury%2C+Rawan+Moukalled%2C+Rita+Aoun%2C+Hazem+Hajj%2C+Wassim+El%2DHajj%2C+Nizar+Habash%2C+and+Khaled+Shaban%2E+2017%2E+A+characterization+study+of+arabic+twitter+data+with+a+benc)
20. Ramy Baly, Gilbert Badaro, Ali Hamdi, Rawan Moukalled, Rita Aoun, Georges El-Khoury, Ahmad Al Sallab, Hazem Hajj, Nizar Habash, Khaled Shaban, et al. 2017. Omam at semeval-2017 task 4: Evaluation of english state-of-the-art sentiment analysis models for arabic and a new topic-based model. In Proceedings of the 11th international workshop on semantic evaluation (SEMEVAL-2017). 603–610. [find](https://scholar.google.com/scholar?q=Ramy+Baly%2C+Gilbert+Badaro%2C+Ali+Hamdi%2C+Rawan+Moukalled%2C+Rita+Aoun%2C+Georges+El%2DKhoury%2C+Ahmad+Al+Sallab%2C+Hazem+Hajj%2C+Nizar+Habash%2C+Khaled+Shaban%2C+et+al%2E+2017%2E+Omam+at+semeval%2D2017+task+4%3A+Evaluation+of+e)
21. Ramy Baly, Hazem Hajj, Nizar Habash, Khaled Bashir Shaban, and Wassim El-Hajj. 2017. A sentiment treebank and morphologically enriched recursive deep models for effective sentiment analysis in arabic. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 16, 4 (2017), 23. [find](https://scholar.google.com/scholar?q=Ramy+Baly%2C+Hazem+Hajj%2C+Nizar+Habash%2C+Khaled+Bashir+Shaban%2C+and+Wassim+El%2DHajj%2E+2017%2E+A+sentiment+treebank+and+morphologically+enriched+recursive+deep+models+for+effective+sentiment+analysis+in+arabic%2E)
22. Majdi Beseiso and Haytham Elmousalami. 2020. Subword attentive model for Arabic sentiment analysis: A deep learning approach. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 19, 2 (2020), 1–17. [find](https://scholar.google.com/scholar?q=Majdi+Beseiso+and+Haytham+Elmousalami%2E+2020%2E+Subword+attentive+model+for+Arabic+sentiment+analysis%3A+A+deep+learning+approach%2E+ACM+Transactions+on+Asian+and+Low%2DResource+Language+Information+Processing)
23. Naaima Boudad, Rdouan Faizi, Rachid Oulad Haj Thami, and Raddouane Chiheb. 2017. Sentiment analysis in Arabic: A review of the literature. Ain Shams Engineering Journal (2017). [find](https://scholar.google.com/scholar?q=Naaima+Boudad%2C+Rdouan+Faizi%2C+Rachid+Oulad+Haj+Thami%2C+and+Raddouane+Chiheb%2E+2017%2E+Sentiment+analysis+in+Arabic%3A+A+review+of+the+literature%2E+Ain+Shams+Engineering+Journal+%282017%29%2E)
24. Leo Breiman. 2001. Random forests. Machine learning 45, 1 (2001), 5–32. [find](https://scholar.google.com/scholar?q=Leo+Breiman%2E+2001%2E+Random+forests%2E+Machine+learning+45%2C+1+%282001%29%2C+5%E2%80%9332%2E)
25. Kyunghyun Cho, Bart Van Merriënboer, Dzmitry Bahdanau, and Yoshua Bengio. 2014. On the properties of neural machine translation: Encoder-decoder approaches. arXiv preprint arXiv:1409.1259 (2014). [↗](https://arxiv.org/abs/1409.1259) [our card](https://md.research.elamur.ai/free/en/papers/cho-2014-properties-neural-machine-translation-encoder/)
26. Jesse Davis and Mark Goadrich. 2006. The relationship between Precision-Recall and ROC curves. In Proceedings of the 23rd international conference on Machine learning. ACM, 233–240. [find](https://scholar.google.com/scholar?q=Jesse+Davis+and+Mark+Goadrich%2E+2006%2E+The+relationship+between+Precision%2DRecall+and+ROC+curves%2E+In+Proceedings+of+the+23rd+international+conference+on+Machine+learning%2E+ACM%2C+233%E2%80%93240%2E)
27. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018). [↗](https://arxiv.org/abs/1810.04805) [our card](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/)
28. Hai Ha Dohaiha, PWC Prasad, Angelika Maag, and Abeer Alsadoon. 2018. Deep learning for aspect-based sentiment analysis: a comparative review. Expert Systems With Applications (2018). [find](https://scholar.google.com/scholar?q=Hai+Ha+Dohaiha%2C+PWC+Prasad%2C+Angelika+Maag%2C+and+Abeer+Alsadoon%2E+2018%2E+Deep+learning+for+aspect%2Dbased+sentiment+analysis%3A+a+comparative+review%2E+Expert+Systems+With+Applications+%282018%29%2E)
29. Omar Einea, Ashraf Elnagar, and Ridhwan Al Debsi. 2019. Sanad: Single-label arabic news articles dataset for automatic text categorization. Data in brief 25 (2019), 104076. [find](https://scholar.google.com/scholar?q=Omar+Einea%2C+Ashraf+Elnagar%2C+and+Ridhwan+Al+Debsi%2E+2019%2E+Sanad%3A+Single%2Dlabel+arabic+news+articles+dataset+for+automatic+text+categorization%2E+Data+in+brief+25+%282019%29%2C+104076%2E)
30. Obeida ElJundi, Wissam Antoun, Nour El Droubi, Hazem Hajj, Wassim El-Hajj, and Khaled Shaban. 2019. hulmona: The universal language model in arabic. In Proceedings of the Fourth Arabic Natural Language Processing Workshop. 68–77. [find](https://scholar.google.com/scholar?q=Obeida+ElJundi%2C+Wissam+Antoun%2C+Nour+El+Droubi%2C+Hazem+Hajj%2C+Wassim+El%2DHajj%2C+and+Khaled+Shaban%2E+2019%2E+hulmona%3A+The+universal+language+model+in+arabic%2E+In+Proceedings+of+the+Fourth+Arabic+Natural+Languag)
31. Ashraf Elnagar. 2016. Investigation on sentiment analysis for Arabic reviews. In 2016 IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA). IEEE, 1–7. [find](https://scholar.google.com/scholar?q=Ashraf+Elnagar%2E+2016%2E+Investigation+on+sentiment+analysis+for+Arabic+reviews%2E+In+2016+IEEE%2FACS+13th+International+Conference+of+Computer+Systems+and+Applications+%28AICCSA%29%2E+IEEE%2C+1%E2%80%937%2E)
32. Ashraf Elnagar, Ridhwan Al-Debsi, and Omar Einea. 2020. Arabic text classification using deep learning models. Information Processing & Management 57, 1 (2020), 102121. [find](https://scholar.google.com/scholar?q=Ashraf+Elnagar%2C+Ridhwan+Al%2DDebsi%2C+and+Omar+Einea%2E+2020%2E+Arabic+text+classification+using+deep+learning+models%2E+Information+Processing+%26+Management+57%2C+1+%282020%29%2C+102121%2E)
33. Ashraf Elnagar and Omar Einea. 2016. BRAD 1.0: Book reviews in Arabic dataset. In 2016 IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA). 1–8. [find](https://scholar.google.com/scholar?q=Ashraf+Elnagar+and+Omar+Einea%2E+2016%2E+BRAD+1%2E0%3A+Book+reviews+in+Arabic+dataset%2E+In+2016+IEEE%2FACS+13th+International+Conference+of+Computer+Systems+and+Applications+%28AICCSA%29%2E+1%E2%80%938%2E)
34. Ashraf Elnagar, Yasmin S Khalifa, and Anas Einea. 2018. Hotel Arabic-reviews dataset construction for sentiment analysis applications. In Intelligent Natural Language Processing: Trends and Applications. Springer, 35–52. [find](https://scholar.google.com/scholar?q=Ashraf+Elnagar%2C+Yasmin+S+Khalifa%2C+and+Anas+Einea%2E+2018%2E+Hotel+Arabic%2Dreviews+dataset+construction+for+sentiment+analysis+applications%2E+In+Intelligent+Natural+Language+Processing%3A+Trends+and+Applicatio)
35. Ashraf Elnagar, Leena Lulu, and Omar Einea. 2018. An Annotated Huge Dataset for Standard and Colloquial Arabic Reviews for Subjective Sentiment Analysis. Procedia computer science 142 (2018), 182–189. [find](https://scholar.google.com/scholar?q=Ashraf+Elnagar%2C+Leena+Lulu%2C+and+Omar+Einea%2E+2018%2E+An+Annotated+Huge+Dataset+for+Standard+and+Colloquial+Arabic+Reviews+for+Subjective+Sentiment+Analysis%2E+Procedia+computer+science+142+%282018%29%2C+182%E2%80%93189%2E)
36. Ashraf Elnagar, Sane M Yagi, Ali Bou Nassif, Ismail Shahin, and Said A Salloum. 2021. Systematic Literature Review of Dialectal Arabic: Identification and Detection. IEEE Access 9 (2021), 31010–31042. Manuscript submitted to ACM [find](https://scholar.google.com/scholar?q=Ashraf+Elnagar%2C+Sane+M+Yagi%2C+Ali+Bou+Nassif%2C+Ismail+Shahin%2C+and+Said+A+Salloum%2E+2021%2E+Systematic+Literature+Review+of+Dialectal+Arabic%3A+Identification+and+Detection%2E+IEEE+Access+9+%282021%29%2C+31010%E2%80%9331042%2E)
37. Yoav Freund and Robert E Schapire. 1997. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of computer and system sciences 55, 1 (1997), 119–139. [find](https://scholar.google.com/scholar?q=Yoav+Freund+and+Robert+E+Schapire%2E+1997%2E+A+decision%2Dtheoretic+generalization+of+on%2Dline+learning+and+an+application+to+boosting%2E+Journal+of+computer+and+system+sciences+55%2C+1+%281997%29%2C+119%E2%80%93139%2E)
38. Yoav Freund, Robert E Schapire, et al. 1996. Experiments with a new boosting algorithm. In icml, Vol. 96. Citeseer, 148–156. [find](https://scholar.google.com/scholar?q=Yoav+Freund%2C+Robert+E+Schapire%2C+et+al%2E+1996%2E+Experiments+with+a+new+boosting+algorithm%2E+In+icml%2C+Vol%2E+96%2E+Citeseer%2C+148%E2%80%93156%2E)
39. Edmund A Gehan. 1965. A generalized Wilcoxon test for comparing arbitrarily singly-censored samples. Biometrika 52, 1-2 (1965), 203–224. [find](https://scholar.google.com/scholar?q=Edmund+A+Gehan%2E+1965%2E+A+generalized+Wilcoxon+test+for+comparing+arbitrarily+singly%2Dcensored+samples%2E+Biometrika+52%2C+1%2D2+%281965%29%2C+203%E2%80%93224%2E)
40. Edouard Grave, Piotr Bojanowski, Prakhar Gupta, Armand Joulin, and Tomas Mikolov. 2018. Learning Word Vectors for 157 Languages. In Proceedings of the International Conference on Language Resources and Evaluation (LREC 2018). [our card](https://md.research.elamur.ai/free/en/papers/grave-2018-learning-word-vectors-157-languages/)
41. Klaus Greff, Rupesh K Srivastava, Jan Koutník, Bas R Steunebrink, and Jürgen Schmidhuber. 2016. LSTM: A search space odyssey. IEEE transactions on neural networks and learning systems 28, 10 (2016), 2222–2232. [find](https://scholar.google.com/scholar?q=Klaus+Greff%2C+Rupesh+K+Srivastava%2C+Jan+Koutn%C3%ADk%2C+Bas+R+Steunebrink%2C+and+J%C3%BCrgen+Schmidhuber%2E+2016%2E+LSTM%3A+A+search+space+odyssey%2E+IEEE+transactions+on+neural+networks+and+learning+systems+28%2C+10+%282016%29%2C+2)
42. Ali Hamdi, Khaled Shaban, and Anazida Zainal. 2018. Clasenti: A class-specific sentiment analysis framework. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 17, 4 (2018), 1–28. [find](https://scholar.google.com/scholar?q=Ali+Hamdi%2C+Khaled+Shaban%2C+and+Anazida+Zainal%2E+2018%2E+Clasenti%3A+A+class%2Dspecific+sentiment+analysis+framework%2E+ACM+Transactions+on+Asian+and+Low%2DResource+Language+Information+Processing+%28TALLIP%29+17%2C+4+%28)
43. Sepp Hochreiter and Jurgen Schmidhuber. 1996. Bridging long time lags by weight guessing and “Long Short-Term Memory”. Spatiotemporal models in biological and artificial systems 37, 65-72 (1996), 11. [find](https://scholar.google.com/scholar?q=Sepp+Hochreiter+and+Jurgen+Schmidhuber%2E+1996%2E+Bridging+long+time+lags+by+weight+guessing+and+%E2%80%9CLong+Short%2DTerm+Memory%E2%80%9D%2E+Spatiotemporal+models+in+biological+and+artificial+systems+37%2C+65%2D72+%281996%29%2C+11%2E)
44. Rafal Jozefowicz, Wojciech Zaremba, and Ilya Sutskever. 2015. An empirical exploration of recurrent network architectures. In International Conference on Machine Learning. 2342–2350. [find](https://scholar.google.com/scholar?q=Rafal+Jozefowicz%2C+Wojciech+Zaremba%2C+and+Ilya+Sutskever%2E+2015%2E+An+empirical+exploration+of+recurrent+network+architectures%2E+In+International+Conference+on+Machine+Learning%2E+2342%E2%80%932350%2E)
45. Jawad Khan, Aftab Alam, Jamil Hussain, and Young-Koo Lee. 2019. EnSWF: effective features extraction and selection in conjunction with ensemble learning methods for document sentiment classification. Applied Intelligence (2019), 1–23. [find](https://scholar.google.com/scholar?q=Jawad+Khan%2C+Aftab+Alam%2C+Jamil+Hussain%2C+and+Young%2DKoo+Lee%2E+2019%2E+EnSWF%3A+effective+features+extraction+and+selection+in+conjunction+with+ensemble+learning+methods+for+document+sentiment+classification%2E+)
46. Yoon Kim. 2014. Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882 (2014). [↗](https://arxiv.org/abs/1408.5882) [our card](https://md.research.elamur.ai/free/en/papers/kim-2014-convolutional-neural-networks-sentence-classification/)
47. Yann LeCun, D Touresky, G Hinton, and T Sejnowski. 1988. A theoretical framework for back-propagation. In Proceedings of the 1988 connectionist models summer school, Vol. 1. CMU, Pittsburgh, Pa: Morgan Kaufmann, 21–28. [find](https://scholar.google.com/scholar?q=Yann+LeCun%2C+D+Touresky%2C+G+Hinton%2C+and+T+Sejnowski%2E+1988%2E+A+theoretical+framework+for+back%2Dpropagation%2E+In+Proceedings+of+the+1988+connectionist+models+summer+school%2C+Vol%2E+1%2E+CMU%2C+Pittsburgh%2C+Pa%3A+Morga)
48. Lin Li, Tiong-Thye Goh, and Dawei Jin. 2018. How textual quality of online reviews affect classification performance: a case of deep learning sentiment analysis. Neural Computing and Applications (2018), 1–29. [find](https://scholar.google.com/scholar?q=Lin+Li%2C+Tiong%2DThye+Goh%2C+and+Dawei+Jin%2E+2018%2E+How+textual+quality+of+online+reviews+affect+classification+performance%3A+a+case+of+deep+learning+sentiment+analysis%2E+Neural+Computing+and+Applications+%28201)
49. Andy Liaw, Matthew Wiener, et al. 2002. Classification and regression by randomForest. R news 2, 3 (2002), 18–22. [find](https://scholar.google.com/scholar?q=Andy+Liaw%2C+Matthew+Wiener%2C+et+al%2E+2002%2E+Classification+and+regression+by+randomForest%2E+R+news+2%2C+3+%282002%29%2C+18%E2%80%9322%2E)
50. Weibo Liu, Zidong Wang, Xiaohui Liu, Nianyin Zeng, Yurong Liu, and Fuad E Alsaadi. 2017. A survey of deep neural network architectures and their applications. Neurocomputing 234 (2017), 11–26. [find](https://scholar.google.com/scholar?q=Weibo+Liu%2C+Zidong+Wang%2C+Xiaohui+Liu%2C+Nianyin+Zeng%2C+Yurong+Liu%2C+and+Fuad+E+Alsaadi%2E+2017%2E+A+survey+of+deep+neural+network+architectures+and+their+applications%2E+Neurocomputing+234+%282017%29%2C+11%E2%80%9326%2E)
51. Leena Lulu and Ashraf Elnagar. 2018. Automatic Arabic Dialect Classification Using Deep Learning Models. Procedia Computer Science 142 (2018), 262 – 269. [find](https://scholar.google.com/scholar?q=Leena+Lulu+and+Ashraf+Elnagar%2E+2018%2E+Automatic+Arabic+Dialect+Classification+Using+Deep+Learning+Models%2E+Procedia+Computer+Science+142+%282018%29%2C+262+%E2%80%93+269%2E)
52. Gjorgji Madjarov, Dragi Kocev, Dejan Gjorgjevikj, and Sašo Džeroski. 2012. An extensive experimental comparison of methods for multi-label learning. Pattern recognition 45, 9 (2012), 3084–3104. [find](https://scholar.google.com/scholar?q=Gjorgji+Madjarov%2C+Dragi+Kocev%2C+Dejan+Gjorgjevikj%2C+and+Sa%C5%A1o+D%C5%BEeroski%2E+2012%2E+An+extensive+experimental+comparison+of+methods+for+multi%2Dlabel+learning%2E+Pattern+recognition+45%2C+9+%282012%29%2C+3084%E2%80%933104%2E)
53. Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013). [↗](https://arxiv.org/abs/1301.3781) [our card](https://md.research.elamur.ai/free/en/papers/mikolov-2013-efficient-estimation-word-representations-vector/)
54. Saif Mohammad, Felipe Bravo-Marquez, Mohammad Salameh, and Svetlana Kiritchenko. 2018. Semeval-2018 task 1: Affect in tweets. In Proceedings of the 12th international workshop on semantic evaluation. 1–17. [our card](https://md.research.elamur.ai/free/en/papers/mohammad-2018-semeval-2018-task-1-affect/)
55. Ali Bou Nassif, Ashraf Elnagar, Ismail Shahin, and Safaa Henno. 2020. Deep learning for Arabic subjective sentiment analysis: Challenges and research opportunities. Applied Soft Computing (2020), 106836. [find](https://scholar.google.com/scholar?q=Ali+Bou+Nassif%2C+Ashraf+Elnagar%2C+Ismail+Shahin%2C+and+Safaa+Henno%2E+2020%2E+Deep+learning+for+Arabic+subjective+sentiment+analysis%3A+Challenges+and+research+opportunities%2E+Applied+Soft+Computing+%282020%29%2C+1068)
56. Andrew Ng. 2015. What data scientists should know about deep learning. URL [https://www.slideshare](https://www.slideshare). net/ExtractConf 44 (2015). [↗](https://www.slideshare)
57. Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 1532–1543. [our card](https://md.research.elamur.ai/free/en/papers/pennington-2014-glove-global-vectors-word-representation/)
58. F Rosenblatt. 1960. Perceptrons and the Theory of Brain Mechanisms: Cornell Aeronautical Laboratory. Technical Report. Report No. VG-1196-G-8. [find](https://scholar.google.com/scholar?q=F+Rosenblatt%2E+1960%2E+Perceptrons+and+the+Theory+of+Brain+Mechanisms%3A+Cornell+Aeronautical+Laboratory%2E+Technical+Report%2E+Report+No%2E+VG%2D1196%2DG%2D8%2E)
59. S Rasoul Safavian and David Landgrebe. 1991. A survey of decision tree classifier methodology. IEEE transactions on systems, man, and cybernetics 21, 3 (1991), 660–674. [find](https://scholar.google.com/scholar?q=S+Rasoul+Safavian+and+David+Landgrebe%2E+1991%2E+A+survey+of+decision+tree+classifier+methodology%2E+IEEE+transactions+on+systems%2C+man%2C+and+cybernetics+21%2C+3+%281991%29%2C+660%E2%80%93674%2E)
60. Jürgen Schmidhuber. 2015. Deep learning in neural networks: An overview. Neural networks 61 (2015), 85–117. [find](https://scholar.google.com/scholar?q=J%C3%BCrgen+Schmidhuber%2E+2015%2E+Deep+learning+in+neural+networks%3A+An+overview%2E+Neural+networks+61+%282015%29%2C+85%E2%80%93117%2E)
61. Amira Shoukry and Ahmed Rafea. 2012. Sentence-level Arabic sentiment analysis. In 2012 International Conference on Collaboration Technologies and Systems (CTS). IEEE, 546–550. [find](https://scholar.google.com/scholar?q=Amira+Shoukry+and+Ahmed+Rafea%2E+2012%2E+Sentence%2Dlevel+Arabic+sentiment+analysis%2E+In+2012+International+Conference+on+Collaboration+Technologies+and+Systems+%28CTS%29%2E+IEEE%2C+546%E2%80%93550%2E)
62. Mohammad Tubishat, Mohammad AM Abushariah, Norisma Idris, and Ibrahim Aljarah. 2019. Improved whale optimization algorithm for feature selection in Arabic sentiment analysis. Applied Intelligence 49, 5 (2019), 1688–1707. [find](https://scholar.google.com/scholar?q=Mohammad+Tubishat%2C+Mohammad+AM+Abushariah%2C+Norisma+Idris%2C+and+Ibrahim+Aljarah%2E+2019%2E+Improved+whale+optimization+algorithm+for+feature+selection+in+Arabic+sentiment+analysis%2E+Applied+Intelligence+49%2C+)
63. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998–6008. [our card](https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/)