--- title: "Sentiment Analysis of Arabic Tweets Using Large Language" description: "The paper looks at binary (positive vs. negative) sentiment classification of Arabic tweets, a setting made… 85.98% accuracy. 2 references." authors: ["Pankaj Dadure", "Ananya Dixit", "Kunal Tewatia", "Nandini Paliwal", "Anshika Malla"] year: 2025 venue: "Proceedings of the 1st Workshop on NLP for Languages Using Arabic Script" source: "https://aclanthology.org/2025.abjadnlp-1.10/" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/dadure-2025-sentiment-analysis-arabic-tweets-large/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/dadure-2025-sentiment-analysis-arabic-tweets-large/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2025](https://md.research.elamur.ai/free/en/papers/2025/page/18/) / Sentiment Analysis of Arabic Tweets Using Large Language Models # Sentiment Analysis of Arabic Tweets Using Large Language Models **Authors:** Pankaj Dadure, Ananya Dixit, Kunal Tewatia, Nandini Paliwal and Anshika Malla · **Year:** 2025 · **Venue:** [Proceedings of the 1st Workshop on NLP for Languages Using Arabic Script](https://md.research.elamur.ai/free/en/venues/abjadnlp/) ([Workshop on NLP for Languages Using Arabic Script 2025](https://md.research.elamur.ai/free/en/venues/abjadnlp/2025/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2025.abjadnlp-1.10/) · [PDF](https://aclanthology.org/2025.abjadnlp-1.10.pdf) ## Summary The paper looks at binary (positive vs. negative) sentiment classification of Arabic tweets, a setting made hard by dialect variety, rich morphology, informal spelling and Arabic–English code-switching. The authors use the Kaggle "Arabic Sentiment Twitter Corpus" and apply standard cleaning: removing punctuation, dates and times, tokenizing, and dropping stopwords. They then turn each tweet into a fixed sentence vector using three pretrained encoders: MiniLM-L12-v2, Universal Sentence Encoder (USE) and XLM-R base. These vectors feed five classical classifiers. Despite the "fine tuning" framing, the encoders are used frozen, as feature extractors. The central experiment runs every encoder–classifier pair twice, once with emojis kept and once with them removed. Keeping emojis helps every encoder. The best result, 85.98% accuracy, comes from MiniLM embeddings with Random Forest on the emoji-preserving data; XLM-R base peaks at 78.98% without emojis. The work is a simple baseline, but it shows that preprocessing choices about non-word symbols can matter as much as the choice of encoder. ## Key points - **Data:** "Arabic Sentiment Twitter Corpus" (Kaggle), 56,795 tweets, nearly balanced at 28,513 positive and 28,282 negative, collected 31 March – 29 April 2019. It contains emojis, code-mixed Arabic/English and informal writing. - **Encoders:** MiniLM-L12-v2 (384-dim sentence vector), USE (512-dim), and XLM-R base (sentence vector from mean pooling of last-layer token states). All are used as frozen feature extractors. - **Classifiers:** Logistic Regression, SVM, Random Forest, Decision Tree and KNN. Each is evaluated on accuracy, F1, precision and recall. - **Headline results:** - Best overall: MiniLM + Random Forest with emojis, 85.98%. - With emojis, XLM-R + Random Forest reaches 82.48%. - Without emojis, XLM-R's best is 78.98%. - Random Forest is reported as the strongest classifier across encoders, though the paper's prose and tables are not fully consistent on some rankings. - **USE ranks lowest:** the authors blame its general-purpose similarity training and thin Arabic coverage, but note that emojis partly compensate. ## Interesting ideas - **Same pipeline, one input class removed:** Running the identical pipeline with and without one kind of input (here emojis) isolates how much signal that kind carries, more cleanly than comparing different systems. - **Non-word symbols as content:** Emojis are treated as meaningful tokens rather than noise to clean away, because they often carry the polarity of a short informal text. - **Encoder × classifier grid as a probe:** Pairing frozen encoders with simple classifiers is a cheap way to ask how much of a task is linearly or shallowly recoverable from each representation. - **Explicit cue as a fallback:** USE improved notably once emojis were present, suggesting that explicit surface cues can rescue a weak semantic model on short texts. ## For Mova How these ideas could serve Mova, our small open language model — its files, stages and tests: - **I1** (learn): Use single-feature ablations as negative controls, e.g. rerun an evaluation with punctuation, emoticons or casing stripped to measure what each step actually depends on. - **I2** (tokens): Keep emojis and emoticons as distinct tokens with their own tag and lemma, so later stages can see them instead of losing them in normalization. - **I3** (learn): Probe gparse's internal states with simple classifiers for properties like polarity or speech act, as a quick diagnostic of what the parser representation already encodes. - **I4** (frames): When the parse-based reading of attitude or irony is uncertain, an emoji or emoticon attached to the clause could serve as an explainable, separately logged cue for the speaker's stance. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* 📚 Shelves (2): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works 🧭 Topics (2): [😊 Sentiment & emotion](https://md.research.elamur.ai/free/en/topics/sentiment-emotion/) · 1,035 works · [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 3,066 works ## Cite Cite as: Pankaj Dadure, Ananya Dixit, Kunal Tewatia, Nandini Paliwal and Anshika Malla. 2025. Sentiment Analysis of Arabic Tweets Using Large Language Models. Proceedings of the 1st Workshop on NLP for Languages Using Arabic Script. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{dadure2025sentiment, title = {{Sentiment Analysis of Arabic Tweets Using Large Language Models}}, author = {Pankaj Dadure, Ananya Dixit, Kunal Tewatia, Nandini Paliwal and Anshika Malla}, booktitle = {Proceedings of the 1st Workshop on NLP for Languages Using Arabic Script}, year = {2025}, url = {https://aclanthology.org/2025.abjadnlp-1.10/} } ``` - [← previous Sentence Alignment of Ancient and Modern Chinese Based on Reinforcement Learning](https://md.research.elamur.ai/free/en/papers/yu-2025-sentence-alignment-ancient/) - [next → Shakespeare, Entropy and Educated Monkeys](https://md.research.elamur.ai/free/en/papers/kontoyiannis-2025-shakespeare-entropy-educated-monkeys/) - [↑ back to papers of 2025](https://md.research.elamur.ai/free/en/papers/2025/page/18/) ## References 2 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Muhammad Abdul-Mageed, Mona Diab, and Sandra Kübler. 2014. Samar: Subjectivity and sentiment analysis for arabic social media. Computer Speech & Language, 28(1):20–37. [↗](https://doi.org/10.1016/j.csl.2013.03.001) 2. Mahmoud Al-Ayyoub, Safa Bani Essa, and Izzat Alsmadi. 2015. Lexicon-based sentiment analysis of *Figure 5: Pictorial representation of the proposed system architecture which rely on three LLM models: XLMR-Base, USE, MiniLM for sentiment classification.* [find](https://scholar.google.com/scholar?q=Mahmoud+Al%2DAyyoub%2C+Safa+Bani+Essa%2C+and+Izzat+Alsmadi%2E+2015%2E+Lexicon%2Dbased+sentiment+analysis+of+%2AFigure+5%3A+Pictorial+representation+of+the+proposed+system+architecture+which+rely+on+three+LLM+models%3A+) *Updated 2 November 2026*