--- title: "A Character Level Convolutional BiLSTM for Arabic Dialect" description: "The paper addresses fine-grained Arabic dialect identification at the level of Twitter… 72.6% accuracy. 2 references, cited by 3 papers here." authors: ["Mohamed Elaraby", "Ahmed Zahran"] year: 2019 venue: "Proceedings of the Fourth Arabic Natural Language Processing Workshop" source: "https://aclanthology.org/W19-4636/" doi: "10.18653/v1/w19-4636" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/elaraby-2019-character-level-convolutional-bilstm-arabic/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/elaraby-2019-character-level-convolutional-bilstm-arabic/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2019](https://md.research.elamur.ai/free/en/papers/2019/page/7/) / A Character Level Convolutional BiLSTM for Arabic Dialect Identification # A Character Level Convolutional BiLSTM for Arabic Dialect Identification **Authors:** [Mohamed Elaraby](https://md.research.elamur.ai/free/en/authors/mohamed-elaraby/) and Ahmed Zahran · **Year:** 2019 · **Venue:** [Proceedings of the Fourth Arabic Natural Language Processing Workshop](https://md.research.elamur.ai/free/en/venues/wanlp/) ([WANLP 2019](https://md.research.elamur.ai/free/en/venues/wanlp/2019/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/W19-4636/) · [PDF](https://aclanthology.org/W19-4636.pdf) · [DOI 10.18653/v1/w19-4636](https://doi.org/10.18653/v1/w19-4636) · [OpenAlex](https://openalex.org/W2970660698) **Citations:** 11 citations (OpenAlex, 2026-10-14) · [3](https://md.research.elamur.ai/free/en/papers/elaraby-2019-character-level-convolutional-bilstm-arabic/cited-by/) in our library, of the 149,439 papers whose bibliographies we read ## Summary The paper addresses fine-grained Arabic dialect identification at the level of Twitter users. Each user must be assigned one of 21 countries, which is harder than separating a few broad dialect groups because neighbouring dialects look very similar in writing. The CU-RAISA team built this system for MADAR shared task 2 (2019). They crawled the organizers' tweet IDs, removed URLs and mentions, and kept a character-only vocabulary. The model is a character-level network: parallel convolutions of many widths feed a BiLSTM, which ends in a softmax over the countries. The authors compared two ways of framing the input. One classifies each tweet separately, and the other joins all of a user's tweets into one long sequence. Joining the tweets worked far better, both for the neural models and for n-gram baselines. On the official test set the system placed 4th, with 61.5% F1-macro and 72.6% accuracy. The work shows that for author-level labels, giving the model the whole body of a user's text matters more than per-message tricks. ## Key points - Data came from the MADAR Twitter user dialect task. The official split was 2180 training users (217,593 tweets), 300 development users and 500 test users. Some timelines could not be retrieved, so the usable sets shrank to 2032, 281 and 463 users. - Preprocessing stripped URLs and user mentions. Characters seen fewer than 20 times were dropped, leaving a vocabulary of 2377 characters. - Architecture and training: - The model uses 50-dimensional randomly initialized character embeddings. - Convolutions have filter widths from 1 to 13 and between 10 and 150 filters, followed by a time-distributed layer. - The BiLSTM has 256 hidden units, and the softmax covers 21 classes. - Training used Adam for 40 epochs, with dropout 0.2 on the embeddings and L2 regularization of 0.002. - Two input framings were tested. Per-tweet inputs were capped at 140 characters, while concatenated user inputs reached up to 12,000 characters. - Development accuracy for C-BiLSTM rose from 51.7% on single tweets to 71.92% on concatenated tweets, and F1-macro rose from 42.3 to 62.21. Logistic regression and Multinomial Naive Bayes on 1–11 n-grams stayed below 47% even with concatenation. ## Interesting ideas - Feed the model input at the same granularity as the label: joining all of one author's messages beat voting over per-message predictions, because weak cues add up across texts. - A plain frequency cutoff on the character inventory keeps the vocabulary compact while preserving rare-but-real symbols that word models would miss. - Users with no retrievable data still had to receive a label, so the system gave them the most frequent class (Saudi Arabia); this makes the fallback an explicit, measurable part of the system. - Running the same n-gram baselines under both input framings separates the gain from the framing itself from the gain from the neural architecture. ## For Mova How these ideas could serve Mova, our small open language model — its files, stages and tests: - **I1** (frames): Document-wide judgments, such as irony or a narrator's stance, could be computed from all relevant clauses together rather than by voting over sentence-level calls. - **I2** (tokens): A character-level fallback with a frequency-pruned inventory could help the tagger and lemmatizer cope with misspellings, social-media spellings and unknown words. - **I3** (learn): Evaluations could report what share of the score comes from a majority-class fallback, using it as a negative control that real reasoning must clearly beat. - **I4** (learn): When a new component is added, rerunning simple baselines under the changed setup would show whether the improvement comes from the method or merely from richer input. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [Cairo University](https://md.research.elamur.ai/free/en/universities/cairo-university/) — University, Giza, Egypt · 42 works · 1,350 citations 📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works 🧭 Topics (1): [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 2,908 works ## Cite Cite as: Mohamed Elaraby and Ahmed Zahran. 2019. A Character Level Convolutional BiLSTM for Arabic Dialect Identification. Proceedings of the Fourth Arabic Natural Language Processing Workshop. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{elaraby2019character, title = {{A Character Level Convolutional BiLSTM for Arabic Dialect Identification}}, author = {Mohamed Elaraby and Ahmed Zahran}, booktitle = {Proceedings of the Fourth Arabic Natural Language Processing Workshop}, year = {2019}, doi = {10.18653/v1/w19-4636}, url = {https://doi.org/10.18653/v1/w19-4636} } ``` - [← previous Squared English Word: A Method of Generating Glyph to Use Super Characters for Sentiment Analysis](https://md.research.elamur.ai/free/en/papers/sun-2019-squared-english-word-method-generating/) - [next → An Annotated Corpus of Reference Resolution for Interpreting Common Grounding](https://md.research.elamur.ai/free/en/papers/udagawa-2019-annotated-corpus-reference-resolution-interpreting/) - [↑ back to papers of 2019](https://md.research.elamur.ai/free/en/papers/2019/page/7/) ## References 2 references, 2 of them with a card of ours. ↗ leads to the work. 1. Muhammad Abdul-Mageed, Hassan Alhuzali, and Mohamed Elaraby. 2018. [You tweet what you speak: A city-level dataset of arabic dialects](https://md.research.elamur.ai/free/en/papers/mageed-2018-you-tweet-what-you-speak/). In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC-2018). 2. Mohamed Ali. 2018. [Character level convolutional neural network for arabic dialect identification](https://md.research.elamur.ai/free/en/papers/ali-2018-character-level-convolutional-neural-network/). In Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial 2018), pages 122–127. *Updated 31 October 2026*