--- title: "SDNLP at AMIYA 2026: Syrian Arabic Dialect Modeling with LoRA" description: "Large language models are trained mostly on Modern Standard Arabic (MSA), so when asked for spoken dialect they tend to… 4 references." authors: ["Hasan Alkhder", "Mohammad Abboush"] year: 2026 venue: "Proceedings of the 13th Workshop on NLP for Similar Languages, Varieties and Dialects" source: "https://aclanthology.org/2026.vardial-1.29/" doi: "10.18653/v1/2026.vardial-1.29" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/alkhder-2026-sdnlp-amiya-2026-syrian-arabic/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/alkhder-2026-sdnlp-amiya-2026-syrian-arabic/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/9/) / SDNLP at AMIYA 2026: Syrian Arabic Dialect Modeling with LoRA # SDNLP at AMIYA 2026: Syrian Arabic Dialect Modeling with LoRA **Authors:** Hasan Alkhder and Mohammad Abboush · **Year:** 2026 · **Venue:** [Proceedings of the 13th Workshop on NLP for Similar Languages, Varieties and Dialects](https://md.research.elamur.ai/free/en/venues/vardial/) ([VarDial 2026](https://md.research.elamur.ai/free/en/venues/vardial/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.vardial-1.29/) · [PDF](https://aclanthology.org/2026.vardial-1.29.pdf) · [DOI 10.18653/v1/2026.vardial-1.29](https://doi.org/10.18653/v1/2026.vardial-1.29) · [OpenAlex](https://openalex.org/W7140133193) **Citations:** 0 citations (OpenAlex, 2026-10-14) ## Summary Large language models are trained mostly on Modern Standard Arabic (MSA), so when asked for spoken dialect they tend to drift back into the formal register. Built for the AMIYA 2026 shared task's Syrian Arabic track (Open Track), this system approaches the problem as dialect modeling rather than factual QA. It favors natural colloquial output over literal faithfulness, in line with the AL-QASIDA evaluation framework. The authors fine-tuned the base Meta-Llama-3.1-8B with LoRA adapters on about 30,000 professionally dubbed TV dialogue turns supplied by the company NIS. Each turn is aligned across English, MSA and Syrian Arabic. At inference they added prompt constraints that require exactly one Syrian Arabic sentence with no explanations. In the official human evaluation, fluency (2.928) was far higher than adequacy (1.124). This reflects the chosen trade-off. Side-by-side outputs show the adapted model giving shorter, more conversational replies than the base model. The work suggests that light adaptation on high-quality, register-aligned data can shift a model toward a spoken variety at low cost. ## Key points - Backbone: Meta-Llama-3.1-8B (base, not instruct), frozen. LoRA settings: - adapters on q_proj, k_proj, v_proj and o_proj; - rank 16, alpha 32, dropout 0.05; - 1.5 epochs with AdamW at lr 2e-4 and effective batch 32 (4 × 8 accumulation); - 8-bit loading with FP16 mixed precision. - Data: about 30k dubbing utterances in a table with the fields character, gender, english, arabic_msa and arabic_syrian. Average lengths are roughly 9.6 words (Syrian), 8.8 (MSA) and 9.9 (English). No official task data or other corpora (e.g., UFAL) were used. - Human evaluation: Adequacy 1.124, Fluency 2.928. - Automatic evaluation (chrF/chrF++ per AL-QASIDA): - ADI2: 0.280; - DA→ENG: 36.211; - ENG→DA: 14.813; - DA→MSA: 6.743; - MSA→DA: 15.609. - The single-sentence output constraint came from informal preliminary observation, not an ablation. Qualitative comparison rests on four example prompts run against the base model with identical prompts. ## Interesting ideas - Training on three-way aligned text (source language, formal register, colloquial register) lets the model see register contrast directly rather than infer it. - Keeping one frozen backbone and swapping small per-variety adapters makes dialect extension cheap and modular. - Hard output-shape constraints in the prompt (one sentence, no meta-commentary) made model outputs shorter and more predictable. - Scoring fluency and adequacy as separate axes exposes a deliberate trade-off that a single score would hide. - Running the base and adapted model under identical prompts isolates the effect of adaptation from prompt wording. ## For Mova How these ideas could serve Mova, our small open language model — its files, stages and tests: - **I1** (back): Generation could keep parallel formal/plain/colloquial realizations of the same meaning graph and learn register choice as a controllable switch instead of a side effect. - **I2** (tree): gparse could carry per-genre or per-UD-dialect adapters (e.g., spoken vs. written treebanks) on a shared encoder, retraining only the small part when a new variety appears. - **I3** (learn): LLM teacher tiers could receive strict single-answer formats so silver labels parse reliably and verbose drift is cut before it enters training data. - **I4** (learn): Evaluation of generated or repaired outputs should report form-quality and meaning-preservation separately, so a fluent but wrong output is not counted as progress. - **I5** (learn): Each trained component could be checked against its untrained baseline on the same inputs, serving as a simple negative control for claimed gains. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [Clausthal University of Technology](https://md.research.elamur.ai/free/en/universities/clausthal-university-of-technology/) — University, Clausthal-Zellerfeld, Germany · 2 works · 150 citations Also on the byline: [Sakarya University](https://ror.org/04ttnw109). 📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,085 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,888 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works 🧭 Topics (1): [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 1,485 works ## Cite Cite as: Hasan Alkhder and Mohammad Abboush. 2026. SDNLP at AMIYA 2026: Syrian Arabic Dialect Modeling with LoRA. Proceedings of the 13th Workshop on NLP for Similar Languages, Varieties and Dialects. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{alkhder2026sdnlp, title = {{SDNLP at AMIYA 2026: Syrian Arabic Dialect Modeling with LoRA}}, author = {Hasan Alkhder and Mohammad Abboush}, booktitle = {Proceedings of the 13th Workshop on NLP for Similar Languages, Varieties and Dialects}, year = {2026}, doi = {10.18653/v1/2026.vardial-1.29}, url = {https://doi.org/10.18653/v1/2026.vardial-1.29} } ``` - [← previous Scripting History: A Diachronic Urdu Text and Image Corpus from the 18Th to 19Th Centuries](https://md.research.elamur.ai/free/en/papers/shams-2026-scripting-history-diachronic-urdu-text/) - [next → SearchLLM: Detecting LLM Paraphrased Text by Measuring the Similarity with Regeneration of the Candidate Source via Search Engine](https://md.research.elamur.ai/free/en/papers/son-2026-searchllm-detecting-llm-paraphrased-text/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/9/) ## References 4 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Edward J. Hu and 1 others. 2022. [Lora: Low-rank adaptation of large language models](https://md.research.elamur.ai/free/en/papers/hu-2021-lora-low-rank-adaptation-large/). In Proceedings of the International Conference on Learning Representations. 2. Nathaniel Robinson, Shahd Abdelmoneim, Anjali Kantharuban, Otba Alsboul, Salima Lamsiyah, Kelly Marchisio, and Kenton Murray. 2026. AMIYA shared task: Arabic Modeling In Your Accent at Var-Dial 2026. In Proceedings of the 13th Workshop on NLP for Similar Languages, Varieties and Dialects, Rabat, Morocco. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Nathaniel+Robinson%2C+Shahd+Abdelmoneim%2C+Anjali+Kantharuban%2C+Otba+Alsboul%2C+Salima+Lamsiyah%2C+Kelly+Marchisio%2C+and+Kenton+Murray%2E+2026%2E+AMIYA+shared+task%3A+Arabic+Modeling+In+Your+Accent+at+Var%2DDial+2026%2E+) 3. Nathaniel R. Robinson, Shahd Abdelmoneim, Anjali Kantharuban, Otba Alsboul, Salima Lamsiyah, Kelly Marchisio, and Kenton Murray. 2025. Al-qasida: Evaluating dialectal arabic in large language models. In Proceedings of the AL-QASIDA Shared Task. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Nathaniel+R%2E+Robinson%2C+Shahd+Abdelmoneim%2C+Anjali+Kantharuban%2C+Otba+Alsboul%2C+Salima+Lamsiyah%2C+Kelly+Marchisio%2C+and+Kenton+Murray%2E+2025%2E+Al%2Dqasida%3A+Evaluating+dialectal+arabic+in+large+language+models%2E+) 4. Hugo Touvron and 1 others. 2023. [Llama: Open and efficient foundation language models](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-open-efficient-foundation-language/). In Proceedings of the International Conference on Machine Learning. *Updated 24 October 2026*