---
title: "ArbESC+: Arabic Enhanced Edit Selection — Alrehili 2025"
description: "Arabic grammatical error correction (GEC) is difficult because of rich inflection, inconsistent spelling conventions, complex syntax and scarce annotated…"
authors: ["Ahlam Alrehili", "Areej Alhothali"]
year: 2025
venue: "arXiv:2511.14230"
source: "https://arxiv.org/abs/2511.14230"
doi: "10.48550/arxiv.2511.14230"
arxiv: "2511.14230"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/alrehili-2025-arbesc-arabic-enhanced-edit-selection/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/alrehili-2025-arbesc-arabic-enhanced-edit-selection/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2025](https://md.research.elamur.ai/free/en/papers/2025/page/3/) / ArbESC+: Arabic Enhanced Edit Selection System Combination for Grammatical Error Correction Resolving conflict and improving system combination in Arabic GEC

# ArbESC+: Arabic Enhanced Edit Selection System Combination for Grammatical Error Correction Resolving conflict and improving system combination in Arabic GEC

**Authors:** [Ahlam Alrehili](https://md.research.elamur.ai/free/en/authors/ahlam-alrehili/), [Areej Alhothali](https://md.research.elamur.ai/free/en/authors/areej-alhothali/) · **Institutions:** [King Abdulaziz University](https://md.research.elamur.ai/free/en/universities/king-abdulaziz-university/) · **Year:** 2025 · **Venue:** arXiv:2511.14230 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2511.14230) · [PDF](https://arxiv.org/pdf/2511.14230) · [DOI 10.48550/arxiv.2511.14230](https://doi.org/10.48550/arxiv.2511.14230) · [arXiv 2511.14230](https://arxiv.org/abs/2511.14230) · [OpenAlex](https://openalex.org/W7106110082)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Arabic grammatical error correction (GEC) is difficult because of rich inflection, inconsistent spelling conventions, complex syntax and scarce annotated data. Earlier Arabic work mostly relied on single models or simple voting. The authors present ArbESC+, which they describe as the first system-combination framework for Arabic GEC. It pools corrections from nine systems. AraT5, ByT5, mT5 and AraBART were fine-tuned by the authors. Three AraBART+Morph+GEC variants and two text-editing variants were used off-the-shelf.

Every proposed micro-edit becomes a vector of numerical features. A classifier then decides, edit by edit, whether that edit is applied, which turns combination into binary classification. Extra steps filter overlapping or conflicting edits and estimate how reliable each decision is.

The combined system beats every individual model, reaching F0.5 of 82.63% on QALB-14, 84.64% on QALB-15 L1 and 65.55% on QALB-15 L2. An ARETA error-type analysis shows sharp drops in overcorrection. The approach is presented as transferable to other low-resource, morphologically complex languages.

## Key points
- Nine base systems are combined:
  - AraT5, ByT5, mT5 and AraBART, fine-tuned for this work;
  - AraBART+Morph+GEC trained on QALB-14, QALB-15 and ZAEBUC;
  - text-editing models trained on QALB-14 and ZAEBUC.
- Combination works at the micro-edit level: each candidate edit is featurized and receives an independent accept/reject decision from a classifier, followed by conflict filtering and a reliability estimate.
- Reported F0.5 is 82.63% (QALB-14), 84.64% (QALB-15 L1) and 65.55% (QALB-15 L2). The previous voting ensemble of Alhafni & Habash scored 81.7% on QALB-2014 and 82.9% on QALB-2015.
- In the ARETA per-tag comparison, ArbESC+ nearly matches the best single model on surface tags:
  - spelling: OA, OG, OW;
  - merge/split: MG, SP, XT.
  
  It lags on semantic and syntactic tags such as XG, MT and OR, most visibly on L2 learner data.
- Overcorrection-prone tags are cut sharply. PT and XT fall to very low counts, and PC and XM vanish entirely.

## Interesting ideas
- Rather than voting on whole output sentences, the method splits every system's output into atomic edits and lets a classifier accept or reject each one using features such as agreement among systems, which keeps the best fragments of each system. — For Mova (learn): Silver data built from several witness parsers could be decided arc by arc, with a small classifier over agreement features instead of a plain majority vote, and each arc decision stays explainable.
- Edits that overlap or contradict each other are resolved by an explicit filtering step before the final output is assembled, so incompatible choices from different systems never mix. — For Mova (tree): When arcs from different parsers are merged, a dedicated conflict-resolution pass could enforce tree well-formedness (a single head per token, no cycles) before the silver tree is accepted.
- The ensemble deliberately mixes system types with different biases: full-sentence seq2seq generators, byte-level ByT5, and edit-tagging models. Diversity of errors is what makes the combination pay off. — For Mova (learn): Witnesses should be chosen for differing error profiles, for example pairing the perceptron parser with gparse, rather than as several near-copies of one model.
- Overcorrection is measured directly, by counting errors of change-prone tags before and after correction, instead of relying only on aggregate F0.5. — For Mova (learn): Evaluation suites could include an "unnecessary change" counter as a negative control, for instance how often repair rules alter tokens that were already correct.
- Results are broken down by linguistic error category and by data source (native vs. learner), which shows where combination stops helping, namely deep semantic and syntactic errors. — For Mova (answer): Per-category reporting of reader failures, such as surface-cue questions versus ones needing deep inference, would show which stage to strengthen next.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/)

Topics: [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · [Grammatical error correction & learner language](https://md.research.elamur.ai/free/en/topics/grammatical-error-correction/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{alrehili2025arbesc,
  title = {{ArbESC+: Arabic Enhanced Edit Selection System Combination for Grammatical Error Correction Resolving conflict and improving system combination in Arabic GEC}},
  author = {Alrehili, Ahlam and Alhothali, Areej},
  year = {2025},
  doi = {10.48550/arxiv.2511.14230},
  eprint = {2511.14230},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2511.14230}
}
```

- [← previous AraToken: Optimizing Arabic Tokenization with Normalization Pipeline and Language Extension for Qwen3](https://md.research.elamur.ai/free/en/papers/kashirskiy-2025-aratoken-optimizing-arabic-tokenization-normalization/)
- [next → ArFake: A Robust Framework for Multi-Dialect Arabic Speech Spoofing Detection Benchmark](https://md.research.elamur.ai/free/en/papers/elsetohy-2025-arfake-robust-framework-multi-dialect/)
- [↑ back to papers of 2025](https://md.research.elamur.ai/free/en/papers/2025/page/3/)

## References

49 references, 15 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Mohamed Abdelrehim, Marwan Torki, and Nagwa El-Makky. Hybrid llm and rule-based synthetic data generation for arabic grammatical error correction. In 2025 International Conference on Machine Intelligence and Smart Innovation (ICMISI), pages 280–285. IEEE, 2025. [find](https://scholar.google.com/scholar?q=Mohamed+Abdelrehim%2C+Marwan+Torki%2C+and+Nagwa+El%2DMakky%2E+Hybrid+llm+and+rule%2Dbased+synthetic+data+generation+for+arabic+grammatical+error+correction%2E+In+2025+International+Conference+on+Machine+Intellige)
2. Ahmad Aiman, Rehab Duwairi, and Mahmoud Al-Ayyoub. Deep learning-based arabic grammatical error correction. International Journal of Arabic Linguistics, 2021. [find](https://scholar.google.com/scholar?q=Ahmad+Aiman%2C+Rehab+Duwairi%2C+and+Mahmoud+Al%2DAyyoub%2E+Deep+learning%2Dbased+arabic+grammatical+error+correction%2E+International+Journal+of+Arabic+Linguistics%2C+2021%2E)
3. Abdullah Alfaifi and Eric Atwell. Arabic learner corpora (alc): a taxonomy of coding errors. In The 8th International Computing Conference in Arabic, 2012. *Figure 9: Raw (gray) vs. ARBESC+ Fixed (blue) counts for frequent over-correction tags. PT/XT values are dataset averages; PC/XM use range midpoints (with error bars). PC and XM are not observed in the latest ARBESC+ run.* [find](https://scholar.google.com/scholar?q=Abdullah+Alfaifi+and+Eric+Atwell%2E+Arabic+learner+corpora+%28alc%29%3A+a+taxonomy+of+coding+errors%2E+In+The+8th+International+Computing+Conference+in+Arabic%2C+2012%2E+%2AFigure+9%3A+Raw+%28gray%29+vs%2E+ARBESC%2B+Fixed+%28blu)
4. Bashar Alhafni and Nizar Habash. Enhancing text editing for grammatical error correction: Arabic as a case study, 2025. URL https://arxiv.org/abs/2503.00985. [↗](https://arxiv.org/abs/2503.00985)
5. Bashar Alhafni and Nizar Habash. Enhancing text editing for grammatical error correction: Arabic as a case study. arXiv preprint arXiv:2503.00985, 2025. [↗](https://arxiv.org/abs/2503.00985)
6. Bashar Alhafni, Go Inoue, Christian Khairallah, and Nizar Habash. Advancements in arabic grammatical error detection and correction: An empirical investigation. arXiv preprint arXiv:2305.14734, 2023. [↗](https://arxiv.org/abs/2305.14734) [our card](https://md.research.elamur.ai/free/en/papers/alhafni-2023-advancements-arabic-grammatical-error-detection/)
7. Ahlam Alrehili and Areej Alhothali. Tibyan corpus: balanced and comprehensive error coverage corpus using chatgpt for arabic grammatical error correction. PeerJ Computer Science, 11:e2724, 2025. [find](https://scholar.google.com/scholar?q=Ahlam+Alrehili+and+Areej+Alhothali%2E+Tibyan+corpus%3A+balanced+and+comprehensive+error+coverage+corpus+using+chatgpt+for+arabic+grammatical+error+correction%2E+PeerJ+Computer+Science%2C+11%3Ae2724%2C+2025%2E) [our card](https://md.research.elamur.ai/free/en/papers/alrehili-2024-tibyan-corpus-balanced-comprehensive-error/)
8. Ahlam Alrehili and Areej Alhothali. Towards the development of balanced synthetic data for correcting grammatical errors in arabic: An approach based on error tagging model and synthetic data generating model. arXiv preprint arXiv:2502.05312, 2025. [↗](https://arxiv.org/abs/2502.05312) [our card](https://md.research.elamur.ai/free/en/papers/alrehili-2025-towards-development-balanced-synthetic-data/)
9. Ahlam Alrehili and Areej Alhothaly. Balanced synthetic data generation for correcting grammatical errors in arabic. arXiv preprint arXiv:2502.05312, 2025. [↗](https://arxiv.org/abs/2502.05312) [our card](https://md.research.elamur.ai/free/en/papers/alrehili-2025-towards-development-balanced-synthetic-data/)
10. Wissam Antoun, Fady Baly, and Hazem Hajj. Arabert: Transformer-based model for arabic language understanding. In LREC 2020 Workshop Language Resources and Evaluation Conference 11–16 May 2020, page 9, 2020. [find](https://scholar.google.com/scholar?q=Wissam+Antoun%2C+Fady+Baly%2C+and+Hazem+Hajj%2E+Arabert%3A+Transformer%2Dbased+model+for+arabic+language+understanding%2E+In+LREC+2020+Workshop+Language+Resources+and+Evaluation+Conference+11%E2%80%9316+May+2020%2C+page+9%2C) [our card](https://md.research.elamur.ai/free/en/papers/antoun-2020-arabert-transformer-based-model-arabic/)
11. Riadh Belkebir and Nizar Habash. Automatic error type annotation for arabic. arXiv preprint arXiv:2109.08068, 2021. [↗](https://arxiv.org/abs/2109.08068) [our card](https://md.research.elamur.ai/free/en/papers/belkebir-2021-automatic-error-type-annotation-arabic/)
12. Christopher Bryant, Zheng Yuan, Muhammad Reza Qorib, Hannan Cao, Hwee Tou Ng, and Ted Briscoe. Grammatical error correction: A survey of the state of the art. Computational Linguistics, 49(3):643–701, 2023. [find](https://scholar.google.com/scholar?q=Christopher+Bryant%2C+Zheng+Yuan%2C+Muhammad+Reza+Qorib%2C+Hannan+Cao%2C+Hwee+Tou+Ng%2C+and+Ted+Briscoe%2E+Grammatical+error+correction%3A+A+survey+of+the+state+of+the+art%2E+Computational+Linguistics%2C+49%283%29%3A643%E2%80%93701%2C)
13. CJ Bryant, Mariano Felice, and Edward Briscoe. Automatic annotation and evaluation of error types for grammatical error correction. In Association for Computational Linguistics, 2017. [find](https://scholar.google.com/scholar?q=CJ+Bryant%2C+Mariano+Felice%2C+and+Edward+Briscoe%2E+Automatic+annotation+and+evaluation+of+error+types+for+grammatical+error+correction%2E+In+Association+for+Computational+Linguistics%2C+2017%2E) [our card](https://md.research.elamur.ai/free/en/papers/bryant-2017-automatic-annotation-evaluation-error-types/)
14. Daniel Dahlmeier and Hwee Tou Ng. Better evaluation for grammatical error correction. In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 568–572, 2012. [find](https://scholar.google.com/scholar?q=Daniel+Dahlmeier+and+Hwee+Tou+Ng%2E+Better+evaluation+for+grammatical+error+correction%2E+In+Proceedings+of+the+2012+Conference+of+the+North+American+Chapter+of+the+Association+for+Computational+Linguisti)
15. Nizar Habash and Owen Rambow. Arabic tokenization, part-of-speech tagging and morphological disambiguation in one fell swoop. In Proceedings of the 43rd annual meeting of the association for computational linguistics (ACL’05), pages 573–580, 2005. [find](https://scholar.google.com/scholar?q=Nizar+Habash+and+Owen+Rambow%2E+Arabic+tokenization%2C+part%2Dof%2Dspeech+tagging+and+morphological+disambiguation+in+one+fell+swoop%2E+In+Proceedings+of+the+43rd+annual+meeting+of+the+association+for+computati) [our card](https://md.research.elamur.ai/free/en/papers/aclbulk-2005-habash-arabic-tokenization-part-speech-tagging/)
16. Nizar Habash, Owen Rambow, and Ryan Roth. Mada+ tokan: A toolkit for arabic tokenization, diacritization, morphological disambiguation, pos tagging, stemming and lemmatization. In Proceedings of the 2nd international conference on Arabic language resources and tools (MEDAR), Cairo, Egypt, volume 41, page 62, 2009. [find](https://scholar.google.com/scholar?q=Nizar+Habash%2C+Owen+Rambow%2C+and+Ryan+Roth%2E+Mada%2B+tokan%3A+A+toolkit+for+arabic+tokenization%2C+diacritization%2C+morphological+disambiguation%2C+pos+tagging%2C+stemming+and+lemmatization%2E+In+Proceedings+of+the+2)
17. Bashar Hefny and Nizar Habash. Enhancing text editing for grammatical error correction: Arabic as a case study. In Proceedings of ACL 2025, 2025. [find](https://scholar.google.com/scholar?q=Bashar+Hefny+and+Nizar+Habash%2E+Enhancing+text+editing+for+grammatical+error+correction%3A+Arabic+as+a+case+study%2E+In+Proceedings+of+ACL+2025%2C+2025%2E)
18. Svanhvít Lilja Ingólfsdóttir, Pétur Orri Ragnarsson, Haukur Páll Jónsson, Haukur Barri Símonarson, Vilhjálmur Þorsteinsson, and Vésteinn Snæbjarnarson. Byte-level grammatical error correction using synthetic and curated corpora. arXiv preprint arXiv:2305.17906, 2023. [↗](https://arxiv.org/abs/2305.17906)
19. Karim Ismail, Sherif Abdou, Mohamed Farouk, and Ahmed Salem. Transformers to the rescue: alleviating data scarcity in arabic grammatical error correction with pre-trained models. Neural Computing and Applications, 37 (18):13011–13038, 2025. [find](https://scholar.google.com/scholar?q=Karim+Ismail%2C+Sherif+Abdou%2C+Mohamed+Farouk%2C+and+Ahmed+Salem%2E+Transformers+to+the+rescue%3A+alleviating+data+scarcity+in+arabic+grammatical+error+correction+with+pre%2Dtrained+models%2E+Neural+Computing+and+)
20. Shyamsundar Jayaraman and Alon Lavie. Multi-engine machine translation guided by explicit word matching. In Proceedings of the 10th EAMT Conference: Practical applications of machine translation, 2005. [find](https://scholar.google.com/scholar?q=Shyamsundar+Jayaraman+and+Alon+Lavie%2E+Multi%2Dengine+machine+translation+guided+by+explicit+word+matching%2E+In+Proceedings+of+the+10th+EAMT+Conference%3A+Practical+applications+of+machine+translation%2C+2005)
21. Yoav Kantor, Yoav Katz, Leshem Choshen, Edo Cohen-Karlik, Naftali Liberman, Assaf Toledo, Amir Menczel, and Noam Slonim. Learning to combine grammatical error corrections. arXiv preprint arXiv:1906.03897, 2019. [↗](https://arxiv.org/abs/1906.03897)
22. Sang Yun Kwon, Gagan Bhatia, El Moatez Billah Nagoud, and Muhammad Abdul-Mageed. Chatgpt for arabic grammatical error correction. arXiv preprint arXiv:2308.04492, 2023. [↗](https://arxiv.org/abs/2308.04492)
23. Seunghyun Kwon, Young Park, and Joonho Lee. Prompting gpt-4 for low-resource grammatical correction: Arabic as a case study. In Findings of the Association for Computational Linguistics (ACL Findings), 2023. [find](https://scholar.google.com/scholar?q=Seunghyun+Kwon%2C+Young+Park%2C+and+Joonho+Lee%2E+Prompting+gpt%2D4+for+low%2Dresource+grammatical+correction%3A+Arabic+as+a+case+study%2E+In+Findings+of+the+Association+for+Computational+Linguistics+%28ACL+Findings%29)
24. Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, and Luke Zettlemoyer. Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461, 2019. [↗](https://arxiv.org/abs/1910.13461) [our card](https://md.research.elamur.ai/free/en/papers/lewis-2020-bart-denoising-sequence-sequence-pre/)
25. Ruixi Lin and Hwee Tou Ng. System combination for grammatical error correction based on integer programming. arXiv preprint arXiv:2111.01465, 2021. [↗](https://arxiv.org/abs/2111.01465)
26. Wolfgang Macherey and Franz Josef Och. An empirical study on computing consensus translations from multiple machine translation systems. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), pages 986–995, 2007. [find](https://scholar.google.com/scholar?q=Wolfgang+Macherey+and+Franz+Josef+Och%2E+An+empirical+study+on+computing+consensus+translations+from+multiple+machine+translation+systems%2E+In+Proceedings+of+the+2007+Joint+Conference+on+Empirical+Method)
27. Amr Mahmoud and Rawan Alghamdi. Error correction in arabic texts using hybrid deep learning. IEEE Access, 2024. [find](https://scholar.google.com/scholar?q=Amr+Mahmoud+and+Rawan+Alghamdi%2E+Error+correction+in+arabic+texts+using+hybrid+deep+learning%2E+IEEE+Access%2C+2024%2E)
28. Amr Mahmoud, Hadeer El-Shazly, and Amal Alotaibi. Fine-tuning t5 for arabic grammatical error correction. Natural Language Engineering, 2024. [find](https://scholar.google.com/scholar?q=Amr+Mahmoud%2C+Hadeer+El%2DShazly%2C+and+Amal+Alotaibi%2E+Fine%2Dtuning+t5+for+arabic+grammatical+error+correction%2E+Natural+Language+Engineering%2C+2024%2E)
29. Behrang Mohit, Alla Rozovskaya, Nizar Habash, Wajdi Zaghouani, and Ossama Obeid. The first qalb shared task on automatic text correction for arabic. In Proceedings of the EMNLP 2014 Workshop on Arabic Natural Language Processing (ANLP), pages 39–47, 2014. [find](https://scholar.google.com/scholar?q=Behrang+Mohit%2C+Alla+Rozovskaya%2C+Nizar+Habash%2C+Wajdi+Zaghouani%2C+and+Ossama+Obeid%2E+The+first+qalb+shared+task+on+automatic+text+correction+for+arabic%2E+In+Proceedings+of+the+EMNLP+2014+Workshop+on+Arabic)
30. El Moatez Billah Nagoudi, AbdelRahim Elmadany, and Muhammad Abdul-Mageed. Arat5: Text-to-text transformers for arabic language generation. arXiv preprint arXiv:2109.12068, 2021. [↗](https://arxiv.org/abs/2109.12068) [our card](https://md.research.elamur.ai/free/en/papers/nagoudi-2022-arat5-text-text-transformers-arabic/)
31. Nour Nawar. Automatic arabic grammar error correction. Master’s thesis, Cairo University, 2015. [find](https://scholar.google.com/scholar?q=Nour+Nawar%2E+Automatic+arabic+grammar+error+correction%2E+Master%E2%80%99s+thesis%2C+Cairo+University%2C+2015%2E)
32. Hwee Tou Ng, Siew Mei Wu, Yuanbin Wu, Christian Hadiwinoto, and Joel Tetreault. The conll-2013 shared task on grammatical error correction. arXiv preprint arXiv:2507.09474, 2025. [↗](https://arxiv.org/abs/2507.09474)
33. Piotr Pajak and Marta Pajak. Neural approaches to arabic grammar correction. Applied Computing Review, 2022. [find](https://scholar.google.com/scholar?q=Piotr+Pajak+and+Marta+Pajak%2E+Neural+approaches+to+arabic+grammar+correction%2E+Applied+Computing+Review%2C+2022%2E)
34. Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32, 2019. [find](https://scholar.google.com/scholar?q=Adam+Paszke%2C+Sam+Gross%2C+Francisco+Massa%2C+Adam+Lerer%2C+James+Bradbury%2C+Gregory+Chanan%2C+Trevor+Killeen%2C+Zeming+Lin%2C+Natalia+Gimelshein%2C+Luca+Antiga%2C+et+al%2E+Pytorch%3A+An+imperative+style%2C+high%2Dperformance+) [our card](https://md.research.elamur.ai/free/en/papers/paszke-2019-pytorch-imperative-style-high-performance/)
35. Muhammad Reza Qorib, Seung-Hoon Na, and Hwee Tou Ng. Frustratingly easy system combination for grammatical error correction. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 1964–1974, 2022. [find](https://scholar.google.com/scholar?q=Muhammad+Reza+Qorib%2C+Seung%2DHoon+Na%2C+and+Hwee+Tou+Ng%2E+Frustratingly+easy+system+combination+for+grammatical+error+correction%2E+In+Proceedings+of+the+2022+Conference+of+the+North+American+Chapter+of+the+)
36. Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of machine learning research, 21(140):1–67, 2020. [find](https://scholar.google.com/scholar?q=Colin+Raffel%2C+Noam+Shazeer%2C+Adam+Roberts%2C+Katherine+Lee%2C+Sharan+Narang%2C+Michael+Matena%2C+Yanqi+Zhou%2C+Wei+Li%2C+and+Peter+J+Liu%2E+Exploring+the+limits+of+transfer+learning+with+a+unified+text%2Dto%2Dtext+trans) [our card](https://md.research.elamur.ai/free/en/papers/raffel-2019-exploring-limits-transfer-learning-unified/)
37. Sascha Rothe, Jonathan Mallinson, Eric Malmi, Sebastian Krause, and Aliaksei Severyn. A simple recipe for multilingual grammatical error correction. arXiv preprint arXiv:2106.03830, 2021. [↗](https://arxiv.org/abs/2106.03830)
38. Alla Rozovskaya, Nizar Habash, and Dan Roth. The qalb-2014 shared task on automatic text correction for arabic. In Proceedings of EMNLP 2014 Workshop on Arabic Natural Language Processing, 2014. [find](https://scholar.google.com/scholar?q=Alla+Rozovskaya%2C+Nizar+Habash%2C+and+Dan+Roth%2E+The+qalb%2D2014+shared+task+on+automatic+text+correction+for+arabic%2E+In+Proceedings+of+EMNLP+2014+Workshop+on+Arabic+Natural+Language+Processing%2C+2014%2E)
39. Alla Rozovskaya, Houda Bouamor, Nizar Habash, Wajdi Zaghouani, Ossama Obeid, and Behrang Mohit. The second qalb shared task on automatic text correction for arabic. In Proceedings of the Second workshop on Arabic natural language processing, pages 26–35, 2015. [find](https://scholar.google.com/scholar?q=Alla+Rozovskaya%2C+Houda+Bouamor%2C+Nizar+Habash%2C+Wajdi+Zaghouani%2C+Ossama+Obeid%2C+and+Behrang+Mohit%2E+The+second+qalb+shared+task+on+automatic+text+correction+for+arabic%2E+In+Proceedings+of+the+Second+worksh)
40. Ahmed Solyman, Mohamed Elsayed, and Mohamed Attia. Improving arabic grammatical error correction using hybrid neural models. Journal of King Saud University–Computer and Information Sciences, 2022. [find](https://scholar.google.com/scholar?q=Ahmed+Solyman%2C+Mohamed+Elsayed%2C+and+Mohamed+Attia%2E+Improving+arabic+grammatical+error+correction+using+hybrid+neural+models%2E+Journal+of+King+Saud+University%E2%80%93Computer+and+Information+Sciences%2C+2022%2E)
41. Ahmed Solyman, Hossam Rashad, and Ahmed Elgohary. Arat5 for arabic grammatical error correction. In Proceedings of the International Conference on Language Resources and Evaluation (LREC), 2023. [find](https://scholar.google.com/scholar?q=Ahmed+Solyman%2C+Hossam+Rashad%2C+and+Ahmed+Elgohary%2E+Arat5+for+arabic+grammatical+error+correction%2E+In+Proceedings+of+the+International+Conference+on+Language+Resources+and+Evaluation+%28LREC%29%2C+2023%2E)
42. Aiman Solyman, Wang Zhenyu, Tao Qian, Arafat Abdulgader Mohammed Elhag, Muhammad Toseef, and Zeinab Aleibeid. Synthetic data with neural machine translation for automatic correction in arabic grammar. Egyptian Informatics Journal, 22(3):303–315, 2021. [find](https://scholar.google.com/scholar?q=Aiman+Solyman%2C+Wang+Zhenyu%2C+Tao+Qian%2C+Arafat+Abdulgader+Mohammed+Elhag%2C+Muhammad+Toseef%2C+and+Zeinab+Aleibeid%2E+Synthetic+data+with+neural+machine+translation+for+automatic+correction+in+arabic+grammar%2E)
43. Aiman Solyman, Marco Zappatore, Wang Zhenyu, Zeinab Mahmoud, Ali Alfatemi, Ashraf Osman Ibrahim, and Lubna Abdelkareim Gabralla. Optimizing the impact of data augmentation for low-resource grammatical error correction. Journal of King Saud University-Computer and Information Sciences, 35(6):101572, 2023. [find](https://scholar.google.com/scholar?q=Aiman+Solyman%2C+Marco+Zappatore%2C+Wang+Zhenyu%2C+Zeinab+Mahmoud%2C+Ali+Alfatemi%2C+Ashraf+Osman+Ibrahim%2C+and+Lubna+Abdelkareim+Gabralla%2E+Optimizing+the+impact+of+data+augmentation+for+low%2Dresource+grammatical)
44. Felix Stahlberg and Shankar Kumar. Seq2edits: Sequence transduction using span-level edit operations. arXiv preprint arXiv:2009.11136, 2020. [↗](https://arxiv.org/abs/2009.11136)
45. Raymond Hendy Susanto, Peter Phandi, and Hwee Tou Ng. System combination for grammatical error correction. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 951–962, 2014. [find](https://scholar.google.com/scholar?q=Raymond+Hendy+Susanto%2C+Peter+Phandi%2C+and+Hwee+Tou+Ng%2E+System+combination+for+grammatical+error+correction%2E+In+Proceedings+of+the+2014+Conference+on+Empirical+Methods+in+Natural+Language+Processing+%28EM)
46. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. Advances in neural information processing systems, 30, 2017. [find](https://scholar.google.com/scholar?q=Ashish+Vaswani%2C+Noam+Shazeer%2C+Niki+Parmar%2C+Jakob+Uszkoreit%2C+Llion+Jones%2C+Aidan+N+Gomez%2C+%C5%81ukasz+Kaiser%2C+and+Illia+Polosukhin%2E+Attention+is+all+you+need%2E+Advances+in+neural+information+processing+system) [our card](https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/)
47. L Xue. mt5: A massively multilingual pre-trained text-to-text transformer. arXiv preprint arXiv:2010.11934, 2020. [↗](https://arxiv.org/abs/2010.11934) [our card](https://md.research.elamur.ai/free/en/papers/xue-2021-mt5-massively-multilingual-pre-trained/)
48. Linting Xue, Aditya Barua, Noah Constant, Rami Al-Rfou, Sharan Narang, Mihir Kale, Adam Roberts, and Colin Raffel. Byt5: Towards a token-free future with pre-trained byte-to-byte models. Transactions of the Association for Computational Linguistics, 10:291–306, 2022. [find](https://scholar.google.com/scholar?q=Linting+Xue%2C+Aditya+Barua%2C+Noah+Constant%2C+Rami+Al%2DRfou%2C+Sharan+Narang%2C+Mihir+Kale%2C+Adam+Roberts%2C+and+Colin+Raffel%2E+Byt5%3A+Towards+a+token%2Dfree+future+with+pre%2Dtrained+byte%2Dto%2Dbyte+models%2E+Transactions+)
49. Yukun Zhu. Aligning books and movies: Towards story-like visual explanations by watching movies and reading books. arXiv preprint arXiv:1506.06724, 2015. [↗](https://arxiv.org/abs/1506.06724) [our card](https://md.research.elamur.ai/free/en/papers/zhu-2015-aligning-books-movies-towards-story/)