---
title: "Arabic OCR Error Correction Using Character Segment"
description: "Magdy and Darwish build a post-OCR corrector on the noisy channel framework. 20 references, cited by 9 papers here."
authors: ["Walid Magdy", "Kareem Darwish"]
year: 2006
venue: "Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing"
source: "https://aclanthology.org/W06-1648/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/magdy-2006-arabic-ocr-error-correction-character/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/magdy-2006-arabic-ocr-error-correction-character/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2006](https://md.research.elamur.ai/free/en/papers/2006/page/2/) / Arabic OCR Error Correction Using Character Segment Correction, Language Modeling, and Shallow Morphology

# Arabic OCR Error Correction Using Character Segment Correction, Language Modeling, and Shallow Morphology

**Authors:** [Walid Magdy](https://md.research.elamur.ai/free/en/authors/walid-magdy/) and [Kareem Darwish](https://md.research.elamur.ai/free/en/authors/kareem-darwish/) · **Year:** 2006 · **Venue:** [Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing](https://md.research.elamur.ai/free/en/venues/emnlp/) ([EMNLP 2006](https://md.research.elamur.ai/free/en/venues/emnlp/2006/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/W06-1648/) · [PDF](https://aclanthology.org/W06-1648.pdf) · [OpenAlex](https://openalex.org/W2436413986)

**Citations:** 38 citations (OpenAlex, 2026-10-14) · [9](https://md.research.elamur.ai/free/en/papers/magdy-2006-arabic-ocr-error-correction-character/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
The paper addresses cleaning up Arabic text produced by OCR. Arabic is hard to correct with dictionaries because the script is cursive, letters are told apart by dots, and the rich morphology yields a vast number of surface forms. Magdy and Darwish build a post-OCR corrector on the noisy channel framework. It learns how the OCR engine distorts characters or multi-character segments from aligned pairs of corrupted and hand-fixed words. It then reranks candidate corrections with a word n-gram language model.

They compare one-to-one character alignment with m:n segment alignment, test smoothing and character-position modeling, and check whether shallow morphology helps: correcting stems instead of full words, or modeling segmented text. Segment-based error modeling combined with a language model clearly works best. Morphological processing slightly hurts.

The main lesson is that a large in-domain corpus, supplying both the correction dictionary and the language model, is enough to cut word error rate by about 70%, even for a morphologically rich language.

## Key points
- Training and test data come from 6,000 OCR'd words of a modern printing of Ibn Al-Qayim's medieval book "Provisions". Pages were scanned at 300 dpi and recognized with Sakhr's Automatic Reader. The words were split 4,000 for training and 2,000 for testing, and the test words had a baseline WER of 39%.
- Before training, all alef/hamza variants were normalized to alef, and alef maqsoura to ya.
- m:n segment alignment, following Brill and Moore, outperformed 1:1 alignment, following Church and Gale. The segment model placed correct answers in the top 10 more often and gave them better scores.
- When the right candidate was among the proposals, the language model picked it about 98% of the time. Smoothing helped, while modeling character position hurt, likely because the training data were sparse.
- A 6-gram model over morphologically segmented words damaged accuracy badly. Word-based correction slightly beat stem-based correction. The best setup reduced WER by roughly 70%.

## Interesting ideas
- Segment alignments are built from an ordinary Levenshtein character alignment: correctly matched characters act as fixed anchors, and the empty slots are merged into the neighboring mismatched characters to form many-to-many edit pairs. This is cheap and captures cases where one symbol is misread as several.
- The authors evaluate the candidate generator (is the right answer in the top 10?) separately from the ranker (how often is it picked when present?). This shows which component is the bottleneck.
- Collapsing orthographic variants before counting edits shrinks the event space and reduces sparsity in a small training set.
- Their negative result is that stemming or segmenting text hurt once enough surface-form data existed, and the authors suspect the outcome could flip with less data. So deeper linguistic units should be tested against plain surface forms rather than assumed better.
- To combine morphology with sparse data, the authors propose a factored language model that conditions on surface words alongside POS tags and affixes.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (tokens): Mova could learn a many-to-many confusion model from pairs of noisy and clean English text, such as OCR'd fables or typo-laden student answers, and use it to normalize input before the tokenizer and tagger.
- **I2** (learn): any Mova stage that proposes and then selects could be scored on both rates separately, so that repair rules or teacher signals target the weaker half.
- **I3** (tokens): normalizing quote styles, ligatures, and British/American spelling variants before learning confusion or lemma statistics would make small hand-corrected samples go further.
- **I4** (learn): ablations should include a surface-form baseline and vary training size, checking whether morphology-based features still help as silver data grows.
- **I5** (tree): parser features or candidate rerankers could back off from word forms to lemma, UPOS, and affix factors, so rare words still receive informed scores.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [IBM (Egypt)](https://md.research.elamur.ai/free/en/companies/ibm-egypt/) — Company, Giza, Egypt · 8 works · 301 citations

📚 Shelves (7): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 2,869 works · [⚙️ Engineering](https://md.research.elamur.ai/free/en/shelves/engineering/) · 133 works · [⚙️ Media Technology](https://md.research.elamur.ai/free/en/shelves/engineering/media-technology/) · 34 works

🧭 Topics (3): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works · [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 2,908 works · [🧩 Morphology](https://md.research.elamur.ai/free/en/topics/morphology/) · 405 works

## Cite

Cite as: Walid Magdy and Kareem Darwish. 2006. Arabic OCR Error Correction Using Character Segment Correction, Language Modeling, and Shallow Morphology. Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{magdy2006arabic,
  title = {{Arabic OCR Error Correction Using Character Segment Correction, Language Modeling, and Shallow Morphology}},
  author = {Walid Magdy and Kareem Darwish},
  booktitle = {Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing},
  year = {2006},
  doi = {10.3115/1610075.1610132},
  url = {https://doi.org/10.3115/1610075.1610132}
}
```

- [← previous Story Segmentation of Broadcast News in English, Mandarin and Arabic](https://md.research.elamur.ai/free/en/papers/rosenberg-2006-story-segmentation-broadcast-news-english/)
- [next → Annotating Attribution in the Penn Discourse TreeBank](https://md.research.elamur.ai/free/en/papers/prasad-2006-annotating-attribution-penn-discourse-treebank/)
- [↑ back to papers of 2006](https://md.research.elamur.ai/free/en/papers/2006/page/2/)

## References

20 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Agirre, E., K. Gojenola, K. Sarasola, and A. Voutilainen. Towards a Single Proposal in Spelling Correction. In COLING-ACL'98 (1998). [find](https://scholar.google.com/scholar?q=Agirre%2C+E%2E%2C+K%2E+Gojenola%2C+K%2E+Sarasola%2C+and+A%2E+Voutilainen%2E+Towards+a+Single+Proposal+in+Spelling+Correction%2E+In+COLING%2DACL%2798+%281998%29%2E)
2. Ahmed, M. A Large-Scale Computational Processor of Arabic Morphology and Applications. MSc. Thesis, in Faculty of Engineering Cairo University: Cairo, Egypt. (2000). [find](https://scholar.google.com/scholar?q=Ahmed%2C+M%2E+A+Large%2DScale+Computational+Processor+of+Arabic+Morphology+and+Applications%2E+MSc%2E+Thesis%2C+in+Faculty+of+Engineering+Cairo+University%3A+Cairo%2C+Egypt%2E+%282000%29%2E)
3. Baeza-Yates, R. and G. Navarro. A Faster Algorithm for Approximate String Matching. In Combinatorial Pattern Matching (CPM'96), Springer-Verlag LNCS (1996). [find](https://scholar.google.com/scholar?q=Baeza%2DYates%2C+R%2E+and+G%2E+Navarro%2E+A+Faster+Algorithm+for+Approximate+String+Matching%2E+In+Combinatorial+Pattern+Matching+%28CPM%2796%29%2C+Springer%2DVerlag+LNCS+%281996%29%2E)
4. Brill, E. and R. Moore. [An improved error model for noisy channel spelling correction](https://md.research.elamur.ai/free/en/papers/brill-2000-improved-error-model-noisy-channel/). In the proceedings of the 38th Annual Meeting on Association for Computational Linguistics, pages 286 – 293 (2000).
5. Church, K. and W. Gale. “Probability Scoringfor Spelling Correction.” Statistics and Computing, 1: 93-103 (1991). [find](https://scholar.google.com/scholar?q=Church%2C+K%2E+and+W%2E+Gale%2E+%E2%80%9CProbability+Scoringfor+Spelling+Correction%2E%E2%80%9D+Statistics+and+Computing%2C+1%3A+93%2D103+%281991%29%2E)
6. Darwish, K. and D. Oard. Term Selection for Searching Printed Arabic. In SIGIR-2002 (2002). [find](https://scholar.google.com/scholar?q=Darwish%2C+K%2E+and+D%2E+Oard%2E+Term+Selection+for+Searching+Printed+Arabic%2E+In+SIGIR%2D2002+%282002%29%2E)
7. Darwish, K., H. Hassan, and O. Emam. [Examining the Effect of Improved Context Sensitive Morphology on Arabic Information Retrieval](https://md.research.elamur.ai/free/en/papers/darwish-2005-examining-effect-improved-context-sensitive/). In ACL Workshop on Computation Approaches to Semitic Languages, Ann Arbor, (2005).
8. De Roeck, A. and W. Al-Fares. [A Morphologically Sensitive Clustering Algorithm for Identifying Arabic Roots](https://md.research.elamur.ai/free/en/papers/roeck-2000-morphologically-sensitive-clustering-algorithm-identifying/). In the 38th Annual Meeting of the ACL, Hong Kong, (2000).
9. Domeij, R., J. Hollman, V. Kann. Detection of spelling errors in Swedish not using a word list en clair. Journal of Quantitative Linguistics (1994) 195-201. [↗](https://doi.org/10.1080/09296179408590017)
10. Harding, S., W. Croft, and C. Weir. Probabilistic Retrieval of OCR-degraded Text Using N-Grams. In European Conference on Digital Libraries (1997). [find](https://scholar.google.com/scholar?q=Harding%2C+S%2E%2C+W%2E+Croft%2C+and+C%2E+Weir%2E+Probabilistic+Retrieval+of+OCR%2Ddegraded+Text+Using+N%2DGrams%2E+In+European+Conference+on+Digital+Libraries+%281997%29%2E)
11. Hong, T. Degraded Text Recognition Using Visual and Linguistic Context. Ph.D. Thesis, Computer Science Department, SUNY Buffalo: Buffalo (1995). [find](https://scholar.google.com/scholar?q=Hong%2C+T%2E+Degraded+Text+Recognition+Using+Visual+and+Linguistic+Context%2E+Ph%2ED%2E+Thesis%2C+Computer+Science+Department%2C+SUNY+Buffalo%3A+Buffalo+%281995%29%2E)
12. Jurafsky, D. and J. Martin. Speech and Language Processing. Chapter 5: pages 141-163. Prentice Hall (2000). [find](https://scholar.google.com/scholar?q=Jurafsky%2C+D%2E+and+J%2E+Martin%2E+Speech+and+Language+Processing%2E+Chapter+5%3A+pages+141%2D163%2E+Prentice+Hall+%282000%29%2E)
13. Larkey, L., L. Ballesteros, and M. Connell. Improving stemming for Arabic information retrieval: light stemming and cooccurrence analysis. In proceedings of the 25th annual international ACM SIGIR conference, pages 275-282 (2002). [find](https://scholar.google.com/scholar?q=Larkey%2C+L%2E%2C+L%2E+Ballesteros%2C+and+M%2E+Connell%2E+Improving+stemming+for+Arabic+information+retrieval%3A+light+stemming+and+cooccurrence+analysis%2E+In+proceedings+of+the+25th+annual+international+ACM+SIGIR+con)
14. Lee, Y., K. Papineni, S. Roukos, O. Emam, and H. Hassan. [Language Model Based Arabic Word Segmentation](https://md.research.elamur.ai/free/en/papers/lee-2003-language-model-based-arabic-word/). In the Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, pages 399 - 406 (2003).
15. Lu, Z., I. Bazzi, A. Kornai, J. Makhoul, P. Natarajan, and R. Schwartz. A Robust, Language-Independent OCR System. In the 27th AIPR Workshop: Advances in Computer Assisted Recognition, SPIE (1999). [find](https://scholar.google.com/scholar?q=Lu%2C+Z%2E%2C+I%2E+Bazzi%2C+A%2E+Kornai%2C+J%2E+Makhoul%2C+P%2E+Natarajan%2C+and+R%2E+Schwartz%2E+A+Robust%2C+Language%2DIndependent+OCR+System%2E+In+the+27th+AIPR+Workshop%3A+Advances+in+Computer+Assisted+Recognition%2C+SPIE+%281999%29%2E)
16. Moussa B., M. Maamouri, H. Jin, A. Bies, X. Ma. Arabic Treebank: Part 1 - 10Kword English Translation. Linguistic Data Consortium (2003). [find](https://scholar.google.com/scholar?q=Moussa+B%2E%2C+M%2E+Maamouri%2C+H%2E+Jin%2C+A%2E+Bies%2C+X%2E+Ma%2E+Arabic+Treebank%3A+Part+1+%2D+10Kword+English+Translation%2E+Linguistic+Data+Consortium+%282003%29%2E)
17. Oflazer, K. Error-Tolerant Finite State Recognition with Applications to Morphological Analysis and Spelling Correction. Computational Linguistics 22(1), 73-90 (1996). [find](https://scholar.google.com/scholar?q=Oflazer%2C+K%2E+Error%2DTolerant+Finite+State+Recognition+with+Applications+to+Morphological+Analysis+and+Spelling+Correction%2E+Computational+Linguistics+22%281%29%2C+73%2D90+%281996%29%2E)
18. Taghva, K., J. Borsack, and A. Condit. An Expert System for Automatically Correcting OCR Output. In SPIE - Document Recognition (1994). [find](https://scholar.google.com/scholar?q=Taghva%2C+K%2E%2C+J%2E+Borsack%2C+and+A%2E+Condit%2E+An+Expert+System+for+Automatically+Correcting+OCR+Output%2E+In+SPIE+%2D+Document+Recognition+%281994%29%2E)
19. Tillenius, M., Efficient generation and ranking of spelling error corrections. NADA (1996). [find](https://scholar.google.com/scholar?q=Tillenius%2C+M%2E%2C+Efficient+generation+and+ranking+of+spelling+error+corrections%2E+NADA+%281996%29%2E)
20. Tseng, Y. and D. Oard. Document Image Retrieval Techniques for Chinese. In Symposium on Document Image Understanding Technology, Columbia, MD (2001). [find](https://scholar.google.com/scholar?q=Tseng%2C+Y%2E+and+D%2E+Oard%2E+Document+Image+Retrieval+Techniques+for+Chinese%2E+In+Symposium+on+Document+Image+Understanding+Technology%2C+Columbia%2C+MD+%282001%29%2E)

*Updated 1 November 2026*