--- title: "Error Correction for Arabic Dictionary Lookup — Rytting 2010" description: "Learners of Arabic often struggle to find words in electronic dictionaries. 18 references, cited by 1 paper here." authors: ["C. Anton Rytting", "Paul Rodrigues", "Tim Buckwalter", "David Zajic", "Bridget Hirsch", "Jeff Carnes", "Nathanael Lynn", "Sarah Wayland", "Chris Taylor", "Jason White", "Charles Blake III", "Evelyn Browne", "Corey Miller", "Tristan Purvis"] year: 2010 venue: "Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)" source: "https://aclanthology.org/L10-1303/" licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)" licence_url: "https://creativecommons.org/licenses/by-nc/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/rytting-2010-error-correction-arabic-dictionary-lookup/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/rytting-2010-error-correction-arabic-dictionary-lookup/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2010](https://md.research.elamur.ai/free/en/papers/2010/page/2/) / Error Correction for Arabic Dictionary Lookup # Error Correction for Arabic Dictionary Lookup **Authors:** C. Anton Rytting, Paul Rodrigues, [Tim Buckwalter](https://md.research.elamur.ai/free/en/authors/tim-buckwalter/), [David Zajic](https://md.research.elamur.ai/free/en/authors/david-zajic/), Bridget Hirsch, Jeff Carnes, Nathanael Lynn, Sarah Wayland, Chris Taylor, Jason White, Charles Blake III, Evelyn Browne, Corey Miller and Tristan Purvis · **Year:** 2010 · **Venue:** Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10) · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/) **Links:** [Publisher's page](https://aclanthology.org/L10-1303/) · [PDF](https://aclanthology.org/L10-1303.pdf) · [OpenAlex](https://openalex.org/W175591777) **Citations:** 6 citations (OpenAlex, 2026-10-14) · 1 in our library, of the 140,884 papers whose bibliographies we read ## Summary Learners of Arabic often struggle to find words in electronic dictionaries. They mix up letters that look alike, miss sound contrasts they cannot hear, and stumble over unfamiliar Romanization. Colloquial dialects make all of this harder. The authors built a spelling corrector for lookup in an Iraqi Arabic–English dictionary, with queries typed in SATTS transliteration. No sizeable corpus of learner spelling errors exists, so they did not train on one. Instead, they asked a teacher, students and proficient SATTS users to rate how likely various insertions, deletions and substitutions are. These ratings became weights in three error modules: keyboard slips, phonetic confusions, and dialect/transcription confusions. The modules were merged into one weighted finite-state transducer, which was composed with an acceptor of dictionary citation forms so that candidate entries come out ranked by likelihood. For testing, a noisy-channel model trained on real learner speech errors was used to corrupt dictionary forms. With one error per word, the system beat a Levenshtein baseline by 28% in MRR and roughly doubled top-1 accuracy. The work shows that a few interviews can substitute for training data in a low-resource setting. ## Key points - The authors describe this as the first spelling corrector built for a spoken, colloquial Arabic dialect (Iraqi). It takes SATTS input and was built with the AT&T FSM toolkit. - Confusion weights came from averaged 5-point ratings: - one Arabic instructor and six current or former students for the phonetic module; - three SATTS-proficient English speakers for the transcription module. - The keyboard module covers only substitutions between horizontally adjacent QWERTY keys and shift-key slips. Its costs were raised after early users found it less helpful. - Modules are combined by taking the union of their operations. When two modules share an operation, the cheaper cost wins, and chained operations add their costs. - The test set had 398 queries, with perturbations generated from learner hearing and pronunciation errors (Sethy et al., 2005). - With one error per word, on the error-only subset, the proposed system ranked the correct form first in 55.4% of cases versus 22.1% for Levenshtein. - With 1–2 or 1–3 errors per word, the baseline did better at top-5. This is partly because the system does not model letter doubling (gemination), which the error generator produced frequently. ## Interesting ideas - When no error corpus exists, the authors had experts and learners rate pairs of confusable sounds or letters and turned those ratings into edit costs, which gives a cheap, interpretable error model. - Each error source (typing, hearing, transcription) is its own weighted transducer, and they are merged by union with minimum cost, so sources can be added, removed or reweighted on their own. - The system does not commit to one fix. It intersects the error model with the lexicon and returns a ranked list of valid entries, which suits settings where a later step or a user can choose. - Test queries were produced by corrupting clean dictionary forms with a noisy-channel model learned from a different source (learner speech errors), which avoids testing on the same assumptions used to build the system. - Results were reported both on all queries and on the subset where the input actually differs from the target, and error analysis showed the test generator over-producing doublings. ## For Mova How these ideas could serve Mova, our small open language model — its files, stages and tests: - **I1** (tokens): A normalizer for misspelled or non-native English could weight its edit operations from a small set of human ratings, so that every correction traces back to a named confusion pair. - **I2** (tokens): Spelling repair could be split into separate modules for keyboard slips, phonetic spellings and dialect variants, letting each correction report which module caused it. - **I3** (tokens): For unknown words, the lemmatizer could pass several ranked dictionary candidates to the parser instead of a single guess, and let syntax decide among them. - **I4** (learn): Robustness checks could perturb clean sentences with an error generator built independently of the repair rules, so the rules do not effectively grade themselves. - **I5** (learn): Scores should always be split into trivial and non-trivial cases, and synthetic test data should be inspected for generator artefacts before conclusions are drawn. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/) Topics: [🐪 Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) ## Institutions - [University of Maryland, College Park](https://md.research.elamur.ai/free/en/universities/university-of-maryland-college-park/) — University, College Park, United States · 65 works · 21,800 citations - [The Ohio State University](https://md.research.elamur.ai/free/en/universities/the-ohio-state-university/) — University, Columbus, United States · 46 works · 16,163 citations ## Cite Cite as: C. Anton Rytting, Paul Rodrigues, Tim Buckwalter, David Zajic, Bridget Hirsch, Jeff Carnes, Nathanael Lynn, Sarah Wayland, Chris Taylor, Jason White, Charles Blake III, Evelyn Browne, Corey Miller and Tristan Purvis. 2010. Error Correction for Arabic Dictionary Lookup. Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10). The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{rytting2010error, title = {{Error Correction for Arabic Dictionary Lookup}}, author = {C. Anton Rytting, Paul Rodrigues, Tim Buckwalter, David Zajic, Bridget Hirsch, Jeff Carnes, Nathanael Lynn, Sarah Wayland, Chris Taylor, Jason White, Charles Blake III, Evelyn Browne, Corey Miller and Tristan Purvis}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, doi = {10.63317/2xy4djonz58d}, url = {https://doi.org/10.63317/2xy4djonz58d} } ``` - [← previous A Morphologically-Analyzed CHILDES Corpus of Hebrew](https://md.research.elamur.ai/free/en/papers/nir-2010-morphologically-analyzed-childes-corpus-hebrew/) - [next → Towards a Domain Independent Semantics: Enhancing Semantic Representation with Construction Grammar](https://md.research.elamur.ai/free/en/papers/hwang-2010-domain-independent-semantics-enhancing-semantic/) - [↑ back to papers of 2010](https://md.research.elamur.ai/free/en/papers/2010/page/2/) ## References 18 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Abuhakema, Ghazi, Faraj, Reem, Feldman, Anna and Fitzpatrick, Eileen. (2008). Annotating an Arabic Learner Corpus for Error. In Proceedings of the Sixth International Language Resources and Evaluation (LREC'08), Nicoletta Calzolari, Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, and Daniel Tapias (Eds.). Marrakech, Morocco: European Language Resources Association, pp. 1347-1350. [find](https://scholar.google.com/scholar?q=Abuhakema%2C+Ghazi%2C+Faraj%2C+Reem%2C+Feldman%2C+Anna+and+Fitzpatrick%2C+Eileen%2E+%282008%29%2E+Annotating+an+Arabic+Learner+Corpus+for+Error%2E+In+Proceedings+of+the+Sixth+International+Language+Resources+and+Evaluation) 2. Boyd, Adriane. (2008). Pronunciation Modeling in Spelling Correction for Writers of English as a Foreign Language. M.S. Thesis, The Ohio State University. [find](https://scholar.google.com/scholar?q=Boyd%2C+Adriane%2E+%282008%29%2E+Pronunciation+Modeling+in+Spelling+Correction+for+Writers+of+English+as+a+Foreign+Language%2E+M%2ES%2E+Thesis%2C+The+Ohio+State+University%2E) 3. Brill, Eric, and Moore, Robert C. (2000). An Improved Error Model for Noisy Channel Spelling Correction. In Proceedings of the 38 th Annual Meeting on Association for Computational Linguistics, pp. 286-293. [our card](https://md.research.elamur.ai/free/en/papers/brill-2000-improved-error-model-noisy-channel/) 4. Church, Kenneth W. and Gale, William A. (1991). Probability scoring for spelling correction. Statistics and Computing, 1, pp.93-103. [find](https://scholar.google.com/scholar?q=Church%2C+Kenneth+W%2E+and+Gale%2C+William+A%2E+%281991%29%2E+Probability+scoring+for+spelling+correction%2E+Statistics+and+Computing%2C+1%2C+pp%2E93%2D103%2E) 5. Ferguson, Charles A. (1959). Diglossia. Word, 5, pp. 325-340. [find](https://scholar.google.com/scholar?q=Ferguson%2C+Charles+A%2E+%281959%29%2E+Diglossia%2E+Word%2C+5%2C+pp%2E+325%2D340%2E) 6. Habash, Nizar Y. (2009). REMOOV: A Tool for Online Handling of Out-of-Vocabulary Words in Machine Translation. In Proceedings of the 2nd International Conference on Arabic Language Resources and Tools (MEDAR), pp. 217-220. [find](https://scholar.google.com/scholar?q=Habash%2C+Nizar+Y%2E+%282009%29%2E+REMOOV%3A+A+Tool+for+Online+Handling+of+Out%2Dof%2DVocabulary+Words+in+Machine+Translation%2E+In+Proceedings+of+the+2nd+International+Conference+on+Arabic+Language+Resources+and+Tools) 7. Haeri, Niloofar. (2003). Sacred Language, Ordinary People. New York: Palgrave Macmillan. [find](https://scholar.google.com/scholar?q=Haeri%2C+Niloofar%2E+%282003%29%2E+Sacred+Language%2C+Ordinary+People%2E+New+York%3A+Palgrave+Macmillan%2E) 8. Levenshtein, Vladimir. (1965). Binary codes capable of correcting deletions, insertions and reversals. Doklady Akademii Nauk SSSR, 163(4), pp. 845–848. [find](https://scholar.google.com/scholar?q=Levenshtein%2C+Vladimir%2E+%281965%29%2E+Binary+codes+capable+of+correcting+deletions%2C+insertions+and+reversals%2E+Doklady+Akademii+Nauk+SSSR%2C+163%284%29%2C+pp%2E+845%E2%80%93848%2E) 9. Mitton, Roger and Okada, Takeshi (2007). The adaptation of an English spellchecker for Japanese writers. Presented at Symposium on Second Language Writing, 15-17 Sept. 2007, Nagoya, Japan. [find](https://scholar.google.com/scholar?q=Mitton%2C+Roger+and+Okada%2C+Takeshi+%282007%29%2E+The+adaptation+of+an+English+spellchecker+for+Japanese+writers%2E+Presented+at+Symposium+on+Second+Language+Writing%2C+15%2D17+Sept%2E+2007%2C+Nagoya%2C+Japan%2E) 10. Nerbonne, John and Heeringa, Wilbert. (1997). Measuring Dialect Distance Phonetically. In Workshop on Computational Phonology. Special Interest Group of the Association for Computational Linguistics. Madrid: Association for Computational Linguistics, pp. 11-18. [find](https://scholar.google.com/scholar?q=Nerbonne%2C+John+and+Heeringa%2C+Wilbert%2E+%281997%29%2E+Measuring+Dialect+Distance+Phonetically%2E+In+Workshop+on+Computational+Phonology%2E+Special+Interest+Group+of+the+Association+for+Computational+Linguistics%2E+) 11. Okada, Takeshi (2004). A corpus analysis of spelling errors made by Japanese EFL writers. Yamagata English Studies, 9, pp. 17–36. [find](https://scholar.google.com/scholar?q=Okada%2C+Takeshi+%282004%29%2E+A+corpus+analysis+of+spelling+errors+made+by+Japanese+EFL+writers%2E+Yamagata+English+Studies%2C+9%2C+pp%2E+17%E2%80%9336%2E) 12. Owens, Jonathan. (2006). A Linguistic History of Arabic. Oxford: Oxford University Press. [find](https://scholar.google.com/scholar?q=Owens%2C+Jonathan%2E+%282006%29%2E+A+Linguistic+History+of+Arabic%2E+Oxford%3A+Oxford+University+Press%2E) 13. Sethy, Abhinav, Mote, Nicolaus, Narayanan, Shrikanth, and Johnson, W. Lewis. (2005). Modeling and Automating Detection of Errors in Arabic Language Learner Speech. In INTERSPEECH-2005, pp. 177-180. [find](https://scholar.google.com/scholar?q=Sethy%2C+Abhinav%2C+Mote%2C+Nicolaus%2C+Narayanan%2C+Shrikanth%2C+and+Johnson%2C+W%2E+Lewis%2E+%282005%29%2E+Modeling+and+Automating+Detection+of+Errors+in+Arabic+Language+Learner+Speech%2E+In+INTERSPEECH%2D2005%2C+pp%2E+177%2D180%2E) 14. Shannon, Claude. (1948). A Mathematical Theory of Communication. In The Bell System Technical Journal, 27, pp. 379-423, 623-656. [find](https://scholar.google.com/scholar?q=Shannon%2C+Claude%2E+%281948%29%2E+A+Mathematical+Theory+of+Communication%2E+In+The+Bell+System+Technical+Journal%2C+27%2C+pp%2E+379%2D423%2C+623%2D656%2E) 15. Versteegh, Kees. (1997). The Arabic Language. New York: Columbia University Press. [find](https://scholar.google.com/scholar?q=Versteegh%2C+Kees%2E+%281997%29%2E+The+Arabic+Language%2E+New+York%3A+Columbia+University+Press%2E) 16. Voorhees, E.M. (2000). The TREC-8 question answering track report. In The Eighth Text REtrieval Conference (TREC-8), Spec Pub 500-246. Washington DC: NIST, pp. 77-82. [our card](https://md.research.elamur.ai/free/en/papers/voorhees-2000-trec-8-question-answering-track/) 17. Wagner, R.A. & Fischer, M.J. (1974). The string-to-string correction problem. Journal of the Association for Computing Machinery, 21(1), pp. 168-73. [find](https://scholar.google.com/scholar?q=Wagner%2C+R%2EA%2E+%26+Fischer%2C+M%2EJ%2E+%281974%29%2E+The+string%2Dto%2Dstring+correction+problem%2E+Journal+of+the+Association+for+Computing+Machinery%2C+21%281%29%2C+pp%2E+168%2D73%2E) 18. Woodhead, D.R. & Beene, Wayne (Eds.). (2003). A Dictionary of Iraqi Arabic: Arabic – English. Washington, D.C.: Georgetown UP. [find](https://scholar.google.com/scholar?q=Woodhead%2C+D%2ER%2E+%26+Beene%2C+Wayne+%28Eds%2E%29%2E+%282003%29%2E+A+Dictionary+of+Iraqi+Arabic%3A+Arabic+%E2%80%93+English%2E+Washington%2C+D%2EC%2E%3A+Georgetown+UP%2E)