---
title: "Standard Arabic Formalization and Linguistic Platform for its"
description: "The author builds an Arabic module for NooJ, a language-independent finite-state platform. 23 references."
authors: ["Slim Mesfar"]
year: 2006
venue: "Proceedings of the International Conference on the Challenge of Arabic for NLP/MT"
source: "https://aclanthology.org/2006.bcs-1.8/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/mesfar-2006-standard-arabic-formalization-linguistic-platform/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/mesfar-2006-standard-arabic-formalization-linguistic-platform/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2006](https://md.research.elamur.ai/free/en/papers/2006/page/2/) / Standard Arabic Formalization and Linguistic Platform for its Analysis

# Standard Arabic Formalization and Linguistic Platform for its Analysis

**Authors:** [Slim Mesfar](https://md.research.elamur.ai/free/en/authors/slim-mesfar/) · **Year:** 2006 · **Venue:** [Proceedings of the International Conference on the Challenge of Arabic for NLP/MT](https://md.research.elamur.ai/free/en/venues/bcs/) ([International Conference on the Challenge of Arabic for NLP/MT 2006](https://md.research.elamur.ai/free/en/venues/bcs/2006/)) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/2006.bcs-1.8/) · [PDF](https://aclanthology.org/2006.bcs-1.8.pdf)

## Summary
The paper tackles automatic morphological analysis of standard Arabic. Two properties make this hard: words agglutinate prefixes, a stem and suffixes, and short vowels are usually left out of writing, which produces heavy ambiguity. The author builds an Arabic module for NooJ, a language-independent finite-state platform. The module is designed to handle fully vowelled, partially vowelled and unvowelled text. It does not generate words from roots and patterns, because that approach can invent lemmas that do not exist or miss real ones. Instead it relies on hand-built lemma dictionaries. Each lemma is linked to an inflectional or derivational paradigm, written as a sequence of cursor-editing commands that turn the lemma into its surface forms in linear time. Three custom operators let near-identical paradigms share one description. Nouns come from a dictionary of primitive nouns plus deverbal forms derived automatically from the verbs. The result is a large-coverage lexical analyzer that can be inspected. Its weak spots are named entities and badly vowelled input, and the author is building a recognizer and fallback grammars for these. The work matters as a reusable, rule-based foundation for further Arabic NLP.

## Key points
- The verb dictionary has 10,000 fully vowelled entries. Each entry is a 3rd person masculine singular perfect form, linked to one of 130 hand-encoded inflectional paradigms, and yields about 122 inflected forms on average.
- Paradigms encode mood, voice, gender, number and person using NooJ string commands such as \<LW>, \<R>, \<S> and \<B>. These run in O(n) time.
- The author added three operators:
  - \<T> rewrites Teh marbouta to Teh maftouha, for example in duals.
  - \<Z> and \<M> allow verbs with slightly different past-tense behaviour, such as kataba vs. Ťabata and kataba vs. dahana, to share a single paradigm.
- The noun dictionary has about 15,000 primitive nouns stored without their final vowel. It also includes plurals that lack a singular in use. Deverbals (IsmFaîl, IsmMafoûl, Masdar) are derived from verb entries through DRV descriptions, for example mudarris and mudarras from darrasa.
- Most unrecognized forms are named entities. In response, the author is building an NER module with NooJ's syntactic grammars and low-priority grammars that strip vowels when a form is unknown.

## Interesting ideas
- Build the lexicon from attested lemmas with assigned paradigms instead of freely combining roots and patterns, so the system never produces "virtual" words.
- Write each inflection as a short program of cursor moves, deletions and insertions applied to the lemma, which makes every generated form traceable step by step.
- Add conditional operators that inspect the stem, such as its final letter, so near-identical inflection classes can be merged into one paradigm instead of multiplying classes.
- Apply relaxed grammars only when a form fails normal analysis, and relax step by step: first remove the last vowel, then all vowels.
- Derive deverbal nouns such as agent and patient nouns directly from verb entries, so each noun keeps a link to its source verb and the role it fills.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (tokens): English morphology could store real lemmas with paradigm IDs rather than productive suffix rules, which cuts overgenerated analyses like nonexistent derived forms.
- **I2** (tokens): spelling changes such as y→ies or consonant doubling could be small edit scripts attached to paradigms, giving each lemma↔form link a readable derivation.
- **I3** (tokens): a few stem-sensitive operators could merge English irregular-ish verb classes and keep the paradigm inventory small and auditable.
- **I4** (tokens): unknown English tokens could go through a priority-ordered repair cascade (case, diacritics, common misspellings), with each relaxation logged as the explanation.
- **I5** (frames): linking "teacher" to "teach" as agent (and similar nominalizations) would let prag fill VerbNet roles from noun phrases as well as from verbs.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (2): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works

🧭 Topics (2): [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 3,066 works · [🧩 Morphology](https://md.research.elamur.ai/free/en/topics/morphology/) · 420 works

## Cite

Cite as: Slim Mesfar. 2006. Standard Arabic Formalization and Linguistic Platform for its Analysis. Proceedings of the International Conference on the Challenge of Arabic for NLP/MT.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{mesfar2006standard,
  title = {{Standard Arabic Formalization and Linguistic Platform for its Analysis}},
  author = {Slim Mesfar},
  booktitle = {Proceedings of the International Conference on the Challenge of Arabic for NLP/MT},
  year = {2006},
  url = {https://aclanthology.org/2006.bcs-1.8/}
}
```

- [← previous Simplified Technical English in the 21st Century](https://md.research.elamur.ai/free/en/papers/shaw-2006-simplified-technical-english-21st-century/)
- [next → The Effect of Machine Translation on the Performance of Arabic-EnglishQA System](https://md.research.elamur.ai/free/en/papers/maskari-2006-effect-machine-translation-performance-arabic/)
- [↑ back to papers of 2006](https://md.research.elamur.ai/free/en/papers/2006/page/2/)

## References

23 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Abou Il Azm, A.(2003) Tasrif Moojim il afál: 10 000 verbs. Dar Ittawhidi, Rabat. [find](https://scholar.google.com/scholar?q=Abou+Il+Azm%2C+A%2E%282003%29+Tasrif+Moojim+il+af%C3%A1l%3A+10+000+verbs%2E+Dar+Ittawhidi%2C+Rabat%2E)
2. Abdeli, A., Cowie, J., Soliman, H. (2004) Arabic Information Retrieval Perspectives. JEP - TALN Session on the automatic treatment of the written and spoken Arabic language, Morocco. [find](https://scholar.google.com/scholar?q=Abdeli%2C+A%2E%2C+Cowie%2C+J%2E%2C+Soliman%2C+H%2E+%282004%29+Arabic+Information+Retrieval+Perspectives%2E+JEP+%2D+TALN+Session+on+the+automatic+treatment+of+the+written+and+spoken+Arabic+language%2C+Morocco%2E)
3. Achour, H. (1998) Contribution à l’étude du problème de la voyellation automatique de l’arabe. PhD Thesis, Paris 7 University. [find](https://scholar.google.com/scholar?q=Achour%2C+H%2E+%281998%29+Contribution+%C3%A0+l%E2%80%99%C3%A9tude+du+probl%C3%A8me+de+la+voyellation+automatique+de+l%E2%80%99arabe%2E+PhD+Thesis%2C+Paris+7+University%2E)
4. Beesley, K., Buckwalter, A. (1989) Two-level Finite State Analysis for Arabic Morphology. In Proceedings of the Seminar on Bilingual Computing in Arabic and English. The Literary and Linguistic Computing Centre, Cambridge. [find](https://scholar.google.com/scholar?q=Beesley%2C+K%2E%2C+Buckwalter%2C+A%2E+%281989%29+Two%2Dlevel+Finite+State+Analysis+for+Arabic+Morphology%2E+In+Proceedings+of+the+Seminar+on+Bilingual+Computing+in+Arabic+and+English%2E+The+Literary+and+Linguistic+Comput)
5. Beesley, K. (1996) [Arabic Finite-State Morphological Analysis and Generation](https://md.research.elamur.ai/free/en/papers/beesley-1996-arabic-finite-state-morphological-analysis/). In Proceedings of COLING-96, the16th International Conference on Computational Linguistics, Copenhagen.
6. Beesley, K. (1998) [Arabic Morphology Using Only Finite-State Operations](https://md.research.elamur.ai/free/en/papers/beesley-1998-arabic-morphology-only-finite-state/). In M. Rosner, editor, Proceedings of the Workshop on Computational Approaches to Semitic Languages, Montreal.
7. Beesley, K. (2001) Arabic Finite-State Morphological Analysis and Generation of Arabic at Xerox Research: Status and Plans in 2001. In Proceedings of ACL/EACL 2001 Workshop, ARABIC Language Processing: Status and Prospects, Toulouse. [find](https://scholar.google.com/scholar?q=Beesley%2C+K%2E+%282001%29+Arabic+Finite%2DState+Morphological+Analysis+and+Generation+of+Arabic+at+Xerox+Research%3A+Status+and+Plans+in+2001%2E+In+Proceedings+of+ACL%2FEACL+2001+Workshop%2C+ARABIC+Language+Processing)
8. Chomsky, N. (1971) Aspects of the Theory of Syntax. Trad. J.-C. Milner. [find](https://scholar.google.com/scholar?q=Chomsky%2C+N%2E+%281971%29+Aspects+of+the+Theory+of+Syntax%2E+Trad%2E+J%2E%2DC%2E+Milner%2E)
9. Debili, F. (2001) Traitement automatique de l’arabe voyellé ou non. Correspondances – IRMC. [find](https://scholar.google.com/scholar?q=Debili%2C+F%2E+%282001%29+Traitement+automatique+de+l%E2%80%99arabe+voyell%C3%A9+ou+non%2E+Correspondances+%E2%80%93+IRMC%2E)
10. Debili, F., Achour, H., and Soussi, E. (2002) La langue arabe et l’ordinateur : de l’étiquetage grammatical à la voyellation automatique. Correspondances – IRMC. [find](https://scholar.google.com/scholar?q=Debili%2C+F%2E%2C+Achour%2C+H%2E%2C+and+Soussi%2C+E%2E+%282002%29+La+langue+arabe+et+l%E2%80%99ordinateur+%3A+de+l%E2%80%99%C3%A9tiquetage+grammatical+%C3%A0+la+voyellation+automatique%2E+Correspondances+%E2%80%93+IRMC%2E)
11. Dichy, J., and Farghaly, A. (2003) Roots & Patterns vs. Stems plus Grammar-Lexis Specifications: there what basis should is multilingual lexical database centred on Arabic be built? Workshop on Machine Translation for Semitic Languages, New Orleans, USA. [find](https://scholar.google.com/scholar?q=Dichy%2C+J%2E%2C+and+Farghaly%2C+A%2E+%282003%29+Roots+%26+Patterns+vs%2E+Stems+plus+Grammar%2DLexis+Specifications%3A+there+what+basis+should+is+multilingual+lexical+database+centred+on+Arabic+be+built%3F+Workshop+on+Machin)
12. Dichy, J. (2001) On lemmatization in Arabic. A formal definition of the Arabic entries of multilingual lexical databases. In proceedings of ACL/ EACL 2001. [find](https://scholar.google.com/scholar?q=Dichy%2C+J%2E+%282001%29+On+lemmatization+in+Arabic%2E+A+formal+definition+of+the+Arabic+entries+of+multilingual+lexical+databases%2E+In+proceedings+of+ACL%2F+EACL+2001%2E)
13. Harris, Z. S. (1985) Transformational Theory. Language, vol. 41, No. 9, pp. 363-401. [find](https://scholar.google.com/scholar?q=Harris%2C+Z%2E+S%2E+%281985%29+Transformational+Theory%2E+Language%2C+vol%2E+41%2C+No%2E+9%2C+pp%2E+363%2D401%2E)
14. Khoja, S., Garside, R., and Knowles, G. (2001) A tagset for the morpho-syntactic tagging of Arabic. Paper given At the Corpus Linguistics 2001 conference, Lancaster. [find](https://scholar.google.com/scholar?q=Khoja%2C+S%2E%2C+Garside%2C+R%2E%2C+and+Knowles%2C+G%2E+%282001%29+A+tagset+for+the+morpho%2Dsyntactic+tagging+of+Arabic%2E+Paper+given+At+the+Corpus+Linguistics+2001+conference%2C+Lancaster%2E)
15. Koskenniemi, K. (1983) Two-level morphology: a general computational model for word-form recognition and publication. University of Helsinki. [find](https://scholar.google.com/scholar?q=Koskenniemi%2C+K%2E+%281983%29+Two%2Dlevel+morphology%3A+a+general+computational+model+for+word%2Dform+recognition+and+publication%2E+University+of+Helsinki%2E)
16. McCarthy, J. (1993) Template form in prosodic morphology. Paper from the Third Annual Formal Linguistics Society of Midamerica Conference, pages 187-218, Bloomington, Indiana. Indiana University Linguistics Club. [find](https://scholar.google.com/scholar?q=McCarthy%2C+J%2E+%281993%29+Template+form+in+prosodic+morphology%2E+Paper+from+the+Third+Annual+Formal+Linguistics+Society+of+Midamerica+Conference%2C+pages+187%2D218%2C+Bloomington%2C+Indiana%2E+Indiana+University+Lingu)
17. Mesfar, S. (2006) La reconnaissance des entités nommées (NER) en arabe standard. The 9th INTEX/NooJ conference, The Faculty of Mathematics, University of Belgrade. [find](https://scholar.google.com/scholar?q=Mesfar%2C+S%2E+%282006%29+La+reconnaissance+des+entit%C3%A9s+nomm%C3%A9es+%28NER%29+en+arabe+standard%2E+The+9th+INTEX%2FNooJ+conference%2C+The+Faculty+of+Mathematics%2C+University+of+Belgrade%2E)
18. Revuz, D. (1991) Dictionnaires et lexiques : méthodes et algorithmes. PhD Thesis, Paris 7 University. [find](https://scholar.google.com/scholar?q=Revuz%2C+D%2E+%281991%29+Dictionnaires+et+lexiques+%3A+m%C3%A9thodes+et+algorithmes%2E+PhD+Thesis%2C+Paris+7+University%2E)
19. Silberztein, M. (2005_1) NooJ’s Dictionnaries. In proceedings of LTC 2005, Pozman University. Silberztein, M. (2005_2) NooJ : The Lexical Module In NooJ pour le Traitement Automatique des Langues. S. Koeva, D. Maurel, M. Silberztein Eds, MSH Ledoux. [find](https://scholar.google.com/scholar?q=Silberztein%2C+M%2E+%282005%5F1%29+NooJ%E2%80%99s+Dictionnaries%2E+In+proceedings+of+LTC+2005%2C+Pozman+University%2E+Silberztein%2C+M%2E+%282005%5F2%29+NooJ+%3A+The+Lexical+Module+In+NooJ+pour+le+Traitement+Automatique+des+Langues%2E+S%2E+)
20. Franche-Comté Academic Presses, 2005. [find](https://scholar.google.com/scholar?q=Franche%2DComt%C3%A9+Academic+Presses%2C+2005%2E)
21. Silberztein, M. (2006) NooJ Manual. Download from “[http://www.nooj4nlp.net](http://www.nooj4nlp.net)” [↗](http://www.nooj4nlp.net)
22. Ouersighni, R. (2001) A major offshot of the DIINAR-MBC project: AraParse, a morpho-syntactic analyzer for unvowelled Arabic texts. In proceedings of ACL/EACL 2001. [find](https://scholar.google.com/scholar?q=Ouersighni%2C+R%2E+%282001%29+A+major+offshot+of+the+DIINAR%2DMBC+project%3A+AraParse%2C+a+morpho%2Dsyntactic+analyzer+for+unvowelled+Arabic+texts%2E+In+proceedings+of+ACL%2FEACL+2001%2E)
23. Tuerlinckx, L. (2004) La lemmatisation de l’arabe non classique. The 7 th international Days of Statistical Analysis of Textual Data, JADT. [find](https://scholar.google.com/scholar?q=Tuerlinckx%2C+L%2E+%282004%29+La+lemmatisation+de+l%E2%80%99arabe+non+classique%2E+The+7+th+international+Days+of+Statistical+Analysis+of+Textual+Data%2C+JADT%2E)

*Updated 2 November 2026*