---
title: "Combination of Arabic Preprocessing Schemes for Statistical"
description: "The authors compare eleven word-level preprocessing schemes, ranging from simple… 38.67 BLEU. 25 references, cited by 39 papers here."
authors: ["Fatiha Sadat", "Nizar Habash"]
year: 2006
venue: "Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics"
source: "https://aclanthology.org/P06-1001/"
doi: "10.3115/1220175.1220176"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/sadat-2006-combination-arabic-preprocessing-schemes-statistical/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/sadat-2006-combination-arabic-preprocessing-schemes-statistical/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2006](https://md.research.elamur.ai/free/en/papers/2006/) / Combination of Arabic Preprocessing Schemes for Statistical Machine Translation

# Combination of Arabic Preprocessing Schemes for Statistical Machine Translation

**Authors:** [Fatiha Sadat](https://md.research.elamur.ai/free/en/authors/fatiha-sadat/) and [Nizar Habash](https://md.research.elamur.ai/free/en/authors/nizar-habash/) · **Year:** 2006 · **Venue:** [Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2006](https://md.research.elamur.ai/free/en/venues/acl/2006/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/P06-1001/) · [PDF](https://aclanthology.org/P06-1001.pdf) · [DOI 10.3115/1220175.1220176](https://doi.org/10.3115/1220175.1220176) · [OpenAlex](https://openalex.org/W2160538511)

**Citations:** 83 citations (OpenAlex, 2026-10-14) · [39](https://md.research.elamur.ai/free/en/papers/sadat-2006-combination-arabic-preprocessing-schemes-statistical/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Phrase-based statistical MT accepts almost any input representation, as long as training and testing use the same one. This leaves many options for preparing Arabic, a morphologically rich language with clitics, orthographic variation, and templatic inflection. The authors compare eleven word-level preprocessing schemes, ranging from simple tokenization (ST) through orthographic normalization, decliticization of increasing depth, and lemma- and English-like variants. All schemes are produced by a single technique: BAMA proposes analyses, MADA (trained on Penn Arabic Treebank part 1) picks one in context, and Aragen regenerates a normalized surface form once the chosen features have been removed. They then test two ways of combining schemes. One merges phrase tables from all schemes in the decoder while a "privileged" scheme preprocesses the input (DRC). The other rescores the pooled outputs (ROC). Combination beats every single scheme, reaching 38.67 BLEU, and bootstrap tests confirm the gains are significant. The work shows that no single segmentation is best and that pooling several views of the same text helps.

## Key points
- Eleven schemes are compared: ST, ON, D1, D2, D3, WA, TB, MR, L1, L2, EN. All of them except the baseline rely on BAMA + MADA + Aragen, and orthographic normalization is applied throughout.
- MADA sometimes produces lexeme ties among analyses with the same features. These are resolved arbitrarily but consistently by taking the first analysis in a sorted list.
- In decoder-level combination, the best privileged scheme was TB (38.24 BLEU, 1-best). Rescoring the pooled outputs of all 11 schemes gave 38.67 BLEU. Pooling only the 4 best (D2, TB, D1, WA) gave a lower 37.73.
- In bootstrap resampling, DRC had the top BLEU in 100% of samples. With DRC excluded, ROC won 97.7% of samples, D2 2.2%, and TB 0.1%.
- The best scheme depends on the amount of training data, consistent with earlier findings that morphological preprocessing helps most on smaller corpora.

## Interesting ideas
- After splitting off a clitic, the word is regenerated with a morphological generator rather than simply cut. This keeps the remaining stem in its canonical form and avoids extra spurious variants that increase sparsity and ambiguity.
- The paper separates the "scheme", meaning the target representation, from the "technique", meaning the tool that produces it. This lets representations and tools be compared independently.
- The input is processed in one privileged representation, while the model consults knowledge tables built from every alternative representation. This exploits the complementary strengths of the different views.
- Bootstrap resampling is used to report how often each system wins, which is more informative than reporting a single score difference.
- Ambiguous analyses are resolved arbitrarily but deterministically, so the same word always maps to the same representation and training and test data stay consistent.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (tokens): When the crate en splits contractions or possessives, it could regenerate the canonical host form instead of keeping a truncated string, so lemmas stay unified.
- **I2** (learn): Evaluation logs could record representation choice and producing tool as separate axes, making it clear which one caused a gain or a regression.
- **I3** (tree): The parser could read one primary tokenization but draw features from alternative segmentations, such as split versus unsplit multiword tokens, to stay robust when the tokenizer errs.
- **I4** (learn): Competing parsers or repair rules could be compared by their win share over resampled test sets, giving an explainable confidence figure for each claimed improvement.
- **I5** (world): When WordNet or other lexicon sense ties cannot be resolved, a fixed deterministic tie-break keeps entity and concept IDs stable across runs and keeps explanations reproducible.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Columbia University](https://md.research.elamur.ai/free/en/universities/columbia-university/) — University, New York, United States · 241 works · 54,053 citations
- [National Research Council Canada](https://md.research.elamur.ai/free/en/government/national-research-council-canada/) — Government body, Ottawa, Canada · 59 works · 21,677 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

🧭 Topics (2): [🔁 Machine translation](https://md.research.elamur.ai/free/en/topics/machine-translation/) · 1,087 works · [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 2,908 works

## Cite

Cite as: Fatiha Sadat and Nizar Habash. 2006. Combination of Arabic Preprocessing Schemes for Statistical Machine Translation. Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{sadat2006combination,
  title = {{Combination of Arabic Preprocessing Schemes for Statistical Machine Translation}},
  author = {Fatiha Sadat and Nizar Habash},
  booktitle = {Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics},
  year = {2006},
  doi = {10.3115/1220175.1220176},
  url = {https://doi.org/10.3115/1220175.1220176}
}
```

- [← previous A (very) Brief Introduction to Fluid Construction Grammar](https://md.research.elamur.ai/free/en/papers/steels-2006-very-brief-introduction-fluid-construction/)
- [next → Chinese Whispers - an Efficient Graph Clustering Algorithm and its Application to Natural Language Processing Problems](https://md.research.elamur.ai/free/en/papers/biemann-2006-chinese-whispers-efficient-graph-clustering/)
- [↑ back to papers of 2006](https://md.research.elamur.ai/free/en/papers/2006/)

## References

25 references, 7 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. S. Bangalore, G. Bordel, and G. Riccardi. 2001. Computing Consensus Translation from Multiple Machine Translation Systems. In Proc. of IEEE Automatic Speech Recognition and Understanding Workshop, Italy. [find](https://scholar.google.com/scholar?q=S%2E+Bangalore%2C+G%2E+Bordel%2C+and+G%2E+Riccardi%2E+2001%2E+Computing+Consensus+Translation+from+Multiple+Machine+Translation+Systems%2E+In+Proc%2E+of+IEEE+Automatic+Speech+Recognition+and+Understanding+Workshop%2C+Ita)
2. T. Buckwalter. 2002. Buckwalter Arabic Morphological Analyzer Version 1.0. Linguistic Data Consortium, University of Pennsylvania. Catalog: LDC2002L49. [find](https://scholar.google.com/scholar?q=T%2E+Buckwalter%2E+2002%2E+Buckwalter+Arabic+Morphological+Analyzer+Version+1%2E0%2E+Linguistic+Data+Consortium%2C+University+of+Pennsylvania%2E+Catalog%3A+LDC2002L49%2E)
3. C. Callison-Burch, M. Osborne, and P. Koehn. 2006. [Re-evaluating the Role of Bleu in Machine Translation Research](https://md.research.elamur.ai/free/en/papers/burch-2006-re-evaluating-role-bleu-machine/). In Proc. of the European Chapter of the Association for Computational Linguistics (EACL), Trento, Italy.
4. M. Diab, K. Hacioglu, and D. Jurafsky. 2004. [Automatic Tagging of Arabic Text: From Raw Text to Base Phrase Chunks](https://md.research.elamur.ai/free/en/papers/diab-2004-automatic-tagging-arabic-text-raw/). In Proc. of the North American Chapter of the Association for Computational Linguistics (NAACL), Boston, MA.
5. R. Frederking and S. Nirenburg. 2005. Three Heads are Better Than One. In Proc. of Applied Natural Language Processing, Stuttgart, Germany. [find](https://scholar.google.com/scholar?q=R%2E+Frederking+and+S%2E+Nirenburg%2E+2005%2E+Three+Heads+are+Better+Than+One%2E+In+Proc%2E+of+Applied+Natural+Language+Processing%2C+Stuttgart%2C+Germany%2E)
6. S. Goldwater and D. McClosky. 2005. [Improving Statistical MT through Morphological Analysis](https://md.research.elamur.ai/free/en/papers/goldwater-2005-improving-statistical-mt-through-morphological/). In Proc. of Empirical Methods in Natural Language Processing (EMNLP), Vancouver, Canada.
7. N. Habash and O. Rambow. 2005. Tokenization, Morphological Analysis, and Part-of-Speech Tagging for Arabic in One Fell Swoop. In Proc. of Association for Computational Linguistics (ACL), Ann Arbor, Michigan. [find](https://scholar.google.com/scholar?q=N%2E+Habash+and+O%2E+Rambow%2E+2005%2E+Tokenization%2C+Morphological+Analysis%2C+and+Part%2Dof%2DSpeech+Tagging+for+Arabic+in+One+Fell+Swoop%2E+In+Proc%2E+of+Association+for+Computational+Linguistics+%28ACL%29%2C+Ann+Arbor%2C+Mi)
8. N. Habash and F. Sadat. 2006. [Arabic Preprocessing Schemes for Statistical Machine Translation](https://md.research.elamur.ai/free/en/papers/habash-2006-arabic-preprocessing-schemes-statistical-machine/). In Proc. of NAACL, Brooklyn, New York.
9. N. Habash. 2004. Large Scale Lexeme-based Arabic Morphological Generation. In Proc. of Traitement Automatique du Langage Naturel (TALN). Fez, Morocco. [find](https://scholar.google.com/scholar?q=N%2E+Habash%2E+2004%2E+Large+Scale+Lexeme%2Dbased+Arabic+Morphological+Generation%2E+In+Proc%2E+of+Traitement+Automatique+du+Langage+Naturel+%28TALN%29%2E+Fez%2C+Morocco%2E)
10. S. Jayaraman and A. Lavie. 2005. Multi-Engine Machine Translation Guided by Explicit Word Matching. In Proc. of the Association of Computational Linguistics (ACL), Ann Arbor, MI. [find](https://scholar.google.com/scholar?q=S%2E+Jayaraman+and+A%2E+Lavie%2E+2005%2E+Multi%2DEngine+Machine+Translation+Guided+by+Explicit+Word+Matching%2E+In+Proc%2E+of+the+Association+of+Computational+Linguistics+%28ACL%29%2C+Ann+Arbor%2C+MI%2E)
11. P. Koehn. 2004a. Pharaoh: a Beam Search Decoder for Phrase-based Statistical Machine Translation Models. In Proc. of the Association for Machine Translation in the Americas (AMTA). [find](https://scholar.google.com/scholar?q=P%2E+Koehn%2E+2004a%2E+Pharaoh%3A+a+Beam+Search+Decoder+for+Phrase%2Dbased+Statistical+Machine+Translation+Models%2E+In+Proc%2E+of+the+Association+for+Machine+Translation+in+the+Americas+%28AMTA%29%2E)
12. P. Koehn. 2004b. [Statistical Significance Tests for Machine Translation Evaluation](https://md.research.elamur.ai/free/en/papers/koehn-2004-statistical-significance-tests-machine-translation/). In Proc. of the EMNLP, Barcelona, Spain.
13. Y. Lee. 2004. [Morphological Analysis for Statistical Machine Translation](https://md.research.elamur.ai/free/en/papers/lee-2004-morphological-analysis-statistical-machine-translation/). In Proc. of NAACL, Boston, MA. [↗](https://doi.org/10.21236/ada460276)
14. Y. Lee. 2005. IBM Statistical Machine Translation for Spoken Languages. In Proc. of International Workshop on Spoken Language Translation (IWSLT). [find](https://scholar.google.com/scholar?q=Y%2E+Lee%2E+2005%2E+IBM+Statistical+Machine+Translation+for+Spoken+Languages%2E+In+Proc%2E+of+International+Workshop+on+Spoken+Language+Translation+%28IWSLT%29%2E)
15. M. Maamouri, A. Bies, and T. Buckwalter. 2004. The Penn Arabic Treebank: Building a Large-scale Annotated Arabic Corpus. In Proc. of NEMLAR Conference on Arabic Language Resources and Tools, Cairo, Egypt. [find](https://scholar.google.com/scholar?q=M%2E+Maamouri%2C+A%2E+Bies%2C+and+T%2E+Buckwalter%2E+2004%2E+The+Penn+Arabic+Treebank%3A+Building+a+Large%2Dscale+Annotated+Arabic+Corpus%2E+In+Proc%2E+of+NEMLAR+Conference+on+Arabic+Language+Resources+and+Tools%2C+Cairo%2C+Eg)
16. E. Matusov, N. Ueffing, H. Ney 2006. Computing Consensus Translation from Multiple Machine Translation Systems Using Enhanced Hypotheses Alignment. In Proc. of EACL, Trento, Italy. [find](https://scholar.google.com/scholar?q=E%2E+Matusov%2C+N%2E+Ueffing%2C+H%2E+Ney+2006%2E+Computing+Consensus+Translation+from+Multiple+Machine+Translation+Systems+Using+Enhanced+Hypotheses+Alignment%2E+In+Proc%2E+of+EACL%2C+Trento%2C+Italy%2E)
17. S. Nießen and H. Ney. 2004. Statistical Machine Translation with Scarce Resources Using Morphosyntactic Information. Computational Linguistics, 30(2). [find](https://scholar.google.com/scholar?q=S%2E+Nie%C3%9Fen+and+H%2E+Ney%2E+2004%2E+Statistical+Machine+Translation+with+Scarce+Resources+Using+Morphosyntactic+Information%2E+Computational+Linguistics%2C+30%282%29%2E)
18. T. Nomoto. 2004. Multi-Engine Machine Translation with Voted Language Model. In Proc. of ACL, Barcelona, Spain. [find](https://scholar.google.com/scholar?q=T%2E+Nomoto%2E+2004%2E+Multi%2DEngine+Machine+Translation+with+Voted+Language+Model%2E+In+Proc%2E+of+ACL%2C+Barcelona%2C+Spain%2E)
19. F. Och. 2003. Minimum Error Rate Training in Statistical Machine Translation. In Proc. of the ACL, Sapporo, Japan. [find](https://scholar.google.com/scholar?q=F%2E+Och%2E+2003%2E+Minimum+Error+Rate+Training+in+Statistical+Machine+Translation%2E+In+Proc%2E+of+the+ACL%2C+Sapporo%2C+Japan%2E)
20. F. Och. 2005. Google System Description for the 2005 Nist MT Evaluation. In MT Eval Workshop (unpublished talk). [find](https://scholar.google.com/scholar?q=F%2E+Och%2E+2005%2E+Google+System+Description+for+the+2005+Nist+MT+Evaluation%2E+In+MT+Eval+Workshop+%28unpublished+talk%29%2E)
21. K. Papineni, S. Roukos, T. Ward, and W. Zhu. 2001. [Bleu: a Method for Automatic Evaluation of Machine Translation](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/). Technical Report RC22176(W0109-022), IBM Research Division, Yorktown Heights, NY.
22. M. Paul, T. Doi, Y. Hwang, K. Imamura, H. Okuma, and E. Sumita. 2005. Nobody is Perfect: ATR’s Hybrid Approach to Spoken Language Translation. In Proc. of IWSLT. [find](https://scholar.google.com/scholar?q=M%2E+Paul%2C+T%2E+Doi%2C+Y%2E+Hwang%2C+K%2E+Imamura%2C+H%2E+Okuma%2C+and+E%2E+Sumita%2E+2005%2E+Nobody+is+Perfect%3A+ATR%E2%80%99s+Hybrid+Approach+to+Spoken+Language+Translation%2E+In+Proc%2E+of+IWSLT%2E)
23. M. Popović and H. Ney. 2004. Towards the Use of Word Stems and Suffixes for Statistical Machine Translation. In Proc. of Language Resources and Evaluation (LREC), Lisbon, Portugal. [find](https://scholar.google.com/scholar?q=M%2E+Popovic%CC%81+and+H%2E+Ney%2E+2004%2E+Towards+the+Use+of+Word+Stems+and+Suffixes+for+Statistical+Machine+Translation%2E+In+Proc%2E+of+Language+Resources+and+Evaluation+%28LREC%29%2C+Lisbon%2C+Portugal%2E)
24. F. Sadat, H. Johnson, A. Agbago, G. Foster, R. Kuhn, J. Martin, and A. Tikuisis. 2005. Portage: A Phrase-based Machine Translation System. In Proceedings of the ACL Workshop on Building and Using Parallel Texts, Ann Arbor, Michigan. [find](https://scholar.google.com/scholar?q=F%2E+Sadat%2C+H%2E+Johnson%2C+A%2E+Agbago%2C+G%2E+Foster%2C+R%2E+Kuhn%2C+J%2E+Martin%2C+and+A%2E+Tikuisis%2E+2005%2E+Portage%3A+A+Phrase%2Dbased+Machine+Translation+System%2E+In+Proceedings+of+the+ACL+Workshop+on+Building+and+Using+Para)
25. A. Stolcke. 2002. Srilm - An Extensible Language Modeling Toolkit. In Proc. of International Conference on Spoken Language Processing. [find](https://scholar.google.com/scholar?q=A%2E+Stolcke%2E+2002%2E+Srilm+%2D+An+Extensible+Language+Modeling+Toolkit%2E+In+Proc%2E+of+International+Conference+on+Spoken+Language+Processing%2E)

*Updated 1 November 2026*