--- title: "Morphological Analysis for Statistical Machine Translation (2004)" description: "The paper addresses a core difficulty in statistical machine translation between languages whose… 8 references, cited by 75 papers here." authors: ["Young-Suk Lee"] year: 2004 venue: "Proceedings of HLT-NAACL 2004: Short Papers" source: "https://aclanthology.org/N04-4015/" licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)" licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/lee-2004-morphological-analysis-statistical-machine-translation/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/lee-2004-morphological-analysis-statistical-machine-translation/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2004](https://md.research.elamur.ai/free/en/papers/2004/) / Morphological Analysis for Statistical Machine Translation # Morphological Analysis for Statistical Machine Translation **Authors:** [Young-Suk Lee](https://md.research.elamur.ai/free/en/authors/young-suk-lee/) · **Year:** 2004 · **Venue:** [Proceedings of HLT-NAACL 2004: Short Papers](https://md.research.elamur.ai/free/en/venues/naacl/) ([NAACL 2004](https://md.research.elamur.ai/free/en/venues/naacl/2004/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/) **Links:** [Publisher's page](https://aclanthology.org/N04-4015/) · [PDF](https://aclanthology.org/N04-4015.pdf) · [OpenAlex](https://openalex.org/W2017802499) **Citations:** 176 citations (OpenAlex, 2026-10-14) · [75](https://md.research.elamur.ai/free/en/papers/lee-2004-morphological-analysis-statistical-machine-translation/cited-by/) in our library, of the 141,840 papers whose bibliographies we read ## Summary The paper addresses a core difficulty in statistical machine translation between languages whose morphology differs sharply, using Arabic-to-English as the test case. A single Arabic orthographic word often packs several English words, such as an article, a preposition and a noun. Rare inflected forms are also poorly estimated. The author first splits Arabic words into prefix(es), stem and suffix(es), then POS-tags both sides of the parallel corpus. An automatic procedure built on IBM Model 1 alignments then decides, for each affix in a given stem-tag context, whether to keep it as a separate token, attach it back to its stem, or remove it. The goal is to make the two languages structurally closer. For phrase-based models, a hand-written rule additionally thins out redundant Arabic determiners inside noun phrases. Across training sets from 3.5K to 3.3M sentence pairs, BLEU improves substantially for both IBM Model 1 and a phrase translation model. The gains are largest when data is scarce. This shows that tailoring segmentation to the target language beats both raw words and maximal splitting. ## Key points - Prerequisites are fine-grained segmentation (following Lee et al. 2003), an Arabic POS tagger with about 120 tags from the LDC Arabic Treebank, and an English tagger with about 55 Penn Treebank tags. Tags are assumed to be single, with no combined tags like DET+NOUN. - The decision rule compares two distributions: - the top-3 English tags predicted for each Arabic tag, and - the English tags predicted for each affix+tag within a stem-tag context. - Affixes with no overlap become merge/delete candidates. A candidate is deleted if its most likely alignment is NULL and merged otherwise. - Evaluation used LDC Multiple Translation Arabic Part I (1,043 segments from AFP and Xinhua) with uncased BLEU and 4 references. Training data mixed news, Ummah and UN text in four sizes: 3.5K, 35K, 350K and 3.3M pairs. - IBM Model 1 BLEU rose from 0.10/0.14/0.18/0.18 to 0.25/0.29/0.31/0.32 across the four data sizes. - The phrase model (monotone decoding) rose from 0.17/0.24/0.32/0.36 to 0.24/0.29/0.36/0.39. - Automatic analysis alone reached 0.21/0.25/0.33/0.36. - The manual Al#-deletion rule therefore added the rest of the gain, but it did not help Model 1. ## Interesting ideas - **Let the other language decide segmentation granularity.** Splitting morphemes is not treated as good in itself. Each affix is kept separate only if it reliably maps to its own word class on the English side. This could guide how far to segment Ukrainian case endings or clitic-like particles for MT or alignment. - **Do the statistics over POS tags instead of words.** Working with tag-to-tag translation probabilities makes the merge/delete decisions robust and generalizable even with small corpora. It is a cheap way to induce linguistic rules from a parallel corpus. - **Use alignment to NULL as a deletion signal.** When a morpheme most often aligns to nothing, the paper drops it rather than gluing it to the stem. This is a simple, interpretable criterion that could be reused for function words or affixes in any language pair. - **Condition affix behavior on the stem's part of speech.** The same suffix may need different treatment after a noun than after a verb, so decisions are made per stem-tag context. This avoids one-size-fits-all preprocessing. - **Tune preprocessing to the model type and report per-component gains.** The determiner rule helped phrase models but not Model 1. The paper also reports automatic-only scores separately from automatic-plus-manual scores. This is a good evaluation habit for isolating which preprocessing step actually helps which system. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [IBM](https://md.research.elamur.ai/free/en/companies/ibm/) — Company, Armonk, United States · 85 works · 66,118 citations - [IBM Research - Thomas J. Watson Research Center](https://md.research.elamur.ai/free/en/labs/ibm-research-thomas-j-watson-research-center/) — Research institute, Yorktown Heights, United States · 41 works · 46,197 citations 📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,086 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,889 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works 🧭 Topics (3): [🔁 Machine translation](https://md.research.elamur.ai/free/en/topics/machine-translation/) · 958 works · [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 1,484 works · [🧩 Morphology](https://md.research.elamur.ai/free/en/topics/morphology/) · 277 works ## Cite Cite as: Young-Suk Lee. 2004. Morphological Analysis for Statistical Machine Translation. Proceedings of HLT-NAACL 2004: Short Papers. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{lee2004morphological, title = {{Morphological Analysis for Statistical Machine Translation}}, author = {Young-Suk Lee}, booktitle = {Proceedings of HLT-NAACL 2004: Short Papers}, year = {2004}, doi = {10.3115/1613984.1613999}, url = {https://doi.org/10.3115/1613984.1613999} } ``` - [← previous Learning to Classify Email into “Speech Acts”](https://md.research.elamur.ai/free/en/papers/cohen-2004-learning-classify-email-into-speech/) - [next → PageRank on Semantic Networks, with Application to Word Sense Disambiguation](https://md.research.elamur.ai/free/en/papers/mihalcea-2004-pagerank-semantic-networks-application-word/) - [↑ back to papers of 2004](https://md.research.elamur.ai/free/en/papers/2004/) ## References 8 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Brown, P., Della Pietra, S., Della Pietra, V., and Mercer, R. 1993. The mathematics of statistical machine translation: Parameter Estimation. Computational Linguistics, 19(2): 263—311. [find](https://scholar.google.com/scholar?q=Brown%2C+P%2E%2C+Della+Pietra%2C+S%2E%2C+Della+Pietra%2C+V%2E%2C+and+Mercer%2C+R%2E+1993%2E+The+mathematics+of+statistical+machine+translation%3A+Parameter+Estimation%2E+Computational+Linguistics%2C+19%282%29%3A+263%E2%80%94311%2E) 2. Lee, Y-S., Papineni, K., Roukos, S., Emam, O., Hassan, H. 2003. Language Model Based Arabic Word Segmentation. In Proceedings of the 41 st Annual Meeting of the ACL. Pages 399— 406. [find](https://scholar.google.com/scholar?q=Lee%2C+Y%2DS%2E%2C+Papineni%2C+K%2E%2C+Roukos%2C+S%2E%2C+Emam%2C+O%2E%2C+Hassan%2C+H%2E+2003%2E+Language+Model+Based+Arabic+Word+Segmentation%2E+In+Proceedings+of+the+41+st+Annual+Meeting+of+the+ACL%2E+Pages+399%E2%80%94+406%2E) 3. Sapporo, Japan. Niessen, S., Ney, H. 2000. Improving SMT quality with morpho-syntactic analysis. In Proceedings of 20 th International Conference on Computational Linguistics. [find](https://scholar.google.com/scholar?q=Sapporo%2C+Japan%2E+Niessen%2C+S%2E%2C+Ney%2C+H%2E+2000%2E+Improving+SMT+quality+with+morpho%2Dsyntactic+analysis%2E+In+Proceedings+of+20+th+International+Conference+on+Computational+Linguistics%2E) 4. Saarbrucken, Germany. Och, F. J., Ney. H. 2002. [Discriminative training and maximum entropy models for statistical machine translation](https://md.research.elamur.ai/free/en/papers/och-2002-discriminative-training-maximum-entropy-models/). In Proceedings of the 40 th Annual Meeting of the ACL. Pages 295—302. 5. Philadelphia. PA. Papineni, K., Roukos, S., Ward, R., Zhu W. 2002. [Bleu: a Method for Automatic Evaluation of Machine Translation](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/). Proceedings of the 40 th Annual Meeting of the ACL. Pages 311—318. 6. Philadelphia, PA. Tillmann, Christoph 2003. A Projection Extension Algorithm for Statistical Machine Translation. In Proceedings of the 2003 [find](https://scholar.google.com/scholar?q=Philadelphia%2C+PA%2E+Tillmann%2C+Christoph+2003%2E+A+Projection+Extension+Algorithm+for+Statistical+Machine+Translation%2E+In+Proceedings+of+the+2003) 7. Conference on Empirical Methods in Natural Language Processing. Pages 1—8. Sapporo, Japan. Yamada, K. and Knight, K. 2001. [A Syntax-Based Statistical Translation Model](https://md.research.elamur.ai/free/en/papers/yamada-2001-syntax-based-statistical-translation-model/). In Proceedings of the 39 th Conference of the ACL. 8. Pages 523—530. Toulouse, France. Yarowsky, D., G. Ngai and R. Wicentowski 2001. [Inducing Multilingual Text Analysis Tools via Robust Projection across Aligned Corpora](https://md.research.elamur.ai/free/en/papers/yarowsky-2001-inducing-multilingual-text-analysis-tools/). In Proceedings of HLT 2001 (ISBN: 1-55860-786-2). *Updated 24 October 2026*