---
title: "Improving Statistical MT through Morphological Analysis (2005)"
description: "Goldwater and McClosky test how far purely morphological processing, with no syntactic parsing, can… 12 references, cited by 65 papers here."
authors: ["Sharon Goldwater", "David McClosky"]
year: 2005
venue: "Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing"
source: "https://aclanthology.org/H05-1085/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/goldwater-2005-improving-statistical-mt-through-morphological/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/goldwater-2005-improving-statistical-mt-through-morphological/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2005](https://md.research.elamur.ai/free/en/papers/2005/) / Improving Statistical MT through Morphological Analysis

# Improving Statistical MT through Morphological Analysis

**Authors:** [Sharon Goldwater](https://md.research.elamur.ai/free/en/authors/sharon-goldwater/) and [David McClosky](https://md.research.elamur.ai/free/en/authors/david-mcclosky/) · **Year:** 2005 · **Venue:** [Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing](https://md.research.elamur.ai/free/en/venues/hlt/) ([HLT 2005](https://md.research.elamur.ai/free/en/venues/hlt/2005/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/H05-1085/) · [PDF](https://aclanthology.org/H05-1085.pdf) · [OpenAlex](https://openalex.org/W2170464899)

**Citations:** 168 citations (OpenAlex, 2026-10-14) · [65](https://md.research.elamur.ai/free/en/papers/goldwater-2005-improving-statistical-mt-through-morphological/cited-by/) in our library, of the 141,840 papers whose bibliographies we read

## Summary
Czech is heavily inflected, so most wordforms in a Czech–English parallel corpus are rare. That makes word alignment probabilities in a noisy-channel translation model hard to estimate, and many Czech inflectional contrasts have no English counterpart anyway. Goldwater and McClosky test how far purely morphological processing, with no syntactic parsing, can ease this. They use the morphologically annotated Czech side of the Prague Czech-English Dependency Treebank (PCEDT) and rewrite the source text in several ways:
- replacing wordforms with lemmas, either for all words, for selected parts of speech, or only for rare forms
- truncating words, as a baseline that needs no linguistic knowledge
- inserting single tags as standalone pseudoword tokens
- fusing tags onto lemmas

They also change the alignment model itself so that it operates on morphemes. Each tag class is evaluated separately with BLEU. The best system mixes treatments, with person and negation as pseudowords and number and tense attached to lemmas. It scores .333 BLEU on test against .270 for the word-to-word baseline. The result suggests that monolingual tools can partly compensate for scarce parallel data.

## Key points
- **Data:** The Czech portion of PCEDT annotates every token with a lemma and a tag string covering up to 15 morphological dimensions, such as POS, gender, number, tense and negation.
- **Methods:** There are four ways of using morphology. Three transform only the input (lemmas, pseudowords, modified lemmas), keeping the standard word alignment model. The fourth, novel method modifies the alignment model so that it works at the morpheme level.
- **Lemmatization and truncation:** Plain lemmatization helped substantially despite discarding information. Lemmatizing only infrequent forms gave a slight but inconclusive gain. Fixed-length word truncation (following Och, 1995) beat the baseline but fell short of lemmatization.
- **Case tags:** These did not improve any of the three basic models and were left out of the final system.
- **Combined model:** It reached BLEU .390 on development and .333 on test, compared with .270 for the baseline. The underlying translation system is word-based.

## Interesting ideas
- **Match each feature to how the target language expresses it.** Features that English expresses with function words (person, negation) work best as separate tokens. Features that English expresses through inflection (number, tense) work best fused with the lemma. The same rule of thumb could guide preprocessing for any morphologically rich source language, Ukrainian included.
- **Use pseudowords for pro-drop.** Emitting a person tag as its own token gives English subject pronouns something to align with when the source omits them. This trick could transfer to other pro-drop languages.
- **Normalize by frequency.** Keeping full forms for frequent words and lemmatizing only rare ones targets sparsity without discarding information where data is sufficient. It is a cheap, tunable knob for low-resource settings.
- **Use truncation as a fallback.** Cutting words to a fixed prefix recovers part of lemmatization's benefit with no analyzer at all. It is a sensible baseline when no morphological tools exist for a language.
- **Ablate one tag class at a time.** The paper evaluates each class of morphological information separately with an automatic metric before combining them. This shows which features actually help and avoids adding useless ones, as with the case tags here.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Brown University](https://md.research.elamur.ai/free/en/universities/brown-university/) — University, Providence, United States · 58 works · 25,310 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,085 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,888 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works

🧭 Topics (2): [🔁 Machine translation](https://md.research.elamur.ai/free/en/topics/machine-translation/) · 958 works · [🧩 Morphology](https://md.research.elamur.ai/free/en/topics/morphology/) · 277 works

## Cite

Cite as: Sharon Goldwater and David McClosky. 2005. Improving Statistical MT through Morphological Analysis. Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{goldwater2005improving,
  title = {{Improving Statistical MT through Morphological Analysis}},
  author = {Sharon Goldwater and David McClosky},
  booktitle = {Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing},
  year = {2005},
  doi = {10.3115/1220575.1220660},
  url = {https://doi.org/10.3115/1220575.1220660}
}
```

- [← previous A Discriminative Matching Approach to Word Alignment](https://md.research.elamur.ai/free/en/papers/taskar-2005-discriminative-matching-approach-word-alignment/)
- [next → Adaptation of the translation model for statistical machine translation based on information retrieval](https://md.research.elamur.ai/free/en/papers/hildebrand-2005-adaptation-translation-model-statistical-machine/)
- [↑ back to papers of 2005](https://md.research.elamur.ai/free/en/papers/2005/)

## References

12 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Y. Al-Onaizan, J. Cuřin, M. Jahr, K. Knight, J. Lafferty, D. Melamed, F. Och, D. Purdy, N. Smith, and D. Yarowsky. 1999. Statistical machine translation. [find](https://scholar.google.com/scholar?q=Y%2E+Al%2DOnaizan%2C+J%2E+Cur%CC%8Cin%2C+M%2E+Jahr%2C+K%2E+Knight%2C+J%2E+Lafferty%2C+D%2E+Melamed%2C+F%2E+Och%2C+D%2E+Purdy%2C+N%2E+Smith%2C+and+D%2E+Yarowsky%2E+1999%2E+Statistical+machine+translation%2E)
2. Final Report, JHU Summer Workshop 1999. [find](https://scholar.google.com/scholar?q=Final+Report%2C+JHU+Summer+Workshop+1999%2E)
3. P. Clarkson and R. Rosenfeld. 1997. Statistical language modeling using the CMU-Cambridge Toolkit. In Proceedings of ESCA Eurospeech. Current version available at [http://mi.eng.cam.ac.uk/∼prc14/toolkit.html](http://mi.eng.cam.ac.uk/∼prc14/toolkit.html). [↗](http://mi.eng.cam.ac.uk/∼prc14/toolkit.html)
4. J. Hajič. 1998. Building a Syntactically Annotated Corpus: The Prague Dependency Treebank. In Eva Hajičová, editor, Issues of Valency and Meaning. Studies in Honor of Jarmila Panevová, pages 12–19. Prague Karolinum, Charles University Press. [find](https://scholar.google.com/scholar?q=J%2E+Hajic%CC%8C%2E+1998%2E+Building+a+Syntactically+Annotated+Corpus%3A+The+Prague+Dependency+Treebank%2E+In+Eva+Hajic%CC%8Cova%CC%81%2C+editor%2C+Issues+of+Valency+and+Meaning%2E+Studies+in+Honor+of+Jarmila+Panevova%CC%81%2C+pages+12%E2%80%9319)
5. Y. Lee. 2004. [Morphological analysis for statistical machine translation](https://md.research.elamur.ai/free/en/papers/lee-2004-morphological-analysis-statistical-machine-translation/). In Proceedings NAACL.
6. D. Marcu and U. Germann. 2005. The ISI ReWrite Decoder 1.0.0a. Available at [http://www.isi.edu/licensed-sw/rewrite-decoder/](http://www.isi.edu/licensed-sw/rewrite-decoder/). [↗](http://www.isi.edu/licensed-sw/rewrite-decoder/)
7. S. Niessen and H. Ney. 2000. Improving SMT quality with morpho-syntactic analysis. In Proceedings of COLING. [find](https://scholar.google.com/scholar?q=S%2E+Niessen+and+H%2E+Ney%2E+2000%2E+Improving+SMT+quality+with+morpho%2Dsyntactic+analysis%2E+In+Proceedings+of+COLING%2E)
8. S. Niessen and H. Ney. 2004. Statistical machine translation with scarce resources using morphosyntactic analysis. Computational Linguistics, 30(2):181–204. [find](https://scholar.google.com/scholar?q=S%2E+Niessen+and+H%2E+Ney%2E+2004%2E+Statistical+machine+translation+with+scarce+resources+using+morphosyntactic+analysis%2E+Computational+Linguistics%2C+30%282%29%3A181%E2%80%93204%2E)
9. F. J. Och and H. Ney. 2003. A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1):19–51. [find](https://scholar.google.com/scholar?q=F%2E+J%2E+Och+and+H%2E+Ney%2E+2003%2E+A+systematic+comparison+of+various+statistical+alignment+models%2E+Computational+Linguistics%2C+29%281%29%3A19%E2%80%9351%2E)
10. F. Och. 1995. Statistical machine translation: The fabulous present and future. Invited talk at the Workshop on Building and Using Parallel Texts at ACL’05. [find](https://scholar.google.com/scholar?q=F%2E+Och%2E+1995%2E+Statistical+machine+translation%3A+The+fabulous+present+and+future%2E+Invited+talk+at+the+Workshop+on+Building+and+Using+Parallel+Texts+at+ACL%E2%80%9905%2E)
11. M. Čmejrek, J. Cuřı́n, and J. Havelka. 2003. Czech-english dependency-based machine translation. In Proceedings of EACL. [find](https://scholar.google.com/scholar?q=M%2E+C%CC%8Cmejrek%2C+J%2E+Cur%CC%8C%C4%B1%CC%81n%2C+and+J%2E+Havelka%2E+2003%2E+Czech%2Denglish+dependency%2Dbased+machine+translation%2E+In+Proceedings+of+EACL%2E)
12. M. Čmejrek, J. Cuřı́n, J. Havelka, J. Hajič, and V. Kuboň. 2004. Prague czech-english dependecy treebank: Syntactically annotated resources for machine translation. In 4th International Conference on Language Resources and Evaluation, Lisbon, Portugal. [find](https://scholar.google.com/scholar?q=M%2E+C%CC%8Cmejrek%2C+J%2E+Cur%CC%8C%C4%B1%CC%81n%2C+J%2E+Havelka%2C+J%2E+Hajic%CC%8C%2C+and+V%2E+Kubon%CC%8C%2E+2004%2E+Prague+czech%2Denglish+dependecy+treebank%3A+Syntactically+annotated+resources+for+machine+translation%2E+In+4th+International+Conference)

*Updated 24 October 2026*