---
title: "Inducing Multilingual Text Analysis Tools — Yarowsky 2001"
description: "Most of the world's languages have no annotated corpora, so they lack statistical taggers and analyzers."
authors: ["David Yarowsky", "Grace Ngai", "Richard Wicentowski"]
year: 2001
venue: "Proceedings of the First International Conference on Human Language Technology Research"
source: "https://aclanthology.org/H01-1035/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/yarowsky-2001-inducing-multilingual-text-analysis-tools/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/yarowsky-2001-inducing-multilingual-text-analysis-tools/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2001](https://md.research.elamur.ai/free/en/papers/2001/) / Inducing Multilingual Text Analysis Tools via Robust Projection across Aligned Corpora

# Inducing Multilingual Text Analysis Tools via Robust Projection across Aligned Corpora

**Authors:** [David Yarowsky](https://md.research.elamur.ai/free/en/authors/david-yarowsky/), Grace Ngai, Richard Wicentowski · **Year:** 2001 · **Venue:** Proceedings of the First International Conference on Human Language Technology Research · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/H01-1035/) · [PDF](https://aclanthology.org/H01-1035.pdf) · [OpenAlex](https://openalex.org/W2016630033)

**Citations:** 482 citations (openalex-snapshot · 2026-10-14) · [252](#cited-by) in our library, of the 140884 papers whose bibliographies we read

## Summary
Most of the world's languages have no annotated corpora, so they lack statistical taggers and analyzers. The authors bootstrap such tools from English. They run existing English analyzers, such as the Brill tagger, on the English side of a parallel corpus. They then carry the resulting labels over to the other language through automatic word alignments produced by EGYPT (IBM Model 3). The corpora include the Canadian and Hong Kong Hansards, a Czech-English Reader's Digest collection and several Bible versions.

Labels transferred this way are very noisy, even when the alignments are perfect. To cope with this, the paper introduces noise-tolerant training procedures that turn the imperfect projections into stand-alone monolingual tools: POS taggers, base noun-phrase bracketers, named-entity taggers and lemmatizers. The case studies cover French, Chinese, Czech and Spanish.

For French, the induced tagger reaches 96% core-tag accuracy, the bracketer exceeds 91% F-measure, and verb lemmatization is above 99% accurate. None of this used hand-annotated data in the target language, and all results clearly beat raw projection. The approach suggests a cheap way to reuse English resources for under-resourced languages.

## Key points
- **Data:** roughly 2 million words per language were used for tagging and bracketing.
  - Corpora: English-French Canadian Hansards, English-Chinese Hong Kong Hansards, Czech-English Reader's Digest.
  - Bibles: French Douay-Rheims, Spanish Reina Valera, and the King James, New International and Revised Standard versions in English.
  - Alignment: all word alignment was done with EGYPT, using raw words (characters for Chinese) and no stemming or dictionaries.
- **French POS results:**
  - Direct projection of core tags scores 76% with automatic alignments and 85% with manually corrected ones.
  - A standard bigram tagger trained on the projections reaches 86% on the aligned data and 82% on unseen French.
  - The noise-robust model scores 96% on the aligned data and 94% on unseen text. Fully supervised training reaches 97–98%.
  - The test set is a separate 200K-word hand-tagged French corpus from Université de Montréal.
  - Overall, the robust training cuts error by 71% relative to raw projection.
- **Low tag ambiguity:** words rarely carry more than two core POS tags.
  - In the Brown Corpus, only 0.37% of tokens fall outside a word's two most frequent tags.
  - In French, the figure is 0.03%.
- **Morphology:**
  - Lemmatization works even when the French Bible is the only bridge text, evaluated on Hansards verbs.
  - Accuracy improves steadily as the aligned corpus grows from 120K to 12M words.
  - Over 60% of errors come from roots missing from the automatically built candidate list.
  - Czech results are weaker because of poor alignments, a small corpus and near-duplicate perfective/imperfective roots.

## Interesting ideas
- **Separate the lexical and sequence models.** The tagger trains P(tag|word) and the tag-sequence model independently, and each gets its own noise treatment. This is useful whenever training labels are noisy, because different model components fail in different ways.
- **Amplify the dominant label per word.** Each word's most frequent projected tag is boosted, while lower-ranked tags are shrunk or zeroed, and the same step is repeated at the subtag level. This exploits the fact that words are rarely ambiguous, and it could clean up any weakly supervised lexicon, including Ukrainian ones.
- **Weight training sentences by trustworthiness.** Each sentence counts according to its alignment score and how well its projected tags agree with first-pass lexical priors. Because alignment errors come in bursts, dropping or downweighting weak regions improves quality while losing little useful data. The same idea fits any automatically labeled corpus.
- **Mark phrasal alignments explicitly first.** When one English word aligns to several foreign words, each target word first receives a position-indexed tag. A learned mapping later converts these to ordinary tags, instead of forcing a guess at projection time.
- **Evaluate on a task with agreed answers.** Morphology is scored by whether the system picks the correct root, which lexicographers largely agree on, rather than by theory-dependent analyses. The authors also note that for retrieval-style uses, grouping inflections correctly matters more than the exact lemma label.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

Topics: [Part-of-speech tagging](https://md.research.elamur.ai/free/en/topics/part-of-speech-tagging/)

## Cited by

Cited by

252 papers of our library cite it (of the 140884 whose bibliographies we read); 26 of them have a page here, 226 not yet.

- [Part-of-Speech Tagging for Middle English through Alignment and Projection of Parallel Diachronic Texts](https://md.research.elamur.ai/free/en/papers/aclbulk-2007-moon-part-speech-tagging-middle-english/)
- [Universal Dependencies for Croatian (that work for Serbian, too)](https://md.research.elamur.ai/free/en/papers/agic-2015-universal-dependencies-croatian-that-work/)
- [Multilingual Projection for Parsing Truly Low-Resource Languages](https://md.research.elamur.ai/free/en/papers/agic-2016-multilingual-projection-parsing-truly-low/)
- [JW300: A Wide-Coverage Parallel Corpus for Low-Resource Languages](https://md.research.elamur.ai/free/en/papers/agic-2019-jw300-wide-coverage-parallel-corpus/)
- [Generating High Quality Proposition Banks for Multilingual Semantic Role Labeling](https://md.research.elamur.ai/free/en/papers/akbik-2015-generating-high-quality-proposition-banks/)
- [Many Languages, One Parser](https://md.research.elamur.ai/free/en/papers/ammar-2016-many-languages-one-parser/)
- [ParaCrawl: Web-Scale Acquisition of Parallel Corpora](https://md.research.elamur.ai/free/en/papers/banon-2020-paracrawl-web-scale-acquisition-parallel/)
- [Knowledge-lean projection of coreference chains across languages](https://md.research.elamur.ai/free/en/papers/grishina-2015-knowledge-lean-projection-coreference-chains/)
- [Multi-source annotation projection of coreference chains: assessing strategies and testing opportunities](https://md.research.elamur.ai/free/en/papers/grishina-2017-multi-source-annotation-projection-coreference/)
- [Cross-lingual Dependency Parsing Based on Distributed Representations](https://md.research.elamur.ai/free/en/papers/guo-2015-cross-lingual-dependency-parsing-based/)
- [A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios](https://md.research.elamur.ai/free/en/papers/hedderich-2021-survey-recent-approaches-natural-language/)
- [Challenges and Strategies in Cross-Cultural NLP](https://md.research.elamur.ai/free/en/papers/hershcovich-2022-challenges-strategies-cross-cultural-nlp/)
- [A FrameNet-Based Semantic Role Labeler for Swedish](https://md.research.elamur.ai/free/en/papers/johansson-2006-framenet-based-semantic-role-labeler/)
- [A Rich Morphological Tagger for English: Exploring the Cross-Linguistic Tradeoff Between Morphology and Syntax](https://md.research.elamur.ai/free/en/papers/kirov-2017-rich-morphological-tagger-english-exploring/)
- [Bridging Resolution: A Survey of the State of the Art](https://md.research.elamur.ai/free/en/papers/kobayashi-2020-bridging-resolution-survey-state-art/)
- [Whit's the Richt Pairt o Speech: PoS tagging for Scots](https://md.research.elamur.ai/free/en/papers/lameris-2021-whit-s-richt-pairt-o/)
- [Cross-lingual Discourse Relation Analysis: A corpus study and a semi-supervised classification system](https://md.research.elamur.ai/free/en/papers/li-2014-cross-lingual-discourse-relation-analysis/)
- [Transferring Coreference Resolvers with Posterior Regularization](https://md.research.elamur.ai/free/en/papers/martins-2015-transferring-coreference-resolvers-posterior-regularization/)
- [The Johns Hopkins University Bible Corpus: 1600+ Tongues for Typological Exploration](https://md.research.elamur.ai/free/en/papers/mccarthy-2020-johns-hopkins-university-bible-corpus/)
- [Improving Machine Translation Performance by Exploiting Non-Parallel Corpora](https://md.research.elamur.ai/free/en/papers/munteanu-2005-improving-machine-translation-performance-exploiting/)
- [Modeling Language Variation and Universals: A Survey on Typological Linguistics for Natural Language Processing](https://md.research.elamur.ai/free/en/papers/ponti-2019-modeling-language-variation-universals-survey/)
- [Massively Multilingual Transfer for NER](https://md.research.elamur.ai/free/en/papers/rahimi-2019-massively-multilingual-transfer-ner/)
- [The Web as a Parallel Corpus](https://md.research.elamur.ai/free/en/papers/resnik-2003-web-as-parallel-corpus/)
- [Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog](https://md.research.elamur.ai/free/en/papers/schuster-2019-cross-lingual-transfer-learning-multilingual/)
- [DGT-TM: A freely available Translation Memory in 22 languages](https://md.research.elamur.ai/free/en/papers/steinberger-2012-dgt-tm-freely-available-translation/)
- [End-to-End Slot Alignment and Recognition for Cross-Lingual NLU](https://md.research.elamur.ai/free/en/papers/xu-2020-end-end-slot-alignment-recognition/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{yarowsky2001inducing,
  title = {{Inducing Multilingual Text Analysis Tools via Robust Projection across Aligned Corpora}},
  author = {Yarowsky, David and Ngai, Grace and Wicentowski, Richard},
  booktitle = {Proceedings of the First International Conference on Human Language Technology Research},
  year = {2001},
  doi = {10.3115/1072133.1072187},
  url = {https://doi.org/10.3115/1072133.1072187}
}
```

- [← previous Immediate-Head Parsing for Language Models](https://md.research.elamur.ai/free/en/papers/charniak-2001-immediate-head-parsing-language-models/)
- [next → Knowledge-Free Induction of Inflectional Morphologies](https://md.research.elamur.ai/free/en/papers/aclbulk-2001-schone-knowledge-free-induction-inflectional-morphologies/)
- [↑ back to papers of 2001](https://md.research.elamur.ai/free/en/papers/2001/)

## References

16 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Y. Al-Onaizan, J. Curin, M. Jahr, K. Knight, J. Lafferty, D. Melamed, FJ Och, D. Purdy, N. Smith and D. Yarowsky. 1999. Statistical Machine Translation (tech report). Johns Hopkins University. [find](https://scholar.google.com/scholar?q=Y%2E+Al%2DOnaizan%2C+J%2E+Curin%2C+M%2E+Jahr%2C+K%2E+Knight%2C+J%2E+Lafferty%2C+D%2E+Melamed%2C+FJ+Och%2C+D%2E+Purdy%2C+N%2E+Smith+and+D%2E+Yarowsky%2E+1999%2E+Statistical+Machine+Translation+%28tech+report%29%2E+Johns+Hopkins+University%2E)
2. E. Brill. 1995. Transformation-based error-driven learning and natural language processing: A case study in part of speech tagging. Computational Linguistics, 24(1): 543–565. [find](https://scholar.google.com/scholar?q=E%2E+Brill%2E+1995%2E+Transformation%2Dbased+error%2Ddriven+learning+and+natural+language+processing%3A+A+case+study+in+part+of+speech+tagging%2E+Computational+Linguistics%2C+24%281%29%3A+543%E2%80%93565%2E) [our card](https://md.research.elamur.ai/free/en/papers/brill-1995-transformation-based-error-driven-learning/)
3. P. Brown, J. Cocke, S. DellaPietra, V. DellaPietra, F. Jelinek, J. Lafferty, R. Mercer, and P. Rossin. 1990. A statistical approach to machine translation. Computational Linguistics, 16(2):29–85. [find](https://scholar.google.com/scholar?q=P%2E+Brown%2C+J%2E+Cocke%2C+S%2E+DellaPietra%2C+V%2E+DellaPietra%2C+F%2E+Jelinek%2C+J%2E+Lafferty%2C+R%2E+Mercer%2C+and+P%2E+Rossin%2E+1990%2E+A+statistical+approach+to+machine+translation%2E+Computational+Linguistics%2C+16%282%29%3A29%E2%80%9385%2E)
4. S. Cucerzan and D. Yarowsky. 1999. Language independent named entity recognition combining morphological and contextual evidence.” In Proceedings, 1999 Joint SIGDAT Conference on Empirical Methods in NLP and Very Large Corpora, pp. 90-99. [find](https://scholar.google.com/scholar?q=S%2E+Cucerzan+and+D%2E+Yarowsky%2E+1999%2E+Language+independent+named+entity+recognition+combining+morphological+and+contextual+evidence%2E%E2%80%9D+In+Proceedings%2C+1999+Joint+SIGDAT+Conference+on+Empirical+Methods+in+)
5. P. Fung and K. Church. 1994. K-vec: a new approach for aligning parallel texts. In Proceedings of COLING-94, pp. 1096–1102. [find](https://scholar.google.com/scholar?q=P%2E+Fung+and+K%2E+Church%2E+1994%2E+K%2Dvec%3A+a+new+approach+for+aligning+parallel+texts%2E+In+Proceedings+of+COLING%2D94%2C+pp%2E+1096%E2%80%931102%2E)
6. P. Fung and K. McKeown. 1994. Aligning noisy parallel corpora across language groups: Word pair feature matching by dynamic warping. In Proceedings of AMTA-94, pp. 81–88. [find](https://scholar.google.com/scholar?q=P%2E+Fung+and+K%2E+McKeown%2E+1994%2E+Aligning+noisy+parallel+corpora+across+language+groups%3A+Word+pair+feature+matching+by+dynamic+warping%2E+In+Proceedings+of+AMTA%2D94%2C+pp%2E+81%E2%80%9388%2E)
7. D. Jones, and R. Havrilla. 1998 Twisted pair grammar: Support for rapid development of machine translation for low density languages In Procs. of AMTA’98, pp. 318–332. [find](https://scholar.google.com/scholar?q=D%2E+Jones%2C+and+R%2E+Havrilla%2E+1998+Twisted+pair+grammar%3A+Support+for+rapid+development+of+machine+translation+for+low+density+languages+In+Procs%2E+of+AMTA%E2%80%9998%2C+pp%2E+318%E2%80%93332%2E)
8. D. Melamed. 1999. Bitext maps and alignment via pattern recognition. Computational Linguistics, 25(1):107–130. [find](https://scholar.google.com/scholar?q=D%2E+Melamed%2E+1999%2E+Bitext+maps+and+alignment+via+pattern+recognition%2E+Computational+Linguistics%2C+25%281%29%3A107%E2%80%93130%2E)
9. G. Ngai and R. Florian. 2001. Transformation-based learning in the fast lane. In Proceedings of NAACL-2001, pp. 40-47. [find](https://scholar.google.com/scholar?q=G%2E+Ngai+and+R%2E+Florian%2E+2001%2E+Transformation%2Dbased+learning+in+the+fast+lane%2E+In+Proceedings+of+NAACL%2D2001%2C+pp%2E+40%2D47%2E)
10. F.J. Och and H. Ney. 2000. Improved statistical alignment models. In Proceedings of ACL-2000, pp. 440-447. [find](https://scholar.google.com/scholar?q=F%2EJ%2E+Och+and+H%2E+Ney%2E+2000%2E+Improved+statistical+alignment+models%2E+In+Proceedings+of+ACL%2D2000%2C+pp%2E+440%2D447%2E) [our card](https://md.research.elamur.ai/free/en/papers/och-2000-improved-statistical-alignment-models/)
11. L. Ramshaw and M. Marcus, 1999. Text chunking using transformation-based learning. In Armstrong et al. (Eds.), Natural Language Processing Using Very Large Corpora. Kluwer, pp. 157-176. [find](https://scholar.google.com/scholar?q=L%2E+Ramshaw+and+M%2E+Marcus%2C+1999%2E+Text+chunking+using+transformation%2Dbased+learning%2E+In+Armstrong+et+al%2E+%28Eds%2E%29%2C+Natural+Language+Processing+Using+Very+Large+Corpora%2E+Kluwer%2C+pp%2E+157%2D176%2E)
12. P. Resnik, M. Olsen, and M. Diab. 2000. The Bible as a parallel corpus: annotating the ‘Book of 2000 Tongues’ Computers and the Humanities, 33(1-2):129-153. [find](https://scholar.google.com/scholar?q=P%2E+Resnik%2C+M%2E+Olsen%2C+and+M%2E+Diab%2E+2000%2E+The+Bible+as+a+parallel+corpus%3A+annotating+the+%E2%80%98Book+of+2000+Tongues%E2%80%99+Computers+and+the+Humanities%2C+33%281%2D2%29%3A129%2D153%2E)
13. D. Wu. 1995. An algorithm for simultaneously bracketing parallel texts. In Proc. of ACL-95, pp. 244–251. [find](https://scholar.google.com/scholar?q=D%2E+Wu%2E+1995%2E+An+algorithm+for+simultaneously+bracketing+parallel+texts%2E+In+Proc%2E+of+ACL%2D95%2C+pp%2E+244%E2%80%93251%2E)
14. D. Wu. 1997. Statistical inversion transduction grammars an bilingual parsing of parallel corpora. Computational Linguistics, 23(3):377-404. [find](https://scholar.google.com/scholar?q=D%2E+Wu%2E+1997%2E+Statistical+inversion+transduction+grammars+an+bilingual+parsing+of+parallel+corpora%2E+Computational+Linguistics%2C+23%283%29%3A377%2D404%2E)
15. D. Yarowsky and G. Ngai. 2001. Inducing multilingual POS taggers and NP Bracketers via robust projection across aligned corpora. In Proceedings of NAACL-2001, pp. 377-404. [find](https://scholar.google.com/scholar?q=D%2E+Yarowsky+and+G%2E+Ngai%2E+2001%2E+Inducing+multilingual+POS+taggers+and+NP+Bracketers+via+robust+projection+across+aligned+corpora%2E+In+Proceedings+of+NAACL%2D2001%2C+pp%2E+377%2D404%2E)
16. D. Yarowsky and R. Wicentowski. 2000. Minimally supervised morphological analysis by multimodal alignment. In Proceedings of ACL-2000, pp. 207-216. [find](https://scholar.google.com/scholar?q=D%2E+Yarowsky+and+R%2E+Wicentowski%2E+2000%2E+Minimally+supervised+morphological+analysis+by+multimodal+alignment%2E+In+Proceedings+of+ACL%2D2000%2C+pp%2E+207%2D216%2E)