---
title: "Automatic Identification of Word Translations from Unrelated English and German Corpora — Rapp 1999"
description: "For each German word, it builds a co-occurrence vector over the seed words and maps the known entries into… 23 references, cited by 203 papers here."
authors: ["Reinhard Rapp"]
year: 1999
venue: "Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics"
source: "https://aclanthology.org/P99-1067/"
doi: "10.3115/1034678.1034756"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/rapp-1999-automatic-identification-word-translations-unrelated/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/rapp-1999-automatic-identification-word-translations-unrelated/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [1999](https://md.research.elamur.ai/free/en/papers/1999/) / Automatic Identification of Word Translations from Unrelated English and German Corpora

# Automatic Identification of Word Translations from Unrelated English and German Corpora

**Authors:** [Reinhard Rapp](https://md.research.elamur.ai/free/en/authors/reinhard-rapp/) · **Year:** 1999 · **Venue:** Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/P99-1067/) · [PDF](https://aclanthology.org/P99-1067.pdf) · [DOI 10.3115/1034678.1034756](https://doi.org/10.3115/1034678.1034756) · [OpenAlex](https://openalex.org/W2102749417)

**Citations:** 456 citations (OpenAlex, 2026-10-14) · [203](https://md.research.elamur.ai/free/en/papers/rapp-1999-automatic-identification-word-translations-unrelated/cited-by/) in our library, of the 140,884 papers whose bibliographies we read

## Summary
The paper addresses how to find word translations when no parallel text exists, using only two monolingual corpora that are largely unrelated in content. The usual alignment clues (word/sentence order, frequency correlation, cognates) mostly fail in this setting. The author therefore relies on one assumption: if two words co-occur unusually often in one language, their translations should also co-occur unusually often in the other.

The method starts from a small German–English seed dictionary. For each German word, it builds a co-occurrence vector over the seed words and maps the known entries into English. It then compares this vector with the vectors of all English words built from the English corpus, and the closest English vector is taken as the translation.

The data are the Frankfurter Allgemeine Zeitung and the Guardian. Both corpora were lemmatized and stripped of function words. Co-occurrences are counted separately for each window position, and raw counts are replaced by association strengths.

On 100 test words, about 72% were translated correctly, compared with roughly 30% in earlier non-parallel work. This shows that cheap monolingual text can be used to extend bilingual dictionaries.

## Key points
- Corpora: 135 million words of Frankfurter Allgemeine Zeitung (1993–1996) and 163 million words of the Guardian (1990–1994). The papers differ in orientation and only partly overlap in time, so the corpora are treated as unrelated.
- Seed lexicon: derived from the Collins Gem German Dictionary (about 22,300 entries). Removing multi-word entries left 16,380, and all entries for the test words were then removed as well.
- Test set: 100 German stimulus words from Russell's (1970) word association norms, with their English translations as the reference.
- Preprocessing: function words were removed (lists of about 600 German and about 200 English words). Lemmatization used only a morphological lexicon, without context. The window size was 3, with a separate vector for each position, so word order is preserved.
- Results: about 72% correct, versus about 30% for prior non-parallel methods and up to 99% reported for parallel texts. Ambiguity explains some failures. For example, the expected translation of *Kohl* ("cabbage") is ranked 17,074th, and the top candidates are politicians such as Major, Thatcher and Gorbachev.

## Interesting ideas
- **A seed dictionary makes the search cheap.** Assuming a small starting lexicon turns an infeasible search over matrix permutations into simple vector comparisons. This is a practical way to bootstrap lexicons for any low-resource language pair where only a basic dictionary exists, such as Ukrainian paired with a smaller language.
- **Position-specific co-occurrence vectors.** Instead of summing counts over a window, the method concatenates one vector per relative position. This keeps rough word-order information at low cost and could help in other distributional similarity tasks.
- **Symmetric preprocessing across languages.** The author deliberately skipped a context-sensitive German lemmatizer because no English equivalent was available, so both sides were treated alike. Keeping pipelines comparable matters whenever two languages' representations are compared directly.
- **Leakage-free evaluation design.** The test words were fixed in advance and their entries removed from the seed lexicon, so the method could never see the answers. The author also reports the rank of the expected translation rather than just hit or miss. Both habits make evaluation more honest and error analysis more informative.
- **Precision-only scoring, with a stated reason.** Recall was not measured because it depends heavily on how large the reference dictionary is. Being explicit about which metrics are meaningful for a given gold standard is worth copying.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

## Institutions

- [Johannes Gutenberg University Mainz](https://md.research.elamur.ai/free/en/universities/johannes-gutenberg-university-mainz/) — University, Mainz, Germany · 3 works · 662 citations

## Cite

Cite as: Reinhard Rapp. 1999. Automatic Identification of Word Translations from Unrelated English and German Corpora. Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{rapp1999automatic,
  title = {{Automatic Identification of Word Translations from Unrelated English and German Corpora}},
  author = {Reinhard Rapp},
  booktitle = {Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics},
  year = {1999},
  doi = {10.3115/1034678.1034756},
  url = {https://doi.org/10.3115/1034678.1034756}
}
```

- [← previous Improved Alignment Models for Statistical Machine Translation](https://md.research.elamur.ai/free/en/papers/och-1999-improved-alignment-models-statistical-machine/)
- [next → Measures of Distributional Similarity](https://md.research.elamur.ai/free/en/papers/lee-1999-measures-distributional-similarity/)
- [↑ back to papers of 1999](https://md.research.elamur.ai/free/en/papers/1999/)

## References

23 references, 7 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Armstrong, S.; Kempen, M.; Petitpierre, D.; Rapp, R.; Thompson, H. (1998). Multilingual Corpora for Cooperation. Proceedings of the 1st International Conference on Linguistic Resources and Evaluation (LREC), Granada, Vol. 2, 975-980. [find](https://scholar.google.com/scholar?q=Armstrong%2C+S%2E%3B+Kempen%2C+M%2E%3B+Petitpierre%2C+D%2E%3B+Rapp%2C+R%2E%3B+Thompson%2C+H%2E+%281998%29%2E+Multilingual+Corpora+for+Cooperation%2E+Proceedings+of+the+1st+International+Conference+on+Linguistic+Resources+and+Evaluation+)
2. Brown, P.; Cocke, J.; Della Pietra, S. A.; Della Pietra, V. J.; Jelinek, F.; Lafferty, J. D.; Mercer, R. L.; Rossin, P. S. (1990). A statistical approach to machine translation. Computational Linguistics, 16(2), 79-85. [find](https://scholar.google.com/scholar?q=Brown%2C+P%2E%3B+Cocke%2C+J%2E%3B+Della+Pietra%2C+S%2E+A%2E%3B+Della+Pietra%2C+V%2E+J%2E%3B+Jelinek%2C+F%2E%3B+Lafferty%2C+J%2E+D%2E%3B+Mercer%2C+R%2E+L%2E%3B+Rossin%2C+P%2E+S%2E+%281990%29%2E+A+statistical+approach+to+machine+translation%2E+Computational+Linguist)
3. Church, K. W.; Hanks, P. (1989). Word association norms, mutual information, and lexicography. In: Proceedings of the 27th Annual Meeting of the Association for Computational Linguistics. Vancouver, British Columbia, 76-83. [our card](https://md.research.elamur.ai/free/en/papers/church-1990-word-association-norms-mutual-information/)
4. Dunning, T. (1993). Accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19(1), 61-74. [our card](https://md.research.elamur.ai/free/en/papers/dunning-1993-accurate-methods-statistics-surprise-coincidence/)
5. Fung, P. (1995). Compiling bilingual lexicon entries from a non-parallel English-Chinese corpus. Proceedings of the 3rd Annual Workshop on Very Large Corpora, Boston, Massachusetts, 173-183. [find](https://scholar.google.com/scholar?q=Fung%2C+P%2E+%281995%29%2E+Compiling+bilingual+lexicon+entries+from+a+non%2Dparallel+English%2DChinese+corpus%2E+Proceedings+of+the+3rd+Annual+Workshop+on+Very+Large+Corpora%2C+Boston%2C+Massachusetts%2C+173%2D183%2E)
6. Fung, P.; McKeown, K. (1997). Finding terminology translations from non-parallel corpora. Proceedings of the 5th Annual Workshop on Very Large Corpora, Hong Kong, 192-202. [find](https://scholar.google.com/scholar?q=Fung%2C+P%2E%3B+McKeown%2C+K%2E+%281997%29%2E+Finding+terminology+translations+from+non%2Dparallel+corpora%2E+Proceedings+of+the+5th+Annual+Workshop+on+Very+Large+Corpora%2C+Hong+Kong%2C+192%2D202%2E)
7. Fung, P.; Yee, L. Y. (1998). An IR approach for translating new words from nonparallel, comparable texts. In: Proceedings of COLING-ACL 1998, Montreal, Vol. 1,414-420. [our card](https://md.research.elamur.ai/free/en/papers/fung-1998-ir-approach-translating-new-words/)
8. Gale, W. A.; Church, K. W. (1993). A program for aligning sentences in bilingual corpora. Computational Linguistics, 19(3), 75-102. [our card](https://md.research.elamur.ai/free/en/papers/gale-1993-program-aligning-sentences-bilingual-corpora/)
9. Grefenstette, G. (1993). Evaluation techniques for automatic semantic extraction: comparing syntactic and window based approaches. In: Proceedings of the Workshop on Acquisition of Lexical Knowledge from Text, Columbus, Ohio. [find](https://scholar.google.com/scholar?q=Grefenstette%2C+G%2E+%281993%29%2E+Evaluation+techniques+for+automatic+semantic+extraction%3A+comparing+syntactic+and+window+based+approaches%2E+In%3A+Proceedings+of+the+Workshop+on+Acquisition+of+Lexical+Knowledge+f)
10. Grefenstette, G. (1994). Explorations in Automatic Thesaurus Discovery. Dordrecht: Kluwer. [find](https://scholar.google.com/scholar?q=Grefenstette%2C+G%2E+%281994%29%2E+Explorations+in+Automatic+Thesaurus+Discovery%2E+Dordrecht%3A+Kluwer%2E)
11. Jones, W. P.; Furnas, G. W. (1987). Pictures of relevance: a geometric analysis of similarity measures. Journal of the American Society for Information Science, 38(6), 420-442. [find](https://scholar.google.com/scholar?q=Jones%2C+W%2E+P%2E%3B+Furnas%2C+G%2E+W%2E+%281987%29%2E+Pictures+of+relevance%3A+a+geometric+analysis+of+similarity+measures%2E+Journal+of+the+American+Society+for+Information+Science%2C+38%286%29%2C+420%2D442%2E)
12. Kay, M.; Rfscheisen, M. (1993). Text-Translation Alignment. Computational Linguistics, 19(1), 121-142. [our card](https://md.research.elamur.ai/free/en/papers/kay-1993-text-translation-alignment/)
13. Landauer, T. K.; Dumais, S. T. (1997). A solution to Plato's problem: the latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104(2), 211-240. [find](https://scholar.google.com/scholar?q=Landauer%2C+T%2E+K%2E%3B+Dumais%2C+S%2E+T%2E+%281997%29%2E+A+solution+to+Plato%27s+problem%3A+the+latent+semantic+analysis+theory+of+acquisition%2C+induction%2C+and+representation+of+knowledge%2E+Psychological+Review%2C+104%282%29%2C+211%2D)
14. Langlais, P.; Simard, M.; V6ronis, J. (1998). Methods and practical issues in evaluating alignment techniques. In: Proceedings of COLING-ACL 1998, Montreal, Vol. l, 711-717. [find](https://scholar.google.com/scholar?q=Langlais%2C+P%2E%3B+Simard%2C+M%2E%3B+V6ronis%2C+J%2E+%281998%29%2E+Methods+and+practical+issues+in+evaluating+alignment+techniques%2E+In%3A+Proceedings+of+COLING%2DACL+1998%2C+Montreal%2C+Vol%2E+l%2C+711%2D717%2E)
15. Lezius, W.; Rapp, R.; Wettler, M. (1998). A freely available morphology system, part-of-speech tagger, and context-sensitive lemmatizer for German. In: Proceedings of COLING-ACL 1998, Montreal, Vol. 2, 743-748. [find](https://scholar.google.com/scholar?q=Lezius%2C+W%2E%3B+Rapp%2C+R%2E%3B+Wettler%2C+M%2E+%281998%29%2E+A+freely+available+morphology+system%2C+part%2Dof%2Dspeech+tagger%2C+and+context%2Dsensitive+lemmatizer+for+German%2E+In%3A+Proceedings+of+COLING%2DACL+1998%2C+Montreal%2C+Vol%2E+2)
16. Lin, D. (1998). Automatic Retrieval and Clustering of Similar Words. In: Proceedings of COLING-ACL 1998, Montreal, Vol. 2, 768-773. [our card](https://md.research.elamur.ai/free/en/papers/lin-1998-automatic-retrieval-clustering-similar-words/)
17. Rapp, R. (1995). Identifying word translations in non-parallel texts. In: Proceedings of the 33rd Meeting of the Association for Computational Linguistics. Cambridge, Massachusetts, 320-322. [our card](https://md.research.elamur.ai/free/en/papers/rapp-1995-identifying-word-translations-non-parallel/)
18. Rapp, R. (1996). Die Berechnung von Assoziationen. Hildesheim: Olms. [find](https://scholar.google.com/scholar?q=Rapp%2C+R%2E+%281996%29%2E+Die+Berechnung+von+Assoziationen%2E+Hildesheim%3A+Olms%2E)
19. Ruge, G. (1995). Human memory models and term association. Proceedings of the ACM SIGIR Conference, Seattle, 219-227. [find](https://scholar.google.com/scholar?q=Ruge%2C+G%2E+%281995%29%2E+Human+memory+models+and+term+association%2E+Proceedings+of+the+ACM+SIGIR+Conference%2C+Seattle%2C+219%2D227%2E)
20. Russell, W. A. (1970). The complete German language norms for responses to 100 words from the Kent-Rosanoff word association test. In: L. Postman, G. Keppel (eds.): Norms of Word Association. New York: Academic Press, 53-94. [find](https://scholar.google.com/scholar?q=Russell%2C+W%2E+A%2E+%281970%29%2E+The+complete+German+language+norms+for+responses+to+100+words+from+the+Kent%2DRosanoff+word+association+test%2E+In%3A+L%2E+Postman%2C+G%2E+Keppel+%28eds%2E%29%3A+Norms+of+Word+Association%2E+New+York)
21. Salton, G.; McGill, M. (1983). Introduction to Modem Information Retrieval. New York: McGraw-Hill. [find](https://scholar.google.com/scholar?q=Salton%2C+G%2E%3B+McGill%2C+M%2E+%281983%29%2E+Introduction+to+Modem+Information+Retrieval%2E+New+York%3A+McGraw%2DHill%2E)
22. Schiitze, H. (1993). Part-of-speech induction from scratch. In: Proceedings of the 31st Annual Meeting of the Association for Computational Linguistics, Columbus, Ohio, 251-258. [find](https://scholar.google.com/scholar?q=Schiitze%2C+H%2E+%281993%29%2E+Part%2Dof%2Dspeech+induction+from+scratch%2E+In%3A+Proceedings+of+the+31st+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+Columbus%2C+Ohio%2C+251%2D258%2E)
23. Wettler, M.; Rapp, R. (1993). Computation of word associations based on the co-occurrences of words in large corpora. In: Proceedings of the 1st Workshop on Very Large Corpora: Columbus, Ohio, 84-93. [find](https://scholar.google.com/scholar?q=Wettler%2C+M%2E%3B+Rapp%2C+R%2E+%281993%29%2E+Computation+of+word+associations+based+on+the+co%2Doccurrences+of+words+in+large+corpora%2E+In%3A+Proceedings+of+the+1st+Workshop+on+Very+Large+Corpora%3A+Columbus%2C+Ohio%2C+84%2D93%2E)