---
title: "The Effects of Language Relatedness on Multilingual Information"
description: "The paper asks whether cross-language retrieval involving Semitic languages, especially Arabic, can be… 18 references, cited by 1 paper here."
authors: ["Peter Chew", "Ahmed Abdelali"]
year: 2008
venue: "Proceedings of the 2nd workshop on Cross Lingual Information Access (CLIA) Addressing the Information Need of Multilingual Societies"
source: "https://aclanthology.org/I08-6001/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/chew-2008-effects-language-relatedness-multilingual-information/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/chew-2008-effects-language-relatedness-multilingual-information/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2008](https://md.research.elamur.ai/free/en/papers/2008/page/2/) / The Effects of Language Relatedness on Multilingual Information Retrieval: A Case Study With Indo-European and Semitic Languages

# The Effects of Language Relatedness on Multilingual Information Retrieval: A Case Study With Indo-European and Semitic Languages

**Authors:** Peter Chew and [Ahmed Abdelali](https://md.research.elamur.ai/free/en/authors/ahmed-abdelali/) · **Year:** 2008 · **Venue:** Proceedings of the 2nd workshop on Cross Lingual Information Access (CLIA) Addressing the Information Need of Multilingual Societies · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/I08-6001/) · [PDF](https://aclanthology.org/I08-6001.pdf) · [OpenAlex](https://openalex.org/W2295481403)

**Citations:** 9 citations (OpenAlex, 2026-10-14) · 1 in our library, of the 149,439 papers whose bibliographies we read

## Summary
The paper asks whether cross-language retrieval involving Semitic languages, especially Arabic, can be improved by changing only the training data while the retrieval model stays the same. The authors use multilingual Latent Semantic Analysis (LSA). Verse-aligned Bible translations are concatenated into a term-by-document matrix, weighted with log-entropy, and reduced by SVD to 300 dimensions. Documents are then compared by cosine similarity. Testing uses the 114 suras of the Quran in Arabic, English, French, Russian and Spanish. Success is measured by how often a document's true translation ranks first.

Three interventions are compared:
- adding related (Semitic) languages to training,
- adding an unrelated language that shares Arabic script,
- morphological preprocessing: light-stemming Arabic and stripping Hebrew vowels.

Adding more training languages helped generally. Script sharing did not help. Arabic stemming improved overall precision but barely helped Arabic pairs. Arabic gained most when Hebrew was added, or when Hebrew was made statistically closer to unvocalized Arabic. The result suggests that genetic relatedness, and putting related languages on a comparable footing, matters for multilingual training data.

## Key points
- **Training and test data:**
  - Training uses Bible translations from www.unboundbible.org, aligned by verse.
  - The test set has 570 documents (114 Quran suras × 5 languages).
  - The metric is precision at 1 document.
- **Model setup:**
  - Log-entropy weighting.
  - SVD keeping the top 300 singular values.
  - Projection of unseen documents via U × S⁻¹.
- **Type/token contrast (Gospel of Matthew):**
  - Afrikaans has 2,112 types over 24,729 tokens.
  - Arabic has 4,607 types over 13,930 tokens.
  - Amharic has 5,161 types over 12,940 tokens.
  - This illustrates how synthetic Semitic morphology packs more into each token.
- **Hebrew vowel removal** (Westminster Leningrad Codex): Arabic-pair precision rose from 0.476 to 0.528 (p ≈ 7.33 × 10⁻⁴). Other pairs showed no significant change.
- **Eleven training languages:** overall 0.739, within-IE 0.853, IE–Semitic 0.537.
- **Adding Hebrew as a twelfth language:**
  - IE–Semitic precision rose to 0.645 (p ≈ 4.39 × 10⁻¹³).
  - Overall precision rose to 0.778.
- **Arabic preprocessing:** the light stemmer used was Darwish 2002.

## Interesting ideas
- Comparing type and token counts on the same parallel passage gives a cheap gauge of how much meaning each surface token carries in each language.
- The study freezes the whole pipeline and varies only the training data, so any change in results can be attributed cleanly to the data.
- Stripping Hebrew vowels made Hebrew resemble the unvocalized Arabic, which helped the model link them; aligning conventions between sources can matter more than adding raw volume.
- Retrieval of the true translation among all candidates serves as an evaluation that needs no human relevance judgments.
- The authors tested a plausible but wrong cause (shared script, via Persian) as a control and found that gains from preprocessing one language could appear in other pairs.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (tokens): Run the same count on parallel or paraphrased English text to spot where the tokenizer and lemmatizer leave too much packed inside one token.
- **I2** (learn): Apply the same discipline when testing new silver data or teacher tiers: keep the parser and training code fixed and swap only the data, so every gain stays explainable.
- **I3** (tree): Before mixing treebanks, convert them to one UD dialect so the parser does not learn spurious distinctions caused only by annotation style.
- **I4** (back): Check the text → graph → text compressor by asking whether each regenerated text is matched back to its own source among many candidates.
- **I5** (learn): Include such negative controls when adding repair rules, and score all components, not just the targeted one, to catch displaced effects.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Sandia National Laboratories](https://md.research.elamur.ai/free/en/labs/sandia-national-laboratories/) — Research institute, Albuquerque, United States · 2 works · 32,682 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 1,437 works

🧭 Topics (3): [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 2,908 works · [🌍 Multilingual & cross-lingual NLP](https://md.research.elamur.ai/free/en/topics/multilingual-nlp/) · 828 works · [🔍 Information retrieval & search](https://md.research.elamur.ai/free/en/topics/information-retrieval/) · 473 works

💡 Concepts (2): [💡 Topic modeling](https://md.research.elamur.ai/free/en/concepts/topic-modeling/) · 47 works · [💡 Latent semantic indexing](https://md.research.elamur.ai/free/en/concepts/latent-semantic-indexing/) · 29 works

## Cite

Cite as: Peter Chew and Ahmed Abdelali. 2008. The Effects of Language Relatedness on Multilingual Information Retrieval: A Case Study With Indo-European and Semitic Languages. Proceedings of the 2nd workshop on Cross Lingual Information Access (CLIA) Addressing the Information Need of Multilingual Societies.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{chew2008effects,
  title = {{The Effects of Language Relatedness on Multilingual Information Retrieval: A Case Study With Indo-European and Semitic Languages}},
  author = {Peter Chew and Ahmed Abdelali},
  booktitle = {Proceedings of the 2nd workshop on Cross Lingual Information Access (CLIA) Addressing the Information Need of Multilingual Societies},
  year = {2008},
  url = {https://aclanthology.org/I08-6001/}
}
```

- [← previous Building the Valency Lexicon of Arabic Verbs](https://md.research.elamur.ai/free/en/papers/bielicky-2008-building-valency-lexicon-arabic-verbs/)
- [next → Converting Romanized Persian to the Arabic Writing Systems](https://md.research.elamur.ai/free/en/papers/maleki-2008-converting-romanized-persian-arabic-writing/)
- [↑ back to papers of 2008](https://md.research.elamur.ai/free/en/papers/2008/page/2/)

## References

18 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Abdou, S., Ruck, P., and Savoy, J. 2005. Evaluation of Stemming, Query Expansion and Manual Indexing Approaches for the Genomic Task. In Proceedings of TREC 2005. [find](https://scholar.google.com/scholar?q=Abdou%2C+S%2E%2C+Ruck%2C+P%2E%2C+and+Savoy%2C+J%2E+2005%2E+Evaluation+of+Stemming%2C+Query+Expansion+and+Manual+Indexing+Approaches+for+the+Genomic+Task%2E+In+Proceedings+of+TREC+2005%2E)
2. Berry, M. W., Dumais, S. T., and O’Brien, G. W. 1994. Using Linear Algebra for Intelligent Information Retrieval. SIAM: Review, 37, 573-595. [↗](https://doi.org/10.1137/1037127)
3. Biola University. 2005-2006. The Unbound Bible. Accessed at [http://www.unboundbible.com/](http://www.unboundbible.com/) on February 27, 2007. [↗](http://www.unboundbible.com/)
4. Chew, P. A., and Abdelali, A. 2007. Benefits of the ‘Massively Parallel Rosetta Stone’: Cross-Language Information Retrieval with over 30 Languages, Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics, ACL 2007. Prague, Czech Republic, June 23–30, 2007. pp. 872-879. [find](https://scholar.google.com/scholar?q=Chew%2C+P%2E+A%2E%2C+and+Abdelali%2C+A%2E+2007%2E+Benefits+of+the+%E2%80%98Massively+Parallel+Rosetta+Stone%E2%80%99%3A+Cross%2DLanguage+Information+Retrieval+with+over+30+Languages%2C+Proceedings+of+the+45th+Annual+Meeting+of+the+Assoc)
5. Chew, P. A., Verzi, S. J., Bauer, T. L., and McClain, J. T. 2006. Evaluation of the Bible as a Resource for Cross-Language Information Retrieval. Proceedings of the Workshop on Multilingual Language Resources and Interoperability, 68–74. [find](https://scholar.google.com/scholar?q=Chew%2C+P%2E+A%2E%2C+Verzi%2C+S%2E+J%2E%2C+Bauer%2C+T%2E+L%2E%2C+and+McClain%2C+J%2E+T%2E+2006%2E+Evaluation+of+the+Bible+as+a+Resource+for+Cross%2DLanguage+Information+Retrieval%2E+Proceedings+of+the+Workshop+on+Multilingual+Language+R)
6. Darwish, K. 2002. Building a shallow Arabic morphological analyzer in one day. In Proceedings of the Association for Computational Linguistics (ACL-02), 40th Anniversary Meeting. pp. 47-54. [find](https://scholar.google.com/scholar?q=Darwish%2C+K%2E+2002%2E+Building+a+shallow+Arabic+morphological+analyzer+in+one+day%2E+In+Proceedings+of+the+Association+for+Computational+Linguistics+%28ACL%2D02%29%2C+40th+Anniversary+Meeting%2E+pp%2E+47%2D54%2E)
7. Dumais, S. T. 1991. Improving the Retrieval of Information from External Sources. Behavior Research Methods, Instruments, and Computers 23 (2), 229-236. [↗](https://doi.org/10.3758/bf03203370)
8. Dumais, S. T., Furnas, G. W., Landauer, T. K., Deerwester, S. and Harshman, R. 1998. Using Latent Semantic Analysis to Improve Access to Textual Information. In CHI’88: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 281-285. ACM Press. [find](https://scholar.google.com/scholar?q=Dumais%2C+S%2E+T%2E%2C+Furnas%2C+G%2E+W%2E%2C+Landauer%2C+T%2E+K%2E%2C+Deerwester%2C+S%2E+and+Harshman%2C+R%2E+1998%2E+Using+Latent+Semantic+Analysis+to+Improve+Access+to+Textual+Information%2E+In+CHI%E2%80%9988%3A+Proceedings+of+the+SIGCHI+Confe)
9. Frakes, W. B. and Baeza-Yates, R. 1992. Information Retrieval: Data Structures and Algorithms. Prentice-Hall: New Jersey. [find](https://scholar.google.com/scholar?q=Frakes%2C+W%2E+B%2E+and+Baeza%2DYates%2C+R%2E+1992%2E+Information+Retrieval%3A+Data+Structures+and+Algorithms%2E+Prentice%2DHall%3A+New+Jersey%2E)
10. Habash, N. 2004. Large Scale Lexeme Based Arabic Morphological Generation. In Proc. of Traitement Automatique du Langage Naturel. [find](https://scholar.google.com/scholar?q=Habash%2C+N%2E+2004%2E+Large+Scale+Lexeme+Based+Arabic+Morphological+Generation%2E+In+Proc%2E+of+Traitement+Automatique+du+Langage+Naturel%2E)
11. Larkey, L., Ballesteros, L. and Connell, M. 2002. Improving Stemming for Arabic Information Retrieval: Light Stemming and Co-Occurrence Analysis. SIGIR 2002, Finland, pp. 275-282. [find](https://scholar.google.com/scholar?q=Larkey%2C+L%2E%2C+Ballesteros%2C+L%2E+and+Connell%2C+M%2E+2002%2E+Improving+Stemming+for+Arabic+Information+Retrieval%3A+Light+Stemming+and+Co%2DOccurrence+Analysis%2E+SIGIR+2002%2C+Finland%2C+pp%2E+275%2D282%2E)
12. Larkey, L. and Connell, M. 2002. Arabic Information Retrieval at Umass in TREC-10. In Voorhees, E.M. and Harman, D.K. (eds.): The Tenth Text Retrieval Conference, TREC 2001 NIST Special Publication 500-250, pp. 562-570. [find](https://scholar.google.com/scholar?q=Larkey%2C+L%2E+and+Connell%2C+M%2E+2002%2E+Arabic+Information+Retrieval+at+Umass+in+TREC%2D10%2E+In+Voorhees%2C+E%2EM%2E+and+Harman%2C+D%2EK%2E+%28eds%2E%29%3A+The+Tenth+Text+Retrieval+Conference%2C+TREC+2001+NIST+Special+Publication+50)
13. Lavie, A., Peterson, E., Probst, K., Wintner, S., and Ey-tani, Y. 2004. [Rapid Prototyping of a Transfer-Based Hebrew-to-English Machine Translation System](https://md.research.elamur.ai/free/en/papers/lavie-2004-rapid-prototyping-transfer-based-hebrew/). In Proceedings of the TMI-04.
14. Mathieu, B., Besançon, R. and Fluhr, C. 2004. Multilingual Document Clusters Discovery. Recherche d’Information Assistée par Ordinateur (RIAO) Proceedings, 1-10. [find](https://scholar.google.com/scholar?q=Mathieu%2C+B%2E%2C+Besan%C3%A7on%2C+R%2E+and+Fluhr%2C+C%2E+2004%2E+Multilingual+Document+Clusters+Discovery%2E+Recherche+d%E2%80%99Information+Assist%C3%A9e+par+Ordinateur+%28RIAO%29+Proceedings%2C+1%2D10%2E)
15. The TREC 2002 Arabic/English CLIR Track, NIST TREC 2002 Proceedings, pp. 16-26. [find](https://scholar.google.com/scholar?q=The+TREC+2002+Arabic%2FEnglish+CLIR+Track%2C+NIST+TREC+2002+Proceedings%2C+pp%2E+16%2D26%2E)
16. Peters, C. (ed.). 2001. Cross-Language Information Retrieval and Evaluation: Workshop of the Cross-Language Evaluation Forum, CLEF 2000. Berlin: Springer-Verlag. [find](https://scholar.google.com/scholar?q=Peters%2C+C%2E+%28ed%2E%29%2E+2001%2E+Cross%2DLanguage+Information+Retrieval+and+Evaluation%3A+Workshop+of+the+Cross%2DLanguage+Evaluation+Forum%2C+CLEF+2000%2E+Berlin%3A+Springer%2DVerlag%2E)
17. Resnik, P., Olsen, M. B., and Diab, M. 1999. The Bible as a Parallel Corpus: Annotating the "Book of 2000 Tongues". Computers and the Humanities, 33, 129-153. [find](https://scholar.google.com/scholar?q=Resnik%2C+P%2E%2C+Olsen%2C+M%2E+B%2E%2C+and+Diab%2C+M%2E+1999%2E+The+Bible+as+a+Parallel+Corpus%3A+Annotating+the+%22Book+of+2000+Tongues%22%2E+Computers+and+the+Humanities%2C+33%2C+129%2D153%2E)
18. Van Rijsbergen, C. 1979. Information Retrieval (2 nd edition). Butterworth: London. [find](https://scholar.google.com/scholar?q=Van+Rijsbergen%2C+C%2E+1979%2E+Information+Retrieval+%282+nd+edition%29%2E+Butterworth%3A+London%2E)

*Updated 1 November 2026*