---
title: "Building a Heterogeneous Information Retrieval Collection of"
description: "The paper addresses a gap in Arabic search research. 27 references. Among them: 3."
authors: ["Abdelrahim Abdelsapor", "Noha Adly", "Kareem Darwish", "Ossama Emam", "Walid Magdy", "Magdi Nagi"]
year: 2006
venue: "Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC'06)"
source: "https://aclanthology.org/L06-1308/"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/abdelsapor-2006-building-heterogeneous-information-retrieval-collection/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/abdelsapor-2006-building-heterogeneous-information-retrieval-collection/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2006](https://md.research.elamur.ai/free/en/papers/2006/page/2/) / Building a Heterogeneous Information Retrieval Collection of Printed Arabic Documents

# Building a Heterogeneous Information Retrieval Collection of Printed Arabic Documents

**Authors:** Abdelrahim Abdelsapor, Noha Adly, [Kareem Darwish](https://md.research.elamur.ai/free/en/authors/kareem-darwish/), [Ossama Emam](https://md.research.elamur.ai/free/en/authors/ossama-emam/), [Walid Magdy](https://md.research.elamur.ai/free/en/authors/walid-magdy/) and Magdi Nagi · **Year:** 2006 · **Venue:** [Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC'06)](https://md.research.elamur.ai/free/en/venues/lrec/) ([LREC 2006](https://md.research.elamur.ai/free/en/venues/lrec/2006/)) · **Publisher:** [European Language Resources Association (ELRA)](https://md.research.elamur.ai/free/en/publishers/european-language-resources-association-elra/) · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/L06-1308/) · [PDF](https://aclanthology.org/L06-1308.pdf) · [OpenAlex](https://openalex.org/W2757881267)

**Citations:** 3 citations (OpenAlex, 2026-10-14)

## Summary
The paper addresses a gap in Arabic search research. There was no large, realistic benchmark for retrieving Arabic text produced by OCR, which is often error-ridden. The authors drew on the Bibliotheca Alexandrina's part of the Million Book Project (75,000 Arabic books). They sampled about 25 pages from each of 1,378 books, giving 34,651 scanned pages, and ran these through Sakhr's Automatic Reader. The resulting pages vary in subject, printing era, typeface and how badly the OCR degraded them. The team wrote 25 topics and gathered relevance judgments with a custom interactive search-and-judge web tool.

The baseline experiments tested four index term types (whole words, lightly stemmed forms, and overlapping character sequences of length three and of length four), each run both with and without blind relevance feedback. Character 4-grams were the strongest. Blind feedback changed results only slightly and not significantly. At the time, this was the largest Arabic document-image collection to come with OCR output, topics and judgments. That makes it a realistic testbed for noisy-text retrieval, because it does not depend on simulated corruption.

## Key points
- **Collection size:** 34,651 page images from 1,378 books, with print dates from the early 1920s to the present. Topics span history, philosophy, culture and politics.
- **Scanning and OCR:** Pages were scanned in black and white at 300×300 dpi on a Minolta PS 3000 and processed with Sakhr's Automatic Reader v6.
  - Character error rate per book ranged from 1% to 21%, estimated by manually checking one random page per book.
  - Typefaces were grouped into 12 common font classes plus a 13th class for rare fonts.
- **Topics:** There are 25 topics, each with a short title (similar to a web query) and a natural-language description. Relevant documents per topic range from 4 to 95.
- **Judging tool:** It ran on the Lemur toolkit (v3.1) with Okapi BM25 weighting and character 4-gram indexing. Judges could reformulate queries, apply optional automatic expansion, keep track of their judgments and view page images with query terms highlighted.
- **Results:**
  - Without feedback, 4-grams beat the other index terms with statistical significance on every metric. The one exception was light stems under precision@10.
  - Blind relevance feedback did not significantly help any index term type.

## Interesting ideas
- Using genuinely degraded inputs instead of corruption simulated by a confusion model captures failure modes that synthetic noise misses, such as page skew, odd fonts and damaged pages.
- Sampling a fixed small number of pages from many different sources spreads variation in genre, font and quality across the set, so no single source dominates.
- Quality was estimated cheaply by hand-checking one random page per book, giving a per-source error estimate without full annotation.
- Character n-grams survived OCR damage better than words or stems, because a few broken characters still leave many intact n-grams to match.
- A judging tool that combined repeated searching, optional query expansion and tracked decisions made relevance labeling feasible without pooling many systems.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (learn): Build part of the evaluation set from real messy English text, such as OCR'd scans or forum posts, so parser and reader robustness is measured on actual noise rather than on noise we generated ourselves.
- **I2** (learn): When building silver or test sets, cap the sentences taken from each document or source so treebank-style evaluations are not skewed by a few long texts.
- **I3** (learn): Spot-check one random parsed sentence per source to estimate a per-source error rate, then use that rate to weight or filter silver data.
- **I4** (tokens): Add character n-gram features as a fallback in the tagger or lemmatizer for misspelled or out-of-vocabulary tokens, so a single corrupted letter does not wreck the analysis.
- **I5** (learn): A similar interactive tool for checking frames or answers could let a human or LLM teacher iterate quickly while every accept or reject decision is logged as explainable training signal.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Cairo University](https://md.research.elamur.ai/free/en/universities/cairo-university/) — University, Giza, Egypt · 12 works · 730 citations
- [Bibliotheca Alexandrina](https://md.research.elamur.ai/free/en/labs/bibliotheca-alexandrina/) — Research institute, Alexandria, Egypt · 2 works · 8 citations
- [IBM (Egypt)](https://md.research.elamur.ai/free/en/companies/ibm-egypt/) — Company, Giza, Egypt · 2 works · 3 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,085 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,888 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 1,282 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 523 works

🧭 Topics (2): [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 1,485 works · [🔍 Information retrieval & search](https://md.research.elamur.ai/free/en/topics/information-retrieval/) · 146 works

## Cite

Cite as: Abdelrahim Abdelsapor, Noha Adly, Kareem Darwish, Ossama Emam, Walid Magdy and Magdi Nagi. 2006. Building a Heterogeneous Information Retrieval Collection of Printed Arabic Documents. Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC'06).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{abdelsapor2006building,
  title = {{Building a Heterogeneous Information Retrieval Collection of Printed Arabic Documents}},
  author = {Abdelrahim Abdelsapor, Noha Adly, Kareem Darwish, Ossama Emam, Walid Magdy and Magdi Nagi},
  booktitle = {Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC'06)},
  year = {2006},
  doi = {10.63317/4tn9y2k2se88},
  url = {https://doi.org/10.63317/4tn9y2k2se88}
}
```

- [← previous Grammatical Framework (GF) for MT in Sublanguage Domains](https://md.research.elamur.ai/free/en/papers/khegai-2006-grammatical-framework-gf-mt-sublanguage/)
- [next → Issues in the Linguistic Analysis of a Dead Language, with Particular Reference to Ancient Hebrew](https://md.research.elamur.ai/free/en/papers/holmstedt-2006-issues-linguistic-analysis-dead-language/)
- [↑ back to papers of 2006](https://md.research.elamur.ai/free/en/papers/2006/page/2/)

## References

27 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Ahmed, M. A large-scale computational processor of the Arabic morphology, and Applications. Master’s Thesis, Faculty of Engineering, Cairo University, Cairo, Egypt, 2000. [find](https://scholar.google.com/scholar?q=Ahmed%2C+M%2E+A+large%2Dscale+computational+processor+of+the+Arabic+morphology%2C+and+Applications%2E+Master%E2%80%99s+Thesis%2C+Faculty+of+Engineering%2C+Cairo+University%2C+Cairo%2C+Egypt%2C+2000%2E)
2. Aljlayl, M., S. Beitzel, E. Jensen, A. Chowdhury, D. Holmes, M. Lee, D. Grossman, and O. Frieder. IIT at TREC-10. TREC-2001, 2001. [find](https://scholar.google.com/scholar?q=Aljlayl%2C+M%2E%2C+S%2E+Beitzel%2C+E%2E+Jensen%2C+A%2E+Chowdhury%2C+D%2E+Holmes%2C+M%2E+Lee%2C+D%2E+Grossman%2C+and+O%2E+Frieder%2E+IIT+at+TREC%2D10%2E+TREC%2D2001%2C+2001%2E)
3. Al-Kharashi, I. and M. Evens. Comparing words, stems, and roots as index terms in an Arabic information retrieval system. JASIS. 45 (8): 548-560, 1994. [↗](https://doi.org/10.1002/(sici)1097-4571(199409)45:8<548::aid-asi3>3.0.co;2-x)
4. Baird, H. Document image defects models and their uses. Proceedings of the Second International Conference on Document Analysis and Recognition (ICDAR), 62-67, 1993. [find](https://scholar.google.com/scholar?q=Baird%2C+H%2E+Document+image+defects+models+and+their+uses%2E+Proceedings+of+the+Second+International+Conference+on+Document+Analysis+and+Recognition+%28ICDAR%29%2C+62%2D67%2C+1993%2E)
5. Baird, H. State of the art of document image degradation modelling. Proceedings of the 4th IAPR Workshop on Document Analysis Systems (DAS 2000), 2000. [find](https://scholar.google.com/scholar?q=Baird%2C+H%2E+State+of+the+art+of+document+image+degradation+modelling%2E+Proceedings+of+the+4th+IAPR+Workshop+on+Document+Analysis+Systems+%28DAS+2000%29%2C+2000%2E)
6. Chen, A. and F. Gey. Translation term weighting and combining translation resources in cross-language retrieval. TREC-2001, 2001. [find](https://scholar.google.com/scholar?q=Chen%2C+A%2E+and+F%2E+Gey%2E+Translation+term+weighting+and+combining+translation+resources+in+cross%2Dlanguage+retrieval%2E+TREC%2D2001%2C+2001%2E)
7. Cormack, G., C. Palmer, and C. Clarke. Efficient Construction of Large Test Collections. In the Proceedings of the 21st ACM SIGIR Conference, 282-289, 1998. [find](https://scholar.google.com/scholar?q=Cormack%2C+G%2E%2C+C%2E+Palmer%2C+and+C%2E+Clarke%2E+Efficient+Construction+of+Large+Test+Collections%2E+In+the+Proceedings+of+the+21st+ACM+SIGIR+Conference%2C+282%2D289%2C+1998%2E)
8. Darwish, K. Building a shallow morphological analyzer in one day. ACL 2002 Workshop on Computational Approaches to Semitic Languages, July 11, 2002. [find](https://scholar.google.com/scholar?q=Darwish%2C+K%2E+Building+a+shallow+morphological+analyzer+in+one+day%2E+ACL+2002+Workshop+on+Computational+Approaches+to+Semitic+Languages%2C+July+11%2C+2002%2E)
9. Darwish, K. and O. Emam. The Effect of Blind Relevance Feedback on a New Arabic OCR Degraded Text Collection. In International Conference on Machine Intelligence: Special Session on Arabic Document Image Analysis, 2005. [find](https://scholar.google.com/scholar?q=Darwish%2C+K%2E+and+O%2E+Emam%2E+The+Effect+of+Blind+Relevance+Feedback+on+a+New+Arabic+OCR+Degraded+Text+Collection%2E+In+International+Conference+on+Machine+Intelligence%3A+Special+Session+on+Arabic+Document+Im)
10. Darwish, K., D. Doermann, R. Jones, D. Oard, and M. Rautiainen. TREC-10 experiments at Maryland: CLIR and video. TREC-2001, 2001. [find](https://scholar.google.com/scholar?q=Darwish%2C+K%2E%2C+D%2E+Doermann%2C+R%2E+Jones%2C+D%2E+Oard%2C+and+M%2E+Rautiainen%2E+TREC%2D10+experiments+at+Maryland%3A+CLIR+and+video%2E+TREC%2D2001%2C+2001%2E)
11. Darwish, K., D. Oard, Term selection for searching printed Arabic. In the Proceedings of the 25th ACM SIGIR Conference, page 261 - 268, 2002. [find](https://scholar.google.com/scholar?q=Darwish%2C+K%2E%2C+D%2E+Oard%2C+Term+selection+for+searching+printed+Arabic%2E+In+the+Proceedings+of+the+25th+ACM+SIGIR+Conference%2C+page+261+%2D+268%2C+2002%2E)
12. Darwish, K., Probabilistic Methods for Search OCR Degraded Arabic Text. Ph.D. dissertation, University of Maryland, College Park, 2003. [find](https://scholar.google.com/scholar?q=Darwish%2C+K%2E%2C+Probabilistic+Methods+for+Search+OCR+Degraded+Arabic+Text%2E+Ph%2ED%2E+dissertation%2C+University+of+Maryland%2C+College+Park%2C+2003%2E)
13. Harding, S., W. Croft, and C. Weir. Probabilistic retrieval of OCR degraded text using n-grams. European Conference on Digital Libraries, 1997 [find](https://scholar.google.com/scholar?q=Harding%2C+S%2E%2C+W%2E+Croft%2C+and+C%2E+Weir%2E+Probabilistic+retrieval+of+OCR+degraded+text+using+n%2Dgrams%2E+European+Conference+on+Digital+Libraries%2C+1997)
14. Hmeidi, I., G. Kanaan, and M. Evens. Design and implementation of automatic indexing for information retrieval with Arabic documents. JASIS. 48 (10): 867-881, 1997. [↗](https://doi.org/10.1002/(sici)1097-4571(199710)48:10<867::aid-asi3>3.3.co;2-r)
15. Jones, K. S. and C. J. Van Rijsbergen. Report on the need for and previous of ‘ideal’ test collection, TR #365, University Computer Laboratory, Cambridge, 1975. [find](https://scholar.google.com/scholar?q=Jones%2C+K%2E+S%2E+and+C%2E+J%2E+Van+Rijsbergen%2E+Report+on+the+need+for+and+previous+of+%E2%80%98ideal%E2%80%99+test+collection%2C+TR+%23365%2C+University+Computer+Laboratory%2C+Cambridge%2C+1975%2E)
16. Kanungo, T. Document degradation models and methodology for degradation model validation. Ph.D. Thesis, Electrical Engineering Department, University of Washington, 1996. [find](https://scholar.google.com/scholar?q=Kanungo%2C+T%2E+Document+degradation+models+and+methodology+for+degradation+model+validation%2E+Ph%2ED%2E+Thesis%2C+Electrical+Engineering+Department%2C+University+of+Washington%2C+1996%2E)
17. Kanungo, T., G. Marton, and O. Bulbul. OmniPage vs. Sakhr: paired model evaluation of two Arabic OCR products. Proceedings of SPIE Conference on Document Recognition and Retrieval (VI), Vol. 3651, San Jose, California, Jan. 27-28, 1999. [find](https://scholar.google.com/scholar?q=Kanungo%2C+T%2E%2C+G%2E+Marton%2C+and+O%2E+Bulbul%2E+OmniPage+vs%2E+Sakhr%3A+paired+model+evaluation+of+two+Arabic+OCR+products%2E+Proceedings+of+SPIE+Conference+on+Document+Recognition+and+Retrieval+%28VI%29%2C+Vol%2E+3651%2C+San)
18. Larkey, L., L. Ballesteros, and M. Connell. Improving stemming for Arabic information retrieval: light stemming and co-occurrence analysis. In SIGIR, 2002, Tampere, Finland. pp. 275-282 [find](https://scholar.google.com/scholar?q=Larkey%2C+L%2E%2C+L%2E+Ballesteros%2C+and+M%2E+Connell%2E+Improving+stemming+for+Arabic+information+retrieval%3A+light+stemming+and+co%2Doccurrence+analysis%2E+In+SIGIR%2C+2002%2C+Tampere%2C+Finland%2E+pp%2E+275%2D282)
19. Mayfield, J., P. McNamee, C. Costello, C. Piatko, and A. Banerjee. JHU/APL at TREC 2001: experiments in filtering and in Arabic, video, and web retrieval. TREC-2001, 2001. [find](https://scholar.google.com/scholar?q=Mayfield%2C+J%2E%2C+P%2E+McNamee%2C+C%2E+Costello%2C+C%2E+Piatko%2C+and+A%2E+Banerjee%2E+JHU%2FAPL+at+TREC+2001%3A+experiments+in+filtering+and+in+Arabic%2C+video%2C+and+web+retrieval%2E+TREC%2D2001%2C+2001%2E)
20. Oard, D. and F. Gey. The TREC-2002 Arabic/English CLIR Track. TREC-2002, 2002. [find](https://scholar.google.com/scholar?q=Oard%2C+D%2E+and+F%2E+Gey%2E+The+TREC%2D2002+Arabic%2FEnglish+CLIR+Track%2E+TREC%2D2002%2C+2002%2E)
21. Sanderson, M. and H. Joho. Forming Test Collection with no System Pooling. In the Proceedings of the 27 th ACM SIGIR Conference, page 33-40, 2004 [find](https://scholar.google.com/scholar?q=Sanderson%2C+M%2E+and+H%2E+Joho%2E+Forming+Test+Collection+with+no+System+Pooling%2E+In+the+Proceedings+of+the+27+th+ACM+SIGIR+Conference%2C+page+33%2D40%2C+2004)
22. Singhal, A., G. Salton, and C. Buckley. Length normalization in degraded text collections. Proceedings of 5th Annual Symposium on Document Analysis and Information Retrieval, 149-162, April 15-17, 1996. [find](https://scholar.google.com/scholar?q=Singhal%2C+A%2E%2C+G%2E+Salton%2C+and+C%2E+Buckley%2E+Length+normalization+in+degraded+text+collections%2E+Proceedings+of+5th+Annual+Symposium+on+Document+Analysis+and+Information+Retrieval%2C+149%2D162%2C+April+15%2D17%2C+199)
23. Taghva, K., J. Borasack, A. Condit, and J. Gilbreth. Results and implications of the noisy data projects. Technical Report 94-01, Information Science Research Institute, University of Nevada, Las Vegas, 1994. [find](https://scholar.google.com/scholar?q=Taghva%2C+K%2E%2C+J%2E+Borasack%2C+A%2E+Condit%2C+and+J%2E+Gilbreth%2E+Results+and+implications+of+the+noisy+data+projects%2E+Technical+Report+94%2D01%2C+Information+Science+Research+Institute%2C+University+of+Nevada%2C+Las+Vega)
24. Taghva, K., J. Borasack, A. Condit, and P. Inaparthy. Querying short OCR’d documents. Technical Report 94-10, Information Science Research Institute 1995. [find](https://scholar.google.com/scholar?q=Taghva%2C+K%2E%2C+J%2E+Borasack%2C+A%2E+Condit%2C+and+P%2E+Inaparthy%2E+Querying+short+OCR%E2%80%99d+documents%2E+Technical+Report+94%2D10%2C+Information+Science+Research+Institute+1995%2E)
25. Trenkle, J., A. Gillies, E. Erlandson, S. Schlosser, and S. Cavin. Advances in Arabic text recognition. Proceeding of Symposium on Document Image Understanding Technology, Columbia, Maryland, April 23-25, 2001. [find](https://scholar.google.com/scholar?q=Trenkle%2C+J%2E%2C+A%2E+Gillies%2C+E%2E+Erlandson%2C+S%2E+Schlosser%2C+and+S%2E+Cavin%2E+Advances+in+Arabic+text+recognition%2E+Proceeding+of+Symposium+on+Document+Image+Understanding+Technology%2C+Columbia%2C+Maryland%2C+April+23)
26. Tseng, Y. and D. Oard. Document image retrieval techniques for Chinese. Proceeding of Symposium on Document Image Understanding Technology, Columbia, Maryland, April 23-25, 2001. [find](https://scholar.google.com/scholar?q=Tseng%2C+Y%2E+and+D%2E+Oard%2E+Document+image+retrieval+techniques+for+Chinese%2E+Proceeding+of+Symposium+on+Document+Image+Understanding+Technology%2C+Columbia%2C+Maryland%2C+April+23%2D25%2C+2001%2E)
27. Xu, J., A. Fraser, and R. Weischedel. TREC 2001 cross-lingual retrieval at BBN. TREC-2001, 2001. [find](https://scholar.google.com/scholar?q=Xu%2C+J%2E%2C+A%2E+Fraser%2C+and+R%2E+Weischedel%2E+TREC+2001+cross%2Dlingual+retrieval+at+BBN%2E+TREC%2D2001%2C+2001%2E)

*Updated 24 October 2026*