---
title: "QARAB — paper by Hammo et al. (2002) — summary and ideas"
description: "QARAB addresses open-domain question answering for Arabic, where NLP lagged far behind English. 37 references, cited by 8 papers here."
authors: ["Bassam Hammo", "Hani Abu-Salem", "Steven Lytinen", "Martha Evens"]
year: 2002
venue: "Proceedings of the ACL-02 Workshop on Computational Approaches to Semitic Languages"
source: "https://aclanthology.org/W02-0507/"
doi: "10.3115/1118637.1118644"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/hammo-2002-qarab-question-answering-system-support/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/hammo-2002-qarab-question-answering-system-support/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2002](https://md.research.elamur.ai/free/en/papers/2002/) / QARAB: A: Question Answering System to Support the Arabic Language

# QARAB: A: Question Answering System to Support the Arabic Language

**Authors:** [Bassam Hammo](https://md.research.elamur.ai/free/en/authors/bassam-hammo/), Hani Abu-Salem, Steven Lytinen and [Martha Evens](https://md.research.elamur.ai/free/en/authors/martha-evens/) · **Year:** 2002 · **Venue:** [Proceedings of the ACL-02 Workshop on Computational Approaches to Semitic Languages](https://md.research.elamur.ai/free/en/venues/acl-02-workshop-on-computational-approaches-to-semitic-languages/) ([ACL-02 Workshop on Computational Approaches to Semitic Languages 2002](https://md.research.elamur.ai/free/en/venues/acl-02-workshop-on-computational-approaches-to-semitic-languages/2002/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/W02-0507/) · [PDF](https://aclanthology.org/W02-0507.pdf) · [DOI 10.3115/1118637.1118644](https://doi.org/10.3115/1118637.1118644) · [OpenAlex](https://openalex.org/W2019468486)

**Citations:** 128 citations (OpenAlex, 2026-10-14) · [8](https://md.research.elamur.ai/free/en/papers/hammo-2002-qarab-question-answering-system-support/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
QARAB addresses open-domain question answering for Arabic, where NLP lagged far behind English. The authors name several reasons: rich inflection and derivation, unwritten vowels (diacritics), no capital letters to signal proper names, and few corpora and lexicons. The system answers from a collection of articles from the Qatari newspaper Al-Raya.

A retrieval engine built from scratch on Salton's vector space model is stored as relational database tables. It treats the question as a query, widens it through shared Arabic roots, and returns ranked documents split into paragraphs. The question and the candidate paragraphs are then processed the same way. Stop-words are dropped, words are stemmed and tagged with an existing tagger and proper-name finder, and the question word fixes the expected answer type (for example, "who" means a person). A passage is kept when it contains the question's nouns in their original order plus cue words for the expected entity type.

No quantitative evaluation is reported, only a promising informal trial. Still, the paper is an early blueprint for Arabic QA that adds lightweight linguistic matching on top of IR.

## Key points
- Knowledge source: Al-Raya (Qatar) newspaper text. The system assumes each answer lies within a single document and is a short passage.
- The IR index is a set of relational tables: ROOT_TABLE, STEM_TABLE (with document frequency and IDF), POSTING_TABLE (document, paragraph, position, length), DOCUMENT_TABLE, PARAGRAPH_TABLE and QUERY_TABLE (original and root-expanded words with weights).
- Part-of-speech and proper-name tagging rely on the Type-Finder and Proper Name-Finder by Abuleil [1999]. Verbs are reported as easiest to spot thanks to regular morphological patterns.
- Hand-built Arabic keyword lists help detect person names, organizations, locations, numbers, money and dates.
- The pipeline has three stages: analyse the question, retrieve candidate paragraphs, then analyse those paragraphs like the question and return sentences likely to hold the answer. The planned evaluation has Arabic users supply questions and judge whether answers satisfy them.

## Interesting ideas
- The interrogative word sets an expected answer category, and small cue-word lists then locate candidates of that category in a passage, a cheap and transparent typed-answer filter.
- Requiring the question's nouns to appear in the candidate passage in the same order is a minimal structural check that sits above pure keyword overlap.
- Query expansion through the morphological root links a question word to every stem in the same derivational family, not just its exact form.
- Storing the inverted index with paragraph IDs, token positions and lengths in plain relational tables makes every retrieval hit traceable to an exact text span.
- The authors plan to collect real users' question forms and let those same users judge answer satisfaction, rather than relying only on gold strings.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (answer): Readers answering fable or school-test questions could map wh-words to an expected entity or value type and reject candidate answers whose world entity has the wrong type, with the rejection reason logged.
- **I2** (answer): It could serve as a weak baseline or negative control for the tree- and frame-based answerer, showing which questions really need structure rather than word order.
- **I3** (tokens): A derivational-family layer over English lemmas (e.g., decide/decision) would let the matcher connect a nominal question to a verbal sentence while recording which derivation was used.
- **I4** (world): Keeping span provenance on each entity and event in the world of the text would let every answer point back to the paragraph and tokens that support it.
- **I5** (learn): Evaluation sets for the QA readers could include human-authored question variants and acceptability judgements, catching answers that are technically correct but unhelpful.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [DePaul University](https://md.research.elamur.ai/free/en/universities/depaul-university/) — University, Chicago, United States · 2 works · 148 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 1,437 works

🧭 Topics (2): [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 2,908 works · [❓ Question answering](https://md.research.elamur.ai/free/en/topics/question-answering/) · 441 works

## Cite

Cite as: Bassam Hammo, Hani Abu-Salem, Steven Lytinen and Martha Evens. 2002. QARAB: A: Question Answering System to Support the Arabic Language. Proceedings of the ACL-02 Workshop on Computational Approaches to Semitic Languages.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{hammo2002qarab,
  title = {{QARAB: A: Question Answering System to Support the Arabic Language}},
  author = {Bassam Hammo, Hani Abu-Salem, Steven Lytinen and Martha Evens},
  booktitle = {Proceedings of the ACL-02 Workshop on Computational Approaches to Semitic Languages},
  year = {2002},
  doi = {10.3115/1118637.1118644},
  url = {https://doi.org/10.3115/1118637.1118644}
}
```

- [← previous Unsupervised discovery of morphologically related words based on orthographic and semantic similarity](https://md.research.elamur.ai/free/en/papers/baroni-2002-unsupervised-discovery-morphologically-related-words/)
- [next → The Disambiguation of Nominalizations](https://md.research.elamur.ai/free/en/papers/lapata-2002-disambiguation-nominalizations/)
- [↑ back to papers of 2002](https://md.research.elamur.ai/free/en/papers/2002/)

## References

37 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Abuleil, S., and Evens, M., 1998. “[Discovering Lexical Information by Tagging Arabic Newspaper Text](https://md.research.elamur.ai/free/en/papers/abuleil-1998-discovering-lexical-information-tagging-arabic/)”, Workshop on Semantic Language Processing. COLING-ACL ’98, University of Montreal, Montreal, PQ, Canada, Aug. 16 1998, pp. 1-7.
2. Al-Daimi, K., and Abdel-Amir, M. 1994. “The Syntactic Analysis of Arabic by Machine”. Computers and Humanities, Vol. 28, No. 1, pp. 29-37. [↗](https://doi.org/10.1007/bf01830685)
3. Allan, J., Callan, J., Feng, F-F., and Malin D. 1999. “INQUERY and TREC-8”. Proceedings of the 8th Text REtrieval Conference (TREC-8), NIST Special Publications 500-246, pp. 637-645. [find](https://scholar.google.com/scholar?q=Allan%2C+J%2E%2C+Callan%2C+J%2E%2C+Feng%2C+F%2DF%2E%2C+and+Malin+D%2E+1999%2E+%E2%80%9CINQUERY+and+TREC%2D8%E2%80%9D%2E+Proceedings+of+the+8th+Text+REtrieval+Conference+%28TREC%2D8%29%2C+NIST+Special+Publications+500%2D246%2C+pp%2E+637%2D645%2E)
4. Ask Jeeves. 1996. www.ask.com Site last visited in March 2001. [find](https://scholar.google.com/scholar?q=Ask+Jeeves%2E+1996%2E+www%2Eask%2Ecom+Site+last+visited+in+March+2001%2E)
5. Breck, E., Burger, J., Ferro, L., House, D., Light, M., and Mani, I. 1999. “A Sys Called Qanda”. Proceedings of the 8th Text REtrieval Conference, NIST Special Publications, pp. 499-507. [find](https://scholar.google.com/scholar?q=Breck%2C+E%2E%2C+Burger%2C+J%2E%2C+Ferro%2C+L%2E%2C+House%2C+D%2E%2C+Light%2C+M%2E%2C+and+Mani%2C+I%2E+1999%2E+%E2%80%9CA+Sys+Called+Qanda%E2%80%9D%2E+Proceedings+of+the+8th+Text+REtrieval+Conference%2C+NIST+Special+Publications%2C+pp%2E+499%2D507%2E)
6. Budzik, J. and Hammond, K. 1999. “Q&A: A System for the Capture, Organization and Reuse of Expertise”. Proceedings of the Sixty-second Annual Meeting of the American Society for Information Science. Information Today, Inc., Medford, NJ. Available on the Web at [http://dent.infolab.nwu.edu/infolab/downloads/papers/paper10061.pdf](http://dent.infolab.nwu.edu/infolab/downloads/papers/paper10061.pdf). Site last visited in August 2001. [↗](http://dent.infolab.nwu.edu/infolab/downloads/papers/paper10061.pdf)
7. Burke, R., Hammond, K., Kulyukin, V., Lytinen, S., Tomuro, N., and Schoenberg, S. 1997. “Question Answering from Frequently-Asked Question Files: Experiences with the FAQ Finder System”. AI Magazine, Vol. 18, No.2, pp. 57-66. [↗](https://doi.org/10.1609/aimag.v18i2.1294)
8. Cardie, C., Ng, V., Pierce, D., and Buckley, C. 2000. “Examining the Role of Statistical and Linguistic Knowledge Sources in a General-Knowledge Question-Answering System”. Proceedings of the Sixth Applied Natural Language Processing Conference, pp. 180-187. [find](https://scholar.google.com/scholar?q=Cardie%2C+C%2E%2C+Ng%2C+V%2E%2C+Pierce%2C+D%2E%2C+and+Buckley%2C+C%2E+2000%2E+%E2%80%9CExamining+the+Role+of+Statistical+and+Linguistic+Knowledge+Sources+in+a+General%2DKnowledge+Question%2DAnswering+System%E2%80%9D%2E+Proceedings+of+the+Sixth+Ap)
9. Cormack, G., Clarke, C., and Kisman, D. 1999. “Fast Automatic Passage Ranking (MultiText Experiments for TREC-8)”. Proceedings of the 8th Text REtrieval Conference (TREC-8), NIST Special Publications 500-246, pp. 735-743. [find](https://scholar.google.com/scholar?q=Cormack%2C+G%2E%2C+Clarke%2C+C%2E%2C+and+Kisman%2C+D%2E+1999%2E+%E2%80%9CFast+Automatic+Passage+Ranking+%28MultiText+Experiments+for+TREC%2D8%29%E2%80%9D%2E+Proceedings+of+the+8th+Text+REtrieval+Conference+%28TREC%2D8%29%2C+NIST+Special+Publications+)
10. Ferret, O., Grau, B., Illouz, G., Jacquemin, C., and Masson, N. 1999. “QALC - the Question-Answering Program of the Language and Cognition Group at LIMSI-CNRS”. Proceedings of the 8th Text REtrieval Conference, NIST Special Publications, pp. 465-475. [find](https://scholar.google.com/scholar?q=Ferret%2C+O%2E%2C+Grau%2C+B%2E%2C+Illouz%2C+G%2E%2C+Jacquemin%2C+C%2E%2C+and+Masson%2C+N%2E+1999%2E+%E2%80%9CQALC+%2D+the+Question%2DAnswering+Program+of+the+Language+and+Cognition+Group+at+LIMSI%2DCNRS%E2%80%9D%2E+Proceedings+of+the+8th+Text+REtrieval+C)
11. Harabagiu, S., Pasca, M., and Maiorano, S. 2000. “Experiments with Open-Domain Textual Question Answering”. Proceedings of 18 th International Conference on Computational Linguistics (COLING-2000), Saarbrucken, Germany, pp. 292-298 [find](https://scholar.google.com/scholar?q=Harabagiu%2C+S%2E%2C+Pasca%2C+M%2E%2C+and+Maiorano%2C+S%2E+2000%2E+%E2%80%9CExperiments+with+Open%2DDomain+Textual+Question+Answering%E2%80%9D%2E+Proceedings+of+18+th+International+Conference+on+Computational+Linguistics+%28COLING%2D2000%29%2C+Sa)
12. Hull, D. 1999. “Xerox TREC-8 Question Answering Track Report”. Proceedings of the 8 th Text REtrieval Conference (TREC-8), NIST Special Publications 500-246, pp. 743-751. [find](https://scholar.google.com/scholar?q=Hull%2C+D%2E+1999%2E+%E2%80%9CXerox+TREC%2D8+Question+Answering+Track+Report%E2%80%9D%2E+Proceedings+of+the+8+th+Text+REtrieval+Conference+%28TREC%2D8%29%2C+NIST+Special+Publications+500%2D246%2C+pp%2E+743%2D751%2E)
13. Humphreys, K., Gaizauskas, R., Hepple, M., and Sanderson, M. 1999. “University of Sheffield TREC-8 Q & A System”. Proceedings of the 8th Text REtrieval Conference (TREC-8), NIST Special Publications 500-246, pp. 707-717. [find](https://scholar.google.com/scholar?q=Humphreys%2C+K%2E%2C+Gaizauskas%2C+R%2E%2C+Hepple%2C+M%2E%2C+and+Sanderson%2C+M%2E+1999%2E+%E2%80%9CUniversity+of+Sheffield+TREC%2D8+Q+%26+A+System%E2%80%9D%2E+Proceedings+of+the+8th+Text+REtrieval+Conference+%28TREC%2D8%29%2C+NIST+Special+Publications+5)
14. Jacobs, P., and Rau, L. 1990. “SCISOR: Extracting Information from On-line News”. Communications of the ACM, Vol. 33, No.11, pp. 88-97. [↗](https://doi.org/10.1145/92755.92769)
15. Katz, B. 1997. “From Sentence Processing to Information Access on the World Wide Web”. Proceedings of the American Association for Artificial Intelligence Conference, Spring Symposium, NLP for WWW, pp. 77-86. [find](https://scholar.google.com/scholar?q=Katz%2C+B%2E+1997%2E+%E2%80%9CFrom+Sentence+Processing+to+Information+Access+on+the+World+Wide+Web%E2%80%9D%2E+Proceedings+of+the+American+Association+for+Artificial+Intelligence+Conference%2C+Spring+Symposium%2C+NLP+for+WWW%2C+pp)
16. Khoja, S. 1999. “Stemming Arabic Text”. Available on the Web at: [http://www.comp.lancs.ac.uk/computing/users/khoja/stemmer.ps](http://www.comp.lancs.ac.uk/computing/users/khoja/stemmer.ps). Site last visited in March 2001. [↗](http://www.comp.lancs.ac.uk/computing/users/khoja/stemmer.ps)
17. Kupiec, J. 1993. “MURAX: A Robust Linguistic Approach for Question Answering Using an On-line Encyclopedia”. Proceedings of the 16th Annual Int. ACM SIGIR Conference, pp. 181-190. [find](https://scholar.google.com/scholar?q=Kupiec%2C+J%2E+1993%2E+%E2%80%9CMURAX%3A+A+Robust+Linguistic+Approach+for+Question+Answering+Using+an+On%2Dline+Encyclopedia%E2%80%9D%2E+Proceedings+of+the+16th+Annual+Int%2E+ACM+SIGIR+Conference%2C+pp%2E+181%2D190%2E)
18. Lehnert, W. 1978. The Process of Question Answering. Lawrence Erlbaum Associates, Hillsdale, NJ. [find](https://scholar.google.com/scholar?q=Lehnert%2C+W%2E+1978%2E+The+Process+of+Question+Answering%2E+Lawrence+Erlbaum+Associates%2C+Hillsdale%2C+NJ%2E)
19. Lin, C-J, and Chen, H-H. 1999. “Description of Preliminary Results to TREC-8 QA Task”. Proceedings of the 8th Text REtrieval Conference(TERC-8), NIST Special Publications 500-246, pp. 507-513. [find](https://scholar.google.com/scholar?q=Lin%2C+C%2DJ%2C+and+Chen%2C+H%2DH%2E+1999%2E+%E2%80%9CDescription+of+Preliminary+Results+to+TREC%2D8+QA+Task%E2%80%9D%2E+Proceedings+of+the+8th+Text+REtrieval+Conference%28TERC%2D8%29%2C+NIST+Special+Publications+500%2D246%2C+pp%2E+507%2D513%2E)
20. Litkowski, K. 1999. “Question-Answering Using Semantic Relation Triples”. Proceedings of the 8th Text REtrieval Conference (TREC-8), NIST Special Publications 500-248, pp. 349-357 [find](https://scholar.google.com/scholar?q=Litkowski%2C+K%2E+1999%2E+%E2%80%9CQuestion%2DAnswering+Using+Semantic+Relation+Triples%E2%80%9D%2E+Proceedings+of+the+8th+Text+REtrieval+Conference+%28TREC%2D8%29%2C+NIST+Special+Publications+500%2D248%2C+pp%2E+349%2D357)
21. Lundquist, C., Grossman, D., and Frieder, O. 1999. "Improving Relevance Feedback in the Vector Space Model". Proceedings of 6 th ACM Annual Conference on Information and Knowledge Management (CIKM), pp. 16-23. [find](https://scholar.google.com/scholar?q=Lundquist%2C+C%2E%2C+Grossman%2C+D%2E%2C+and+Frieder%2C+O%2E+1999%2E+%22Improving+Relevance+Feedback+in+the+Vector+Space+Model%22%2E+Proceedings+of+6+th+ACM+Annual+Conference+on+Information+and+Knowledge+Management+%28CIKM%29%2C+p)
22. Moldovan, D., Harabagiu, S., Pasca, M., Mihalcea, R., Girju, R., Goodrum, R., and Rus, V. 2000. “The Structure and Performance of an Open-Domain Question-Answering System”. Proceedings of the 38 th Annual Meeting of the Association for Computational Linguistics, pp. 563-570. [find](https://scholar.google.com/scholar?q=Moldovan%2C+D%2E%2C+Harabagiu%2C+S%2E%2C+Pasca%2C+M%2E%2C+Mihalcea%2C+R%2E%2C+Girju%2C+R%2E%2C+Goodrum%2C+R%2E%2C+and+Rus%2C+V%2E+2000%2E+%E2%80%9CThe+Structure+and+Performance+of+an+Open%2DDomain+Question%2DAnswering+System%E2%80%9D%2E+Proceedings+of+the+38+th+An)
23. Oard, D., Wang, J., Lin, D., and Soboroff, I. 1999. “TREC-8 Experiments at Maryland: CLIR, QA and Routing”. Proceedings of the 8th Text REtrieval Conference (TERC-8), NIST Special Publications 500-246, pp. 623-637. [↗](https://doi.org/10.21236/ada456027)
24. Ogden, B., Cowie, J., Ludovik, E. Molina-Salgado, H., Nirenburg, S., Sharples, N., and Sheremtyeva, S. 1999. “CRL's TREC-8 Systems Cross-Lingual IR, and Q&A”. Proceedings of the 8th Text REtrieval Conference (TERC-8), NIST Special Publications 500-246, pp. 513-523. [find](https://scholar.google.com/scholar?q=Ogden%2C+B%2E%2C+Cowie%2C+J%2E%2C+Ludovik%2C+E%2E+Molina%2DSalgado%2C+H%2E%2C+Nirenburg%2C+S%2E%2C+Sharples%2C+N%2E%2C+and+Sheremtyeva%2C+S%2E+1999%2E+%E2%80%9CCRL%27s+TREC%2D8+Systems+Cross%2DLingual+IR%2C+and+Q%26A%E2%80%9D%2E+Proceedings+of+the+8th+Text+REtrieval+Con)
25. Salton, G. 1971. The SMART Retrieval System Experiments in Automatic Document Processing. Prentice Hall Inc., Englewood Cliffs, NJ. [find](https://scholar.google.com/scholar?q=Salton%2C+G%2E+1971%2E+The+SMART+Retrieval+System+Experiments+in+Automatic+Document+Processing%2E+Prentice+Hall+Inc%2E%2C+Englewood+Cliffs%2C+NJ%2E)
26. Schank, R., and Abelson, R. 1977. Scripts, Plans, Goals, and Understanding. Lawrence Erlbaum Associates, Hillsdale, NJ. [find](https://scholar.google.com/scholar?q=Schank%2C+R%2E%2C+and+Abelson%2C+R%2E+1977%2E+Scripts%2C+Plans%2C+Goals%2C+and+Understanding%2E+Lawrence+Erlbaum+Associates%2C+Hillsdale%2C+NJ%2E)
27. Shin, D-H, Kim, Y-H, Kim, S., Eom, J-H, Shin, H-J, and Zhang B-T. 1999. “SCAI TREC-8 Experiments”. Proceedings of the 8th Text REtrieval Conference (TREC-8), NIST Special Publications 500-246, pp. 583-591. [find](https://scholar.google.com/scholar?q=Shin%2C+D%2DH%2C+Kim%2C+Y%2DH%2C+Kim%2C+S%2E%2C+Eom%2C+J%2DH%2C+Shin%2C+H%2DJ%2C+and+Zhang+B%2DT%2E+1999%2E+%E2%80%9CSCAI+TREC%2D8+Experiments%E2%80%9D%2E+Proceedings+of+the+8th+Text+REtrieval+Conference+%28TREC%2D8%29%2C+NIST+Special+Publications+500%2D246%2C+pp%2E+583)
28. Singhal, A., Abney, S., Bacchiani, M., Collins, M., Hindle, D., and Pereira, F. 1999. “AT&T at TREC-8”. Proceedings of the 8th Text REtrieval Conference, NIST Special Publications, pp. 317-331. [find](https://scholar.google.com/scholar?q=Singhal%2C+A%2E%2C+Abney%2C+S%2E%2C+Bacchiani%2C+M%2E%2C+Collins%2C+M%2E%2C+Hindle%2C+D%2E%2C+and+Pereira%2C+F%2E+1999%2E+%E2%80%9CAT%26T+at+TREC%2D8%E2%80%9D%2E+Proceedings+of+the+8th+Text+REtrieval+Conference%2C+NIST+Special+Publications%2C+pp%2E+317%2D331%2E)
29. Srihari, R., and Li, W. 1999. “Information Extraction Supported Question Answering”. Proceedings of the 8th Text REtrieval Conference (TREC-8), NIST Special Publications 500-246, pp. 185-197. [↗](https://doi.org/10.21236/ada460042)
30. Takaki, T. 1999. “NTT DATA: Overview of System Approach at TREC-8 ad-hoc and Question Answering”. Proceedings of the 8th Text REtrieval Conference (TREC-8), NIST Special Publications 500-246, pp. 523-531. [find](https://scholar.google.com/scholar?q=Takaki%2C+T%2E+1999%2E+%E2%80%9CNTT+DATA%3A+Overview+of+System+Approach+at+TREC%2D8+ad%2Dhoc+and+Question+Answering%E2%80%9D%2E+Proceedings+of+the+8th+Text+REtrieval+Conference+%28TREC%2D8%29%2C+NIST+Special+Publications+500%2D246%2C+pp%2E+523%2D)
31. TREC-8. 1999. NIST Special Publication 500-246: The Eighth Text REtrieval Conference. Available on the Web at: [http://trec.nist.gov/pubs/trec8/t8_proceedings](http://trec.nist.gov/pubs/trec8/t8_proceedings). html. Site last visited in August 2001. [↗](http://trec.nist.gov/pubs/trec8/t8_proceedings)
32. TREC-9. 2000. NIST Special Publication: The Ninth Text REtrieval Conference. Available on the Web at: [http://trec.nist.gov/pubs/trec9/t9_proceedings](http://trec.nist.gov/pubs/trec9/t9_proceedings). html. Site last visited in August 2001. [↗](http://trec.nist.gov/pubs/trec9/t9_proceedings)
33. Vicedo, J., and Ferrández, A. 2000. “Importance of Pronominal Anaphora Resolution in Question- Answering System”. Proceedings of the 38 th Annual Meeting of the Association for Computational Linguistics, pp. 555-562. [find](https://scholar.google.com/scholar?q=Vicedo%2C+J%2E%2C+and+Ferr%C3%A1ndez%2C+A%2E+2000%2E+%E2%80%9CImportance+of+Pronominal+Anaphora+Resolution+in+Question%2D+Answering+System%E2%80%9D%2E+Proceedings+of+the+38+th+Annual+Meeting+of+the+Association+for+Computational+Linguisti)
34. Voorhees, E., and Tice, D. 1999. "[The TREC-8 Question Answering Track](https://md.research.elamur.ai/free/en/papers/voorhees-2000-trec-8-question-answering-track/) Evaluation". Proceedings of the 8 th Text REtrieval Conference (TREC-8), NIST Special Publication 500-246, pp. 83-106.
35. Voorhees, E., and Tice, D. 2000. “Building a Question Answering Test Collection”. Proceedings of the 23 rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Athens, Greece, pp. 200-207. [find](https://scholar.google.com/scholar?q=Voorhees%2C+E%2E%2C+and+Tice%2C+D%2E+2000%2E+%E2%80%9CBuilding+a+Question+Answering+Test+Collection%E2%80%9D%2E+Proceedings+of+the+23+rd+Annual+International+ACM+SIGIR+Conference+on+Research+and+Development+in+Information+Retrieva)
36. Winograd, T. 1972. Understanding Natural Language. Academic Press, New York, NY. [↗](https://doi.org/10.1016/0010-0285(72)90002-3)
37. Woods, W., Kaplan, R., and Webber, B. 1972. “The Lunar Sciences Natural Language Information System: Final Report”. Bolt Beranek and Newman Inc. (BBN), Report No. 2378. [find](https://scholar.google.com/scholar?q=Woods%2C+W%2E%2C+Kaplan%2C+R%2E%2C+and+Webber%2C+B%2E+1972%2E+%E2%80%9CThe+Lunar+Sciences+Natural+Language+Information+System%3A+Final+Report%E2%80%9D%2E+Bolt+Beranek+and+Newman+Inc%2E+%28BBN%29%2C+Report+No%2E+2378%2E)

*Updated 1 November 2026*