--- title: "A Language Modeling Approach to Information — Ponte 1998" description: "Classical probabilistic retrieval models need a separate indexing model to estimate term weights, and that indexing step usually rests on parametric…" authors: ["Jay M. Ponte", "W. Bruce Croft"] year: 1998 venue: "SIGIR 1998" source: "https://ciir.cs.umass.edu/pubfiles/ir-120.pdf" doi: "10.1145/290941.291008" licence: "author's copy (CIIR UMass) — read only" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/ponte-1998-language-modeling-approach-information/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/ponte-1998-language-modeling-approach-information/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [1998](https://md.research.elamur.ai/free/en/papers/1998/) / A Language Modeling Approach to Information Retrieval # A Language Modeling Approach to Information Retrieval **Authors:** Jay M. Ponte, W. Bruce Croft · **Year:** 1998 · **Venue:** SIGIR 1998 · **Licence:** author's copy (CIIR UMass) — read only **Links:** [Publisher's page](https://doi.org/10.1145/290941.291008) · [PDF](https://ciir.cs.umass.edu/pubfiles/ir-120.pdf) · [DOI 10.1145/290941.291008](https://doi.org/10.1145/290941.291008) · [OpenAlex](https://openalex.org/W4206765718) **Citations:** 1748 citations (openalex-snapshot · 2026-10-14) · [119](#cited-by) in our library, of the 140673 papers whose bibliographies we read ## Summary Classical probabilistic retrieval models need a separate indexing model to estimate term weights, and that indexing step usually rests on parametric assumptions about term distributions. Ponte and Croft avoid this split. They treat each document as a sample from its own language model and rank documents by the probability that this model would produce the query. To estimate each document model, they combine the document's maximum-likelihood term estimates with the average estimate across documents containing the term. A geometric risk function controls the weight of each part. Terms missing from a document fall back to their collection-wide frequency. They compared this query-likelihood ranking with INQUERY tf.idf weighting on TREC ad hoc collections. It gave better precision and recall without any hand-tuned weighting heuristics. The paper matters because it founded the language modeling approach to IR, the basis for later smoothing methods and many modern ranking models. ## Key points - Ranking principle: documents are ordered by query likelihood, the probability that the document's language model generates the query. It replaces explicit relevance-probability modeling. - Estimation is non-parametric: - a document's ML term estimate is blended with the mean estimate over documents containing that term; - the blend is weighted by a geometric-distribution risk function; - unseen terms get their collection frequency divided by collection size. - The query is modeled as a set of binary term-occurrence events (a multiple-Bernoulli view). Indexing and retrieval are not treated as separate models. - Evaluation used TREC ad hoc topics, including topics 202–250, with tf.idf weighting from INQUERY as the baseline. The LM approach beat the baseline on most recall levels and in average precision. - The authors present the framework as a basis for future work on richer document models and query expansion within the same theory. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* Fields: [Computing & GPUs](https://md.research.elamur.ai/free/en/shelves/computing/) ## Cited by Cited by 119 papers of our library cite it (of the 140673 whose bibliographies we read); 2 of them have a page here, 117 not yet. - [Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey](https://md.research.elamur.ai/free/en/papers/min-2021-recent-advances-natural-language-processing/) - [Improving Passage Retrieval with Zero-Shot Question Generation](https://md.research.elamur.ai/free/en/papers/sachan-2022-improving-passage-retrieval-zero-shot/) ## Cite The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{ponte1998language, title = {{A Language Modeling Approach to Information Retrieval}}, author = {Ponte, Jay M. and Croft, W. Bruce}, booktitle = {SIGIR 1998}, year = {1998}, doi = {10.1145/290941.291008}, url = {https://doi.org/10.1145/290941.291008} } ``` - [next → A Lexicalized Tree Adjoining Grammar for English](https://md.research.elamur.ai/free/en/papers/group-1998-lexicalized-tree-adjoining-grammar-english/) - [↑ back to papers of 1998](https://md.research.elamur.ai/free/en/papers/1998/)