---
title: "Collective Content Selection for Concept-to-Text Generation (2005)"
description: "Concept-to-text generation systems must decide which of many database records… 94.0% precision. 16 references, cited by 75 papers here."
authors: ["Regina Barzilay", "Mirella Lapata"]
year: 2005
venue: "Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing"
source: "https://aclanthology.org/H05-1042/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/barzilay-2005-collective-content-selection-concept-text/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/barzilay-2005-collective-content-selection-concept-text/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2005](https://md.research.elamur.ai/free/en/papers/2005/) / Collective Content Selection for Concept-to-Text Generation

# Collective Content Selection for Concept-to-Text Generation

**Authors:** [Regina Barzilay](https://md.research.elamur.ai/free/en/authors/regina-barzilay/) and [Mirella Lapata](https://md.research.elamur.ai/free/en/authors/mirella-lapata/) · **Year:** 2005 · **Venue:** [Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing](https://md.research.elamur.ai/free/en/venues/hlt/) ([HLT 2005](https://md.research.elamur.ai/free/en/venues/hlt/2005/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/H05-1042/) · [PDF](https://aclanthology.org/H05-1042.pdf) · [OpenAlex](https://openalex.org/W2003170434)

**Citations:** 185 citations (OpenAlex, 2026-10-14) · [75](https://md.research.elamur.ai/free/en/papers/barzilay-2005-collective-content-selection-concept-text/cited-by/) in our library, of the 141,840 papers whose bibliographies we read

## Summary
Concept-to-text generation systems must decide which of many database records belong in the output text. This content selection step has traditionally been hand-written per domain, which is costly and hard to scale. Barzilay and Lapata learn selection rules automatically from a parallel corpus of American football (NFL) game summaries and the matching statistics database. Training labels come from automatically aligning summary text with database entries. Rather than judging each entry independently, the authors cast selection as collective classification. Each entry carries its own preference to be kept or dropped, and links between related entries penalise giving them different labels. Link types are derived automatically from database relations. The resulting cost function is minimised exactly and globally with a min-cut algorithm. The collective model reaches an F-score of 60.15%, roughly 10 points above a context-agnostic classifier. It also compares favourably with earlier work done in a simpler biographical domain. The study shows that coherence constraints between related facts help data-driven content selection, even in a large database with many interconnected records.

## Key points
- Data: 468 NFL game summaries paired with database entries, giving 105,792 instances.
  - 68 summaries were held out for testing.
  - 10 summaries (1,930 instances) were reserved for development.
- Automatic text–database alignment, checked against a gold standard, reached 94.0% precision and 90.4% recall.
- The collective classifier scored an F-score of 60.15%, a 10.4% F-score gain over the standard classifier (the same model with link scores set to zero). Paired t-tests showed significant gains in both precision and recall over that classifier and over a per-type majority baseline.
- For comparison, Duboue and McKeown (2003) reported a best F-score of 51.00% on simpler biographical summaries.
- The model favours recall and tends to overgenerate, leaving later pipeline components or a domain expert to filter its output.

## Interesting ideas
- **Choose items jointly, not one at a time.** Scoring each candidate alone cannot guarantee that the chosen set fits together. Adding pairwise penalties for splitting related items carries over to extractive summarisation, choosing facts for data-to-text reports, or picking related records in trade or geographic datasets.
- **Use min-cut for exact global inference.** Individual preferences plus pairwise agreement terms form a two-class graph-cut problem, which is solved optimally and efficiently. This is a cheap alternative to approximate inference whenever constraints are pairwise and two-way.
- **Get links from the database schema.** Candidate dependencies come from relational structure, such as entries sharing the same quarter, the same player, or the same action. This replaces heavy hand-crafted feature engineering, and the same approach works for any structured source with joinable attributes.
- **Build training labels by alignment.** Entries that are verbalised in human-written texts count as positives and the rest as negatives. This yields supervision with no manual labelling, and checking the alignment against a small gold sample shows how noisy the labels are.
- **Make the baseline a switch inside the full model.** Setting link weights to zero recovers the context-free classifier. The comparison therefore isolates exactly what the contextual constraints contribute, which is a clean ablation design worth reusing.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Edinburgh](https://md.research.elamur.ai/free/en/universities/university-of-edinburgh/) — University, Edinburgh, United Kingdom · 255 works · 68,771 citations
- [Massachusetts Institute of Technology](https://md.research.elamur.ai/free/en/universities/massachusetts-institute-of-technology/) — University, Cambridge, United States · 159 works · 65,157 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,086 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,889 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works

🧭 Topics (1): [✍️ Text generation](https://md.research.elamur.ai/free/en/topics/text-generation/) · 145 works

## Cite

Cite as: Regina Barzilay and Mirella Lapata. 2005. Collective Content Selection for Concept-to-Text Generation. Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{barzilay2005collective,
  title = {{Collective Content Selection for Concept-to-Text Generation}},
  author = {Regina Barzilay and Mirella Lapata},
  booktitle = {Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing},
  year = {2005},
  doi = {10.3115/1220575.1220617},
  url = {https://doi.org/10.3115/1220575.1220617}
}
```

- [← previous Machine Translation Using Probabilistic Synchronous Dependency Insertion Grammars](https://md.research.elamur.ai/free/en/papers/ding-2005-machine-translation-probabilistic-synchronous-dependency/)
- [next → Syntactic Features for Evaluation of Machine Translation](https://md.research.elamur.ai/free/en/papers/liu-2005-syntactic-features-evaluation-machine-translation/)
- [↑ back to papers of 2005](https://md.research.elamur.ai/free/en/papers/2005/)

## References

16 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. J. Besag. 1986. On the statistical analysis of dirty pictures. Journal of the Royal Statistical Society, 48:259– 302. [find](https://scholar.google.com/scholar?q=J%2E+Besag%2E+1986%2E+On+the+statistical+analysis+of+dirty+pictures%2E+Journal+of+the+Royal+Statistical+Society%2C+48%3A259%E2%80%93+302%2E)
2. Y. Boykov, O. Veksler, R. Zabih. 1999. Fast approximate energy minimization via graph cuts. In ICCV, 377– 384. [find](https://scholar.google.com/scholar?q=Y%2E+Boykov%2C+O%2E+Veksler%2C+R%2E+Zabih%2E+1999%2E+Fast+approximate+energy+minimization+via+graph+cuts%2E+In+ICCV%2C+377%E2%80%93+384%2E)
3. P. A. Duboue, K. R. McKeown. 2003. Statistical acquisition of content selection rules for natural language generation. In Proceedings of the EMNLP, 121–128. [find](https://scholar.google.com/scholar?q=P%2E+A%2E+Duboue%2C+K%2E+R%2E+McKeown%2E+2003%2E+Statistical+acquisition+of+content+selection+rules+for+natural+language+generation%2E+In+Proceedings+of+the+EMNLP%2C+121%E2%80%93128%2E)
4. D. Greig, B. Porteous, A. Seheult. 1989. Exact maximum a posteriori estimation for binary images. Journal of the Royal Statistical Society, 51(2):271–279. [find](https://scholar.google.com/scholar?q=D%2E+Greig%2C+B%2E+Porteous%2C+A%2E+Seheult%2E+1989%2E+Exact+maximum+a+posteriori+estimation+for+binary+images%2E+Journal+of+the+Royal+Statistical+Society%2C+51%282%29%3A271%E2%80%93279%2E)
5. K. Kukich. 1983. [Design of a knowledge-based report generator](https://md.research.elamur.ai/free/en/papers/kukich-1983-design-knowledge-based-report-generator/). In Proceedings of the ACL, 145–150.
6. J. Kupiec, J. O. Pedersen, F. Chen. 1995. A trainable document summarizer. In Proceedings of the SIGIR, 68–73. [find](https://scholar.google.com/scholar?q=J%2E+Kupiec%2C+J%2E+O%2E+Pedersen%2C+F%2E+Chen%2E+1995%2E+A+trainable+document+summarizer%2E+In+Proceedings+of+the+SIGIR%2C+68%E2%80%9373%2E)
7. K. R. McKeown. 1985. Text Generation: Using Discourse Strategies and Focus Constraints to Generate Natural Language Text. Cambridge University Press. [find](https://scholar.google.com/scholar?q=K%2E+R%2E+McKeown%2E+1985%2E+Text+Generation%3A+Using+Discourse+Strategies+and+Focus+Constraints+to+Generate+Natural+Language+Text%2E+Cambridge+University+Press%2E)
8. B. Pang, L. Lee. 2004. [A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts](https://md.research.elamur.ai/free/en/papers/pang-2004-sentimental-education-sentiment-analysis-subjectivity/). In Proceedings of the ACL, 271– 278, Barcelona, Spain.
9. G. Parks. 1990. An intelligent stochastic optimization routine for nuclear fuel cycle design. Nuclear Technology, 89:233–246. [find](https://scholar.google.com/scholar?q=G%2E+Parks%2E+1990%2E+An+intelligent+stochastic+optimization+routine+for+nuclear+fuel+cycle+design%2E+Nuclear+Technology%2C+89%3A233%E2%80%93246%2E)
10. E. Reiter, R. Dale. 2000. Building Natural Language Generation Systems. Cambridge University Press, Cambridge. [find](https://scholar.google.com/scholar?q=E%2E+Reiter%2C+R%2E+Dale%2E+2000%2E+Building+Natural+Language+Generation+Systems%2E+Cambridge+University+Press%2C+Cambridge%2E)
11. J. Robin. 1994. Revision-Based Generation of Natural Language Summaries Providing Historical Background. Ph.D. thesis, Columbia University. [find](https://scholar.google.com/scholar?q=J%2E+Robin%2E+1994%2E+Revision%2DBased+Generation+of+Natural+Language+Summaries+Providing+Historical+Background%2E+Ph%2ED%2E+thesis%2C+Columbia+University%2E)
12. M. Rogati, Y. Yang. 2002. High-performing feature selection for text classification. In Proceedings of the CIKM, 659–661. [find](https://scholar.google.com/scholar?q=M%2E+Rogati%2C+Y%2E+Yang%2E+2002%2E+High%2Dperforming+feature+selection+for+text+classification%2E+In+Proceedings+of+the+CIKM%2C+659%E2%80%93661%2E)
13. R. E. Schapire, Y. Singer. 2000. Boostexter: A boosting-based system for text categorization. Machine Learning, 39(2/3):135–168. [find](https://scholar.google.com/scholar?q=R%2E+E%2E+Schapire%2C+Y%2E+Singer%2E+2000%2E+Boostexter%3A+A+boosting%2Dbased+system+for+text+categorization%2E+Machine+Learning%2C+39%282%2F3%29%3A135%E2%80%93168%2E)
14. S. G. Sripada, E. Reiter, J. Hunter, J. Yu. 2001. A two-stage model for content determination. In Proceedings of the ACL-ENLG, 3–10. [find](https://scholar.google.com/scholar?q=S%2E+G%2E+Sripada%2C+E%2E+Reiter%2C+J%2E+Hunter%2C+J%2E+Yu%2E+2001%2E+A+two%2Dstage+model+for+content+determination%2E+In+Proceedings+of+the+ACL%2DENLG%2C+3%E2%80%9310%2E)
15. K. Tanaka-Ishii, K. Hasida, I. Noda. 1998. Reactive content selection in the generation of real-time soccer commentary. In Proceedings of the ACL/COLING, 1282–1288. [find](https://scholar.google.com/scholar?q=K%2E+Tanaka%2DIshii%2C+K%2E+Hasida%2C+I%2E+Noda%2E+1998%2E+Reactive+content+selection+in+the+generation+of+real%2Dtime+soccer+commentary%2E+In+Proceedings+of+the+ACL%2FCOLING%2C+1282%E2%80%931288%2E)
16. B. Taskar, P. Abbeel, D. Koller. 2002. Discriminative probabilistic models for relational data. In Proceedings of the UAI, 485–495. [find](https://scholar.google.com/scholar?q=B%2E+Taskar%2C+P%2E+Abbeel%2C+D%2E+Koller%2E+2002%2E+Discriminative+probabilistic+models+for+relational+data%2E+In+Proceedings+of+the+UAI%2C+485%E2%80%93495%2E)

*Updated 24 October 2026*